-- Logs begin at Thu 2022-05-26 11:43:36 UTC, end at Thu 2022-05-26 13:00:30 UTC. -- May 26 12:17:14.351373 dv-cinder-815145-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 26 12:17:14.360661 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 12:17:14 2022] *** May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: nodename: dv-cinder-815145-10-iscsi May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: machine: x86_64 May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: clock source: unix May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: pcre jit disabled May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: detected number of CPU cores: 4 May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: current working directory: / May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: detected binary path: /usr/bin/uwsgi-core May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: your processes number limit is 47680 May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: your memory page size is 4096 bytes May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: detected max file descriptor number: 2048 May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: lock engine: pthread robust mutexes May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: thunder lock: enabled May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 12:17:14.363151 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 12:17:14.407679 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: Python main interpreter initialized at 0x562ccc0879c0 May 26 12:17:14.407679 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: python threads support enabled May 26 12:17:14.407679 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: your server socket listen backlog is limited to 100 connections May 26 12:17:14.407679 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: your mercy for graceful operations on workers is 90 seconds May 26 12:17:14.408004 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: mapped 403077 bytes (393 KB) for 2 cores May 26 12:17:14.408099 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: *** Operational MODE: preforking *** May 26 12:17:14.408375 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: *** uWSGI is running in multiple interpreter mode *** May 26 12:17:14.408375 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: spawned uWSGI master process (pid: 80132) May 26 12:17:14.408577 dv-cinder-815145-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 26 12:17:14.410479 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: spawned uWSGI worker 1 (pid: 80140, cores: 1) May 26 12:17:14.410479 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: spawned uWSGI worker 2 (pid: 80141, cores: 1) May 26 12:17:14.410479 dv-cinder-815145-10-iscsi devstack@keystone.service[80132]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 12:17:20.138444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:17:20.138444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: from cryptography.utils import int_from_bytes May 26 12:17:20.139176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:17:20.139176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: from cryptography.utils import int_from_bytes May 26 12:17:20.139286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:17:20.139286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: from cryptography.utils import int_from_bytes May 26 12:17:20.139683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:17:20.139683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: from cryptography.utils import int_from_bytes May 26 12:17:20.189453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:17:20.189631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:17:20.189828 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] command line args: [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:17:20.189924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:17:20.190142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:17:20.190232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:17:20.190306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ================================================================================ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:17:20.190376 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] command line args: [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:17:20.190528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] admin_token = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.190621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:17:20.190705 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ================================================================================ {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:17:20.190775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] config_dir = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.190962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] admin_token = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.191091 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.191209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] config_dir = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.191434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] config_source = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.191519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.191618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] config_source = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.191760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] debug = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.191843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] debug = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.191985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.192291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.192425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.192522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.192615 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.192777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.192969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.193087 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.193256 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.193438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.193546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] log_config_append = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.193653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.193779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] log_dir = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.193923 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.194062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] log_file = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.194221 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.194335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.194437 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.194651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.194729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] log_config_append = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.194899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.194986 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.195101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.195243 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.195325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] log_dir = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.195488 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.195636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] log_file = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.195718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.195963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.196097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.196371 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.196585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.196858 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.196955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.197163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.197296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.197373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.197524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.197770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.197846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.198105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.198192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.198399 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.198589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.199405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.199564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.199672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] publish_errors = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.199954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.200093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.200237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.200359 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.200436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.200509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.200658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.200767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.200926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.201073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.201153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] standard_threads = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.201387 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.201709 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.201811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.202004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] publish_errors = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.202082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.202247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.202367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] use_journal = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.202488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.202673 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.202748 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] use_json = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.202924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.203007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] use_stderr = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.203168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.203335 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] use_syslog = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.203412 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] standard_threads = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.203629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.203784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.203866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.204042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.204224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] use_journal = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.204305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.204515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] use_json = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.204641 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.204832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.204909 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] use_stderr = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.205089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.205221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] use_syslog = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.205353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.205603 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.205677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:17:20.205860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.206105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.206180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.206359 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.206574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.206722 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.206873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.207092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.207203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.207415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.207496 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.207746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.207875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.207990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.208244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.208362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.208496 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.208764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.208899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.209027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.209286 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.209365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.209538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.209778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.209864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.210118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.210197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.210376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.210628 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.210708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.210869 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.211078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.211163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.211367 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.211497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.211615 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.211742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.211879 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.211981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.212140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.212218 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.212392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.212478 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.212635 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.212763 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.212921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.212999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.213175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.213264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.213410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.213488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.213660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.213744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.213897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.214069 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.214151 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.214230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.214357 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.214435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.215193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.215319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.215459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.215538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.215706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.215792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.215942 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.216027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.216177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.216262 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.216429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.216507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.216684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.216781 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.216956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.217044 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.217206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.217290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.217441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.217525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.217679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.217756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.217914 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.217998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.218146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.218231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.218379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.218457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.218610 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.218688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.218841 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.218982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.219081 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.219148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.219307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.219426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.219525 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.219587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.219771 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.219861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.220006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.220093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.220234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.220313 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.220471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.220557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.220728 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.220816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.220969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.221089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.221203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.221293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.221443 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.221520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.221683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.221777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.221913 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.222042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.222180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.222281 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.222407 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.222518 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.222626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.222711 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.222865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.222988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.223108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.223196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.223330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.223418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.223592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.223674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.223816 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.223932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.224038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.224118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.224277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.224356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.224514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.224590 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.224773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.224868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.225020 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.225099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.225261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.225338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.225502 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.225580 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.225738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.225814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.225974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.226049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.226195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.226267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.226448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.226530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.226686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.226769 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.226924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.226999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.227161 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.227236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.227399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.227481 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.227635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.227716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.227869 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.227950 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.228104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.228186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.228336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.228412 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.228568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.228644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.228825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.228919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.229063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.229152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.229294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.229372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.229536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.229611 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.229771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.229854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.230008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.230083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.230280 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.230402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.230535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.230663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.230798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.230936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.231046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.231145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.231264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.231381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.external = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.231501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.231614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.231750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.231917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.232064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.232155 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.232228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.232373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.password = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.232456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.232607 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] auth.token = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.232705 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.232875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.232981 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.233114 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.233223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.233361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.233461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.external = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.233594 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.233696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.233842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.233998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.234235 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.234443 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.234520 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.password = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.234687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.234765 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.token = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.234926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.235002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.235170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.235248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.235418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.235504 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.235651 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.235728 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.235896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.235972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.236144 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.236222 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.236376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.236452 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.236615 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.236694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.236891 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.236971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.237135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.237212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.237383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.237459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.237624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.237703 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.237872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.237949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.238108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.238186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.238375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.238453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.238629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.238705 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.238865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.238941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.239104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.239181 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.239352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.239429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.239600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.239677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.239832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.239911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.240081 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.240159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.240319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.240404 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.240561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.240641 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.240821 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.240902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.241072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.241150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.241309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.241387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.241545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.241621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.241783 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.241859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.242022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.242099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.242264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.242341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.242501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.242584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.242738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.242817 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.242979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.243057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.243221 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.243297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.243457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.243535 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.243706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.243782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.243952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.244029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.244186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.244264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.244422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.244498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.244657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.244774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.244918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.244995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.245165 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.245241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.245414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.245500 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.245668 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.245744 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.245943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.246080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.246204 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.246382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.246526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.246656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.246763 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.246859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.246944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.247110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.247190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.247339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.247417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.247577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.247660 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.247820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.247899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.248060 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.248138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.248309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.248387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.248542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.248621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.248813 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.248894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.249060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.249138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.249294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.249372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.249530 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.249611 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.249774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.249856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.250006 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.250084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.250246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.250324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.250478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.250553 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.250715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.250796 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.250953 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.251030 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.251189 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.251266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.251426 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.251504 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.251665 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.251742 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.251895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.251977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.252137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.252215 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.252370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.252449 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.252603 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.252681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.252865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.252944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.253111 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.253188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.253345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.253421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.253583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.253661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.253818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.253895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.254049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.254126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.254288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.254365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.254523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.254601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.254765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.254842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.255013 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.255092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.255251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.255327 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.255489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.255567 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.255722 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.255799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.255951 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.256028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.256186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.256265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.256421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.256505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.256657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.256764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.256932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.257017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.257181 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.257294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.257430 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.257546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.257667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.257795 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.257901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.258043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.258140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.258288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.258429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.258515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.258723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.258801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.258956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.259034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.259211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.259299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.259451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.259528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.259688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.259766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.259933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.260017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.260179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.260255 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.260407 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.260484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.260660 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.260766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.260929 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.261008 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.261171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.261248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.261913 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.262008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.262159 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.262297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.262434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.262573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.262705 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.262786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.262872 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.262952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.263106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.263212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.263347 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.263433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.263590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.263689 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.263932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.264009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.264173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.264321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.264417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.264495 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.264668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.264791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.264949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.265041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.265192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.265270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.265441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.265518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.265682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.265768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.265926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.266003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.266165 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] role.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.266242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.266416 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] role.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.266502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.266651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.266728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.266903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.266980 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.267151 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.267236 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.267400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.267476 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.267639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.267715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.267885 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.267970 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.268123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] role.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.268201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.268369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.268445 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] role.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.268602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.268686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.268865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.268943 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.269122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.269200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.269373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.269461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.269619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.269697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.270122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.270207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.270371 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.270527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.270606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.270767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.270845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.271020 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.271106 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.271273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.271352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.271522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.271600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.271771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.271856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.272010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.272088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.272267 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.272413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.272523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.272656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.272792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.272936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.273035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.273192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.273269 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.273444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.273523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.273697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.273775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.273937 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.274014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.274196 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.274275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.274438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.274515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.274677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.274754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.274909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.274987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.275144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.275220 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] token.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.275381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.275457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.275633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.275717 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.275881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.275959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.276131 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.276207 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.276373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.276453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.276610 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.276686 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.276875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.276964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.277734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.277877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] token.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.277982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.278090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.278226 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.278380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.278492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.278632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.278711 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.278901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.278979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.279158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.279236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.279393 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.279474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.279643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.279720 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.279895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.279974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.280147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.280225 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.connection = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.280392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.280483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.280637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.280852 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.280949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.281024 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.281147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.281225 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.281383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.281459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.281623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.281702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.281862 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.281939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.282101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.282178 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.282349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.282428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.282587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.282674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.282835 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.282913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.283072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.283158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.283323 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.283401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.283561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.283639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.283803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.283888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.284044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.284285 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.284362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.284531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.284607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.284780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.284857 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.284957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:17:20.285037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.285272 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.285524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.285763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.286013 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.286248 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.286492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.286728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:17:20.286901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:17:20.315871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.316098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.316325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.317370 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.317607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.317835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.325467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.326996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.354234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.354463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.355556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.355798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.408540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.408664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.459862 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.460094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.460327 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.460565 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.528016 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.528198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.528283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.528384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.528464 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.528601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.528686 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.528850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.528944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.529054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.529137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.529273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.552437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.552696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.552810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.552938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.553021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.553165 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.553247 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.553388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.553480 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.553610 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.553692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.553827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.553919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.554051 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.565737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.565945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.579048 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.579282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.579534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.579761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.579983 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.580198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.580410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80140) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.580858 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.581097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.581330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.581558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.581776 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.581992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.582208 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:17:20.599119 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.599335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:17:20.599626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.599726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.599842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:17:20.599925 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:17:20.600122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.600202 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.600366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:17:20.600455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.600633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.600731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.600926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.601006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.601184 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.601438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.612227 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.612509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.612679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.612803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.612979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.613087 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.613248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.613529 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.621926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.622253 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.625253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.625535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.625619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.625821 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.625916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.626109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.626193 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.626391 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.626472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.626676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.626767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.626936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.627016 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.627205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.627285 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.627557 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.627638 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.627841 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.627922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.628113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.628200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.628384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.655433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.655617 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.657255 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.657445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.657550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.657724 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.662865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.662997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.663108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.663274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.663395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.663557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.670806 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.671096 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.671190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.671395 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.675603 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.675886 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.676005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.676286 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.676382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.676574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.676656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.676882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.676965 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.677160 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.677244 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.677433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.677515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.677701 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.677789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.677970 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.696926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.697213 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.697505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.697769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.702166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.702893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.705852 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.706155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.706566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.706862 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.711238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.711923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.714954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.715617 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.718766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.719071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.719374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.719457 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.719666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.719832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.719954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.720037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.720236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.720317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.720512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.720818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.739716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.740003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.740277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.740381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.740540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.740625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.740860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.741125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.748643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.749841 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.750449 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.750729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.751828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.753823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.754111 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.754396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.754678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.754903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.754987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.755186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.755472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.755755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.756032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.769208 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.769487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.770047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.770340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.770551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.770647 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.770831 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.770915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.771111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.771194 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.771402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.771685 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.771960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.772242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.789692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.790762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.793512 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.794560 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.796862 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.797900 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.798482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.799518 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.800133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.800430 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.800729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.801175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.801466 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.801749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.808191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.809403 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.809858 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.811008 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.813208 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.813504 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.813791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.814071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.814357 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.814648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.814929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.815204 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.823242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.823533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.824474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.825045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.825329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.825712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.832384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.832671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.832982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.833264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.833541 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.833621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80140) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:17:20.833818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.833912 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.834111 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.834192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.834384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.834465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.834651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.834730 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.834926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.835014 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.835203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.835285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.835459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.835539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.835735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.835814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.836001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.836081 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.836272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.836534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.836835 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.837098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80140) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:17:20.875744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ccc0879c0 pid: 80141 (default app) May 26 12:17:20.876613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562ccc0879c0 pid: 80140 (default app) May 26 12:17:20.879039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28e641-1d44-4e82-9841-2eb19d39dd83 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:20.879336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28e641-1d44-4e82-9841-2eb19d39dd83 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:20.879619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28e641-1d44-4e82-9841-2eb19d39dd83 None None] PATH_INFO: `/v3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:20.883993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Thu May 26 12:17:20 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:28.808219 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac112d-a8fe-401d-ab48-06dfbdb80242 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:28.808806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac112d-a8fe-401d-ab48-06dfbdb80242 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:28.808806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac112d-a8fe-401d-ab48-06dfbdb80242 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:28.813229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:28.818361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610bf8c-c128-4e24-aaff-4f6867b1655c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:28.818773 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610bf8c-c128-4e24-aaff-4f6867b1655c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:28.818914 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610bf8c-c128-4e24-aaff-4f6867b1655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:28.889609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: INFO dbcounter [None req-3610bf8c-c128-4e24-aaff-4f6867b1655c None None] Registered counter for database keystone May 26 12:17:28.912008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG oslo_db.sqlalchemy.engines [None req-3610bf8c-c128-4e24-aaff-4f6867b1655c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:17:28.918881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writer thread running {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:17:29.104571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG passlib.handlers.bcrypt [None req-3610bf8c-c128-4e24-aaff-4f6867b1655c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80141) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 12:17:29.104931 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG passlib.handlers.bcrypt [None req-3610bf8c-c128-4e24-aaff-4f6867b1655c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80141) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 12:17:29.160205 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3610bf8c-c128-4e24-aaff-4f6867b1655c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:29.161819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3610bf8c-c128-4e24-aaff-4f6867b1655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:29.289205 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 26 12:17:29.470434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac112d-a8fe-401d-ab48-06dfbdb80242 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:29.542721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: INFO dbcounter [None req-2fac112d-a8fe-401d-ab48-06dfbdb80242 None None] Registered counter for database keystone May 26 12:17:29.562100 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG oslo_db.sqlalchemy.engines [None req-2fac112d-a8fe-401d-ab48-06dfbdb80242 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:17:29.568220 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writer thread running {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:17:29.688867 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac112d-a8fe-401d-ab48-06dfbdb80242 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:29.693189 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d45bb7-6203-472e-ab37-c4f2300522f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:29.693855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d45bb7-6203-472e-ab37-c4f2300522f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:29.694148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d45bb7-6203-472e-ab37-c4f2300522f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:29.694436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d45bb7-6203-472e-ab37-c4f2300522f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:29.702671 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d45bb7-6203-472e-ab37-c4f2300522f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:29.753909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e5d45bb7-6203-472e-ab37-c4f2300522f0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 12:17:29.754211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d45bb7-6203-472e-ab37-c4f2300522f0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:29.764272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Thu May 26 12:17:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:17:29.770574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610bf8c-c128-4e24-aaff-4f6867b1655c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:29.785484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610bf8c-c128-4e24-aaff-4f6867b1655c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:29.789902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b74c7e-1b4d-4c27-ab01-f1d8a4fdf32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:29.791103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b74c7e-1b4d-4c27-ab01-f1d8a4fdf32b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:29.791460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b74c7e-1b4d-4c27-ab01-f1d8a4fdf32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:29.791754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b74c7e-1b4d-4c27-ab01-f1d8a4fdf32b admin admin] PATH_INFO: `/v3/projects/051f7e40d662400dae586acf29916006` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:29.793301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b74c7e-1b4d-4c27-ab01-f1d8a4fdf32b admin admin] RBAC: Authorizing `identity:get_project(project_id=051f7e40d662400dae586acf29916006)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:29.952142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c7b74c7e-1b4d-4c27-ab01-f1d8a4fdf32b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 12:17:29.952797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b74c7e-1b4d-4c27-ab01-f1d8a4fdf32b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:29.957215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Thu May 26 12:17:29 2022] GET /identity/v3/projects/051f7e40d662400dae586acf29916006 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:32.130775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa1b8d-5a9e-402e-8d9b-953a7b4d7e5d None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:32.131277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa1b8d-5a9e-402e-8d9b-953a7b4d7e5d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:32.131384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa1b8d-5a9e-402e-8d9b-953a7b4d7e5d None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:32.136250 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:17:32.141764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde6917-36a8-4497-a563-40be988a9c08 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:32.142143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde6917-36a8-4497-a563-40be988a9c08 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:32.142336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde6917-36a8-4497-a563-40be988a9c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:32.162012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ccde6917-36a8-4497-a563-40be988a9c08 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:32.163538 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ccde6917-36a8-4497-a563-40be988a9c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:32.171741 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 12:17:32.194033 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa1b8d-5a9e-402e-8d9b-953a7b4d7e5d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:32.206808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa1b8d-5a9e-402e-8d9b-953a7b4d7e5d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:32.211040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc74be-09bf-49e2-af83-9aa35395dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:32.211664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc74be-09bf-49e2-af83-9aa35395dd53 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:32.211949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc74be-09bf-49e2-af83-9aa35395dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:32.212229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc74be-09bf-49e2-af83-9aa35395dd53 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:32.220653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc74be-09bf-49e2-af83-9aa35395dd53 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:32.222444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc74be-09bf-49e2-af83-9aa35395dd53 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:32.231431 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Thu May 26 12:17:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:17:32.236681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde6917-36a8-4497-a563-40be988a9c08 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:32.245653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde6917-36a8-4497-a563-40be988a9c08 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:32.250085 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f138eb-3b35-466d-9a88-c5699fef471c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:32.250945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f138eb-3b35-466d-9a88-c5699fef471c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:32.251236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f138eb-3b35-466d-9a88-c5699fef471c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:32.251518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f138eb-3b35-466d-9a88-c5699fef471c admin admin] PATH_INFO: `/v3/users/6cb812d57b84461b8b6450ef1b357cc1` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:32.252953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f138eb-3b35-466d-9a88-c5699fef471c admin admin] RBAC: Authorizing `identity:get_user(user_id=6cb812d57b84461b8b6450ef1b357cc1)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:32.254790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f138eb-3b35-466d-9a88-c5699fef471c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:32.256333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Thu May 26 12:17:32 2022] GET /identity/v3/users/6cb812d57b84461b8b6450ef1b357cc1 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:34.517123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c470e-3f51-4a90-b126-31a32c7fa099 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:34.517666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c470e-3f51-4a90-b126-31a32c7fa099 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:34.517666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c470e-3f51-4a90-b126-31a32c7fa099 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:34.519297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:34.525060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79ffd5-2144-4048-91b4-73986d3856d6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:34.525717 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79ffd5-2144-4048-91b4-73986d3856d6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:34.526006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79ffd5-2144-4048-91b4-73986d3856d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:34.542708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2a79ffd5-2144-4048-91b4-73986d3856d6 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:34.543883 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2a79ffd5-2144-4048-91b4-73986d3856d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:34.551768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665f283-605d-42bc-90ba-dea6f52580c1 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:34.552064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665f283-605d-42bc-90ba-dea6f52580c1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:34.552348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665f283-605d-42bc-90ba-dea6f52580c1 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:34.553777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:17:34.559007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfa506-dba6-4459-8443-e9ba53acbfc7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:34.559304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfa506-dba6-4459-8443-e9ba53acbfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:34.559591 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfa506-dba6-4459-8443-e9ba53acbfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:34.599590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG passlib.handlers.bcrypt [None req-0cdfa506-dba6-4459-8443-e9ba53acbfc7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80140) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 12:17:34.600051 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG passlib.handlers.bcrypt [None req-0cdfa506-dba6-4459-8443-e9ba53acbfc7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80140) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 12:17:34.624672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:34.647458 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0cdfa506-dba6-4459-8443-e9ba53acbfc7 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:34.649173 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0cdfa506-dba6-4459-8443-e9ba53acbfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:34.649293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79ffd5-2144-4048-91b4-73986d3856d6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:34.673052 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:34.748871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:17:34.760052 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79ffd5-2144-4048-91b4-73986d3856d6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:34.771190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfa506-dba6-4459-8443-e9ba53acbfc7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:34.800873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dad6e-a3fb-4f99-bcae-a2a21dec3834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:34.801680 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dad6e-a3fb-4f99-bcae-a2a21dec3834 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:34.801966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dad6e-a3fb-4f99-bcae-a2a21dec3834 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:34.802245 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dad6e-a3fb-4f99-bcae-a2a21dec3834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:34.814793 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801dad6e-a3fb-4f99-bcae-a2a21dec3834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-801dad6e-a3fb-4f99-bcae-a2a21dec3834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:17:34.826921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:34.828168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:34.829041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:34.829041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:34.829041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:34.829041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:34.829041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:17:34.829041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:17:34.829041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:17:34.829041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:17:34.829041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:17:34.829041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:17:34.829041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:17:34.829041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:17:34.829041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:17:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:17:34.834466 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dad6e-a3fb-4f99-bcae-a2a21dec3834 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:34.922939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:34.942178 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dad6e-a3fb-4f99-bcae-a2a21dec3834 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:34.976387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6080247-107e-4b66-bacb-1781c0c6ae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:34.977094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6080247-107e-4b66-bacb-1781c0c6ae2d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:34.977382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6080247-107e-4b66-bacb-1781c0c6ae2d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:34.977974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfa506-dba6-4459-8443-e9ba53acbfc7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:34.978237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6080247-107e-4b66-bacb-1781c0c6ae2d None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:34.978998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6080247-107e-4b66-bacb-1781c0c6ae2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:34.979312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6080247-107e-4b66-bacb-1781c0c6ae2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:34.980321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:34.980737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6080247-107e-4b66-bacb-1781c0c6ae2d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:34.992788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:17:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:17:34.999156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6080247-107e-4b66-bacb-1781c0c6ae2d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:35.016510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2beea-a092-4ad1-bf2b-722f0185c670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:35.017449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2beea-a092-4ad1-bf2b-722f0185c670 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:35.017987 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2beea-a092-4ad1-bf2b-722f0185c670 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:35.018261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2beea-a092-4ad1-bf2b-722f0185c670 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:35.088100 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2beea-a092-4ad1-bf2b-722f0185c670 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:35.089590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2beea-a092-4ad1-bf2b-722f0185c670 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:35.097485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6080247-107e-4b66-bacb-1781c0c6ae2d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:35.130469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83360f-ad3b-4db6-b262-b388fa926830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:35.131347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83360f-ad3b-4db6-b262-b388fa926830 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:35.131635 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83360f-ad3b-4db6-b262-b388fa926830 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:35.131911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83360f-ad3b-4db6-b262-b388fa926830 None admin] PATH_INFO: `/v3/users/6cb812d57b84461b8b6450ef1b357cc1` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:35.133166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83360f-ad3b-4db6-b262-b388fa926830 None admin] RBAC: Authorizing `identity:get_user(user_id=6cb812d57b84461b8b6450ef1b357cc1)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:35.135117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83360f-ad3b-4db6-b262-b388fa926830 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:35.136739 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 9/16] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:17:34 2022] GET /identity/v3/users/6cb812d57b84461b8b6450ef1b357cc1 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:17:35.142002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83360f-ad3b-4db6-b262-b388fa926830 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:35.157336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:35.189519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 8/17] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:17:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:17:35.194908 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2beea-a092-4ad1-bf2b-722f0185c670 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:35.198463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:35.245074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83360f-ad3b-4db6-b262-b388fa926830 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:35.285023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801afbf-7d85-46f9-90af-ff925bbf73aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:35.285820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801afbf-7d85-46f9-90af-ff925bbf73aa None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:35.286104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801afbf-7d85-46f9-90af-ff925bbf73aa None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:35.286380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801afbf-7d85-46f9-90af-ff925bbf73aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:35.287566 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801afbf-7d85-46f9-90af-ff925bbf73aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:35.289039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801afbf-7d85-46f9-90af-ff925bbf73aa None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:35.291246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 10/18] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:17:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:35.296586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801afbf-7d85-46f9-90af-ff925bbf73aa None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:35.298771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2beea-a092-4ad1-bf2b-722f0185c670 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:35.334782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671ce2-fb2a-43bd-94bd-277455159d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:35.335708 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671ce2-fb2a-43bd-94bd-277455159d73 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:35.336070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671ce2-fb2a-43bd-94bd-277455159d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:35.336444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671ce2-fb2a-43bd-94bd-277455159d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:35.356816 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671ce2-fb2a-43bd-94bd-277455159d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:35.358258 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671ce2-fb2a-43bd-94bd-277455159d73 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-63671ce2-fb2a-43bd-94bd-277455159d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:17:35.380185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:35.381062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:35.381864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:17:35.381864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:17:35.381864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:17:35.381864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:17:35.381864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 9/19] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:17:35.389040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671ce2-fb2a-43bd-94bd-277455159d73 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:35.391424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:35.412952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801afbf-7d85-46f9-90af-ff925bbf73aa None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:35.455492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228775e-6bf4-4eff-ae3b-0bd9a5e5c1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:35.456421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228775e-6bf4-4eff-ae3b-0bd9a5e5c1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:35.456888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228775e-6bf4-4eff-ae3b-0bd9a5e5c1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:35.457296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228775e-6bf4-4eff-ae3b-0bd9a5e5c1e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:35.458712 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228775e-6bf4-4eff-ae3b-0bd9a5e5c1e1 None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.domain.id=default, user.id=6cb812d57b84461b8b6450ef1b357cc1) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:35.459425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228775e-6bf4-4eff-ae3b-0bd9a5e5c1e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:35.461210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:35.461626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228775e-6bf4-4eff-ae3b-0bd9a5e5c1e1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:35.471143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 11/20] 10.222.0.39 () {56 vars in 1322 bytes} [Thu May 26 12:17:35 2022] GET /identity/v3/role_assignments?user.id=6cb812d57b84461b8b6450ef1b357cc1&scope.domain.id=default&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 233 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:17:35.510304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671ce2-fb2a-43bd-94bd-277455159d73 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:35.555106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d25c3-7142-4a86-b51c-b200d4fa1740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:35.556148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d25c3-7142-4a86-b51c-b200d4fa1740 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:35.556444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d25c3-7142-4a86-b51c-b200d4fa1740 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:35.556822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d25c3-7142-4a86-b51c-b200d4fa1740 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:35.557647 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d25c3-7142-4a86-b51c-b200d4fa1740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:35.557968 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d25c3-7142-4a86-b51c-b200d4fa1740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:35.559419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d25c3-7142-4a86-b51c-b200d4fa1740 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:35.579602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 10/21] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:17:38.031913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f69ea7-c4e8-4dff-9097-b89f19899b93 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:38.031913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f69ea7-c4e8-4dff-9097-b89f19899b93 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:38.031913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f69ea7-c4e8-4dff-9097-b89f19899b93 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:38.031913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 12/22] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:38.048421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aabda9-723f-43c3-be07-b179034b184d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:38.049276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aabda9-723f-43c3-be07-b179034b184d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:38.049722 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aabda9-723f-43c3-be07-b179034b184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:38.070146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a0aabda9-723f-43c3-be07-b179034b184d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:38.071980 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a0aabda9-723f-43c3-be07-b179034b184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:38.158776 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 11/23] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:38.190867 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f69ea7-c4e8-4dff-9097-b89f19899b93 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:38.340982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f69ea7-c4e8-4dff-9097-b89f19899b93 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:38.388242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5c6f5-a88e-4006-995a-de878dadadaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:38.389078 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5c6f5-a88e-4006-995a-de878dadadaf None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:38.389369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5c6f5-a88e-4006-995a-de878dadadaf None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:38.389652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5c6f5-a88e-4006-995a-de878dadadaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:38.406214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5c6f5-a88e-4006-995a-de878dadadaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-94a5c6f5-a88e-4006-995a-de878dadadaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:17:38.414225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:38.415671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:38.416413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:38.416413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:38.416413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:38.416413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:38.416413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:17:38.416413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:17:38.416413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:17:38.416413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:17:38.416413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:17:38.416413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:17:38.416413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:17:38.416413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:17:38.416413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 13/24] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:17:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:17:38.421887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aabda9-723f-43c3-be07-b179034b184d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:38.497196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:38.567728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c15380-b5e3-4105-9366-d6e1ef0461d9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:38.568507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c15380-b5e3-4105-9366-d6e1ef0461d9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:38.569506 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c15380-b5e3-4105-9366-d6e1ef0461d9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:38.571753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 14/25] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:38.577426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee4806-516a-4712-b64d-8b432d9ea923 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:38.577950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee4806-516a-4712-b64d-8b432d9ea923 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:38.578427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee4806-516a-4712-b64d-8b432d9ea923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:38.578598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aabda9-723f-43c3-be07-b179034b184d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:38.601062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:38.606377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ebee4806-516a-4712-b64d-8b432d9ea923 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:38.607867 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ebee4806-516a-4712-b64d-8b432d9ea923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:38.717456 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b3b13-e131-481a-8b5b-2f81d1b0704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:38.718510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b3b13-e131-481a-8b5b-2f81d1b0704c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:38.719208 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b3b13-e131-481a-8b5b-2f81d1b0704c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:38.719208 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b3b13-e131-481a-8b5b-2f81d1b0704c None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:38.719493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 15/26] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:38.720135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b3b13-e131-481a-8b5b-2f81d1b0704c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:38.720452 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b3b13-e131-481a-8b5b-2f81d1b0704c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:38.721389 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859861-4954-4b75-9f04-55df22f3d32b None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:38.721847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859861-4954-4b75-9f04-55df22f3d32b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:38.721980 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b3b13-e131-481a-8b5b-2f81d1b0704c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:38.722386 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e859861-4954-4b75-9f04-55df22f3d32b None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:38.724528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 16/27] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:38.730059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9659d-10bc-4d18-a4c0-e3f1c2507b91 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:38.730536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9659d-10bc-4d18-a4c0-e3f1c2507b91 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:38.731532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9659d-10bc-4d18-a4c0-e3f1c2507b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:38.745164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 12/28] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:17:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:38.746687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f247d-52a8-4f0e-bfc4-aee32b08aa9f None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:38.747112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f247d-52a8-4f0e-bfc4-aee32b08aa9f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:38.747555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f247d-52a8-4f0e-bfc4-aee32b08aa9f None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:38.748940 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 13/29] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:38.754523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f247d-52a8-4f0e-bfc4-aee32b08aa9f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:38.756003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3ca9659d-10bc-4d18-a4c0-e3f1c2507b91 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:38.756645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3ca9659d-10bc-4d18-a4c0-e3f1c2507b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:38.829203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 17/30] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:38.830349 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9659d-10bc-4d18-a4c0-e3f1c2507b91 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:38.881662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f247d-52a8-4f0e-bfc4-aee32b08aa9f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:38.900462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:38.903482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:38.933486 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e681fc-4edc-4f94-a449-3bd3b9a2a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:38.935073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e681fc-4edc-4f94-a449-3bd3b9a2a099 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:38.935504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e681fc-4edc-4f94-a449-3bd3b9a2a099 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:38.935924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e681fc-4edc-4f94-a449-3bd3b9a2a099 None admin] PATH_INFO: `/v3/users/6cb812d57b84461b8b6450ef1b357cc1` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:38.938143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e681fc-4edc-4f94-a449-3bd3b9a2a099 None admin] RBAC: Authorizing `identity:get_user(user_id=6cb812d57b84461b8b6450ef1b357cc1)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:38.940371 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e681fc-4edc-4f94-a449-3bd3b9a2a099 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:38.942372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 14/31] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:17:38 2022] GET /identity/v3/users/6cb812d57b84461b8b6450ef1b357cc1 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:38.943570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e1cc3-b8e5-4f95-a3c5-3cc6557894e7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:38.943864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e1cc3-b8e5-4f95-a3c5-3cc6557894e7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:38.944145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e1cc3-b8e5-4f95-a3c5-3cc6557894e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:38.952944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9659d-10bc-4d18-a4c0-e3f1c2507b91 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:38.967902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3c5e1cc3-b8e5-4f95-a3c5-3cc6557894e7 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:38.969405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3c5e1cc3-b8e5-4f95-a3c5-3cc6557894e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:38.997594 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db30a4e-22c2-46ec-914b-0cbde81a5229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:38.998880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db30a4e-22c2-46ec-914b-0cbde81a5229 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:38.999388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db30a4e-22c2-46ec-914b-0cbde81a5229 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:39.000021 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db30a4e-22c2-46ec-914b-0cbde81a5229 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:39.001311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db30a4e-22c2-46ec-914b-0cbde81a5229 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:39.003298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db30a4e-22c2-46ec-914b-0cbde81a5229 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:39.055210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 15/32] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:39.057532 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e1cc3-b8e5-4f95-a3c5-3cc6557894e7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:39.171825 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 18/33] 10.222.0.39 () {60 vars in 1131 bytes} [Thu May 26 12:17:38 2022] POST /identity/v3/roles => generated 225 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:17:39.172846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db30a4e-22c2-46ec-914b-0cbde81a5229 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:39.179117 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e1cc3-b8e5-4f95-a3c5-3cc6557894e7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:39.190109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:39.253129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493d66f-1234-4ac4-a713-4665fb8cb725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:39.254268 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493d66f-1234-4ac4-a713-4665fb8cb725 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:39.254743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493d66f-1234-4ac4-a713-4665fb8cb725 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:39.255574 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493d66f-1234-4ac4-a713-4665fb8cb725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:39.281898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493d66f-1234-4ac4-a713-4665fb8cb725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:39.285676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493d66f-1234-4ac4-a713-4665fb8cb725 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-1493d66f-1234-4ac4-a713-4665fb8cb725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:17:39.327965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:39.328905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:39.329741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:17:39.329741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:17:39.329741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:17:39.329741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:17:39.337662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 16/34] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:17:39.340055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493d66f-1234-4ac4-a713-4665fb8cb725 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:39.401800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db30a4e-22c2-46ec-914b-0cbde81a5229 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:39.431044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:39.443085 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05177466-5c10-497e-8d2b-ba3a48825210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:39.444126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05177466-5c10-497e-8d2b-ba3a48825210 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:39.444880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05177466-5c10-497e-8d2b-ba3a48825210 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:39.445312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05177466-5c10-497e-8d2b-ba3a48825210 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:39.447441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05177466-5c10-497e-8d2b-ba3a48825210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:39.449855 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05177466-5c10-497e-8d2b-ba3a48825210 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:39.451752 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 19/35] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:17:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:39.452704 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05177466-5c10-497e-8d2b-ba3a48825210 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:39.509462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493d66f-1234-4ac4-a713-4665fb8cb725 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:39.546442 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93771fd4-55ab-4794-b841-8188c8183577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:39.547513 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771fd4-55ab-4794-b841-8188c8183577 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:39.547812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771fd4-55ab-4794-b841-8188c8183577 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:39.548099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771fd4-55ab-4794-b841-8188c8183577 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:39.549161 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93771fd4-55ab-4794-b841-8188c8183577 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:39.550723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93771fd4-55ab-4794-b841-8188c8183577 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:39.572104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05177466-5c10-497e-8d2b-ba3a48825210 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:39.608318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a800d-67cb-4707-b369-81bb9f856ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:39.609163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a800d-67cb-4707-b369-81bb9f856ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:39.609467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a800d-67cb-4707-b369-81bb9f856ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:39.609752 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a800d-67cb-4707-b369-81bb9f856ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:39.610550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a800d-67cb-4707-b369-81bb9f856ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:39.610874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a800d-67cb-4707-b369-81bb9f856ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:39.612266 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a800d-67cb-4707-b369-81bb9f856ad7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:39.631089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 20/36] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:39.635076 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a800d-67cb-4707-b369-81bb9f856ad7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:39.689000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 17/37] 10.222.0.39 () {60 vars in 1131 bytes} [Thu May 26 12:17:39 2022] POST /identity/v3/roles => generated 219 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:17:39.690723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d32172-daa2-4f37-b390-07f52bb7f0e4 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:39.691158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d32172-daa2-4f37-b390-07f52bb7f0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:39.691368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d32172-daa2-4f37-b390-07f52bb7f0e4 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:39.696839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 18/38] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:39.696839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d32172-daa2-4f37-b390-07f52bb7f0e4 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:39.721474 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:39.724283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:39.777776 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a800d-67cb-4707-b369-81bb9f856ad7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:39.826304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d32172-daa2-4f37-b390-07f52bb7f0e4 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:39.831895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b32e12-2951-4f03-8eb7-64170a179135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:39.833200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b32e12-2951-4f03-8eb7-64170a179135 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:39.833693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b32e12-2951-4f03-8eb7-64170a179135 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:39.834373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b32e12-2951-4f03-8eb7-64170a179135 None admin] PATH_INFO: `/v3/domains/default/users/6cb812d57b84461b8b6450ef1b357cc1/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:39.837445 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b32e12-2951-4f03-8eb7-64170a179135 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6cb812d57b84461b8b6450ef1b357cc1, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:39.839462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b32e12-2951-4f03-8eb7-64170a179135 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:39.858961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 21/39] 10.222.0.39 () {58 vars in 1361 bytes} [Thu May 26 12:17:39 2022] PUT /identity/v3/domains/default/users/6cb812d57b84461b8b6450ef1b357cc1/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:17:39.861175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df141b6-c9d1-45c9-8ee1-a04e26189d30 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:39.861950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df141b6-c9d1-45c9-8ee1-a04e26189d30 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:39.862515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df141b6-c9d1-45c9-8ee1-a04e26189d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:39.877961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d9fd0-95e6-4054-8482-076daf7aea66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:39.878505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d9fd0-95e6-4054-8482-076daf7aea66 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:39.878809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d9fd0-95e6-4054-8482-076daf7aea66 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:39.879097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d9fd0-95e6-4054-8482-076daf7aea66 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:39.884437 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d9fd0-95e6-4054-8482-076daf7aea66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:39.884437 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d9fd0-95e6-4054-8482-076daf7aea66 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:39.894722 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8df141b6-c9d1-45c9-8ee1-a04e26189d30 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:39.896848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8df141b6-c9d1-45c9-8ee1-a04e26189d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:39.920330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 19/40] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:17:39 2022] POST /identity/v3/projects => generated 301 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:17:39.926373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424de8-b74a-4fe2-87a2-ee30fdfdf811 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:39.926688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424de8-b74a-4fe2-87a2-ee30fdfdf811 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:39.926955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424de8-b74a-4fe2-87a2-ee30fdfdf811 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:39.928351 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 20/41] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:39.938218 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27029923-8f21-4c1b-9d71-6c9afaccd558 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:39.938518 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27029923-8f21-4c1b-9d71-6c9afaccd558 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:39.938811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27029923-8f21-4c1b-9d71-6c9afaccd558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:39.966100 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-27029923-8f21-4c1b-9d71-6c9afaccd558 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:39.968320 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-27029923-8f21-4c1b-9d71-6c9afaccd558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:40.000835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 22/42] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:40.027030 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df141b6-c9d1-45c9-8ee1-a04e26189d30 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:40.072925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:40.079656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 21/43] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:40.090963 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:40.109809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27029923-8f21-4c1b-9d71-6c9afaccd558 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:40.172427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df141b6-c9d1-45c9-8ee1-a04e26189d30 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:40.212034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29e020-d300-4747-bf73-053b498a7500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:40.212912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29e020-d300-4747-bf73-053b498a7500 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:40.213309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29e020-d300-4747-bf73-053b498a7500 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:40.213594 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29e020-d300-4747-bf73-053b498a7500 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:40.214933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29e020-d300-4747-bf73-053b498a7500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:40.216412 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29e020-d300-4747-bf73-053b498a7500 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:40.218227 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 23/44] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:17:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:40.223858 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29e020-d300-4747-bf73-053b498a7500 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:40.237566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27029923-8f21-4c1b-9d71-6c9afaccd558 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:40.277324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a058bf-e17f-466d-bc00-65be2fa9e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:40.278217 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a058bf-e17f-466d-bc00-65be2fa9e122 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:40.278586 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a058bf-e17f-466d-bc00-65be2fa9e122 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:40.278921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a058bf-e17f-466d-bc00-65be2fa9e122 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:40.279864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a058bf-e17f-466d-bc00-65be2fa9e122 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:40.281448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a058bf-e17f-466d-bc00-65be2fa9e122 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:40.300039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1131 bytes} [Thu May 26 12:17:40 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:17:40.345378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29e020-d300-4747-bf73-053b498a7500 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:40.358978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:40.387144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608832a7-85a2-49a2-8b15-f13cbf9c2383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:40.387839 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608832a7-85a2-49a2-8b15-f13cbf9c2383 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:40.388127 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608832a7-85a2-49a2-8b15-f13cbf9c2383 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:40.388408 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608832a7-85a2-49a2-8b15-f13cbf9c2383 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:40.389190 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608832a7-85a2-49a2-8b15-f13cbf9c2383 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:40.390763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608832a7-85a2-49a2-8b15-f13cbf9c2383 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:40.428754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:17:40 2022] POST /identity/v3/projects => generated 312 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:17:42.185084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea56d7d-8799-422c-8d0c-75f3375b9856 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:42.185578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea56d7d-8799-422c-8d0c-75f3375b9856 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:42.185578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea56d7d-8799-422c-8d0c-75f3375b9856 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:42.186942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 23/47] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:42.192416 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32545fbf-4390-4ff6-9073-735f84e06451 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:42.192827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32545fbf-4390-4ff6-9073-735f84e06451 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:42.193052 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32545fbf-4390-4ff6-9073-735f84e06451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:42.211590 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-32545fbf-4390-4ff6-9073-735f84e06451 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:42.212954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-32545fbf-4390-4ff6-9073-735f84e06451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:42.287932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 25/48] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:42.311542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea56d7d-8799-422c-8d0c-75f3375b9856 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:42.373516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:42.420173 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea56d7d-8799-422c-8d0c-75f3375b9856 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:42.454607 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cd85c-a123-4687-80dc-e230e37eddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:42.455421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd85c-a123-4687-80dc-e230e37eddd7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:42.455711 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd85c-a123-4687-80dc-e230e37eddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:42.455993 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cd85c-a123-4687-80dc-e230e37eddd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:42.469964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cd85c-a123-4687-80dc-e230e37eddd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-6b3cd85c-a123-4687-80dc-e230e37eddd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:17:42.479350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:42.480282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:42.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:42.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:42.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:42.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:42.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:17:42.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:17:42.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:17:42.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:17:42.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:17:42.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:17:42.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:17:42.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:17:42.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 24/49] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:17:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:17:42.487216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32545fbf-4390-4ff6-9073-735f84e06451 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:42.584632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:42.595086 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32545fbf-4390-4ff6-9073-735f84e06451 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:42.628353 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741c778-1865-402a-9d27-3d173b2474a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:42.629053 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741c778-1865-402a-9d27-3d173b2474a6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:42.629341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741c778-1865-402a-9d27-3d173b2474a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:42.629618 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741c778-1865-402a-9d27-3d173b2474a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:42.630372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741c778-1865-402a-9d27-3d173b2474a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:42.630686 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741c778-1865-402a-9d27-3d173b2474a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:42.632082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741c778-1865-402a-9d27-3d173b2474a6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:42.640814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 26/50] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:17:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:42.646304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cd85c-a123-4687-80dc-e230e37eddd7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:42.658308 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbfd57-263e-40c5-9b49-0132837c08c6 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:42.658608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbfd57-263e-40c5-9b49-0132837c08c6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:42.658893 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbfd57-263e-40c5-9b49-0132837c08c6 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:42.660257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 27/51] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:17:42.665229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e9c05-a9b1-45dd-bfeb-8f2336506d79 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:42.665524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e9c05-a9b1-45dd-bfeb-8f2336506d79 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:42.665811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e9c05-a9b1-45dd-bfeb-8f2336506d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:42.682896 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-320e9c05-a9b1-45dd-bfeb-8f2336506d79 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:42.684100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-320e9c05-a9b1-45dd-bfeb-8f2336506d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:42.748592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cd85c-a123-4687-80dc-e230e37eddd7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:42.749908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 28/52] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:17:42.770869 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:42.773954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e9c05-a9b1-45dd-bfeb-8f2336506d79 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:42.786058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027bcdf-1707-4628-b2a8-d11e9153bf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:42.786939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027bcdf-1707-4628-b2a8-d11e9153bf95 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:42.787235 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027bcdf-1707-4628-b2a8-d11e9153bf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:42.787520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027bcdf-1707-4628-b2a8-d11e9153bf95 None admin] PATH_INFO: `/v3/users/6cb812d57b84461b8b6450ef1b357cc1` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:42.788764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027bcdf-1707-4628-b2a8-d11e9153bf95 None admin] RBAC: Authorizing `identity:get_user(user_id=6cb812d57b84461b8b6450ef1b357cc1)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:42.790454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027bcdf-1707-4628-b2a8-d11e9153bf95 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:42.792088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 25/53] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:17:42 2022] GET /identity/v3/users/6cb812d57b84461b8b6450ef1b357cc1 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:42.797444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027bcdf-1707-4628-b2a8-d11e9153bf95 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:42.856723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:42.872802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e9c05-a9b1-45dd-bfeb-8f2336506d79 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:42.900058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027bcdf-1707-4628-b2a8-d11e9153bf95 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:42.907774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b416b-713e-4c01-8a48-b7add7d8f8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:42.908579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b416b-713e-4c01-8a48-b7add7d8f8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:42.908904 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b416b-713e-4c01-8a48-b7add7d8f8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:42.909191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b416b-713e-4c01-8a48-b7add7d8f8a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:42.910384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b416b-713e-4c01-8a48-b7add7d8f8a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:42.911869 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b416b-713e-4c01-8a48-b7add7d8f8a0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:42.913537 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 29/54] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:17:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:17:42.918975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b416b-713e-4c01-8a48-b7add7d8f8a0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:42.933501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03097d77-d1e6-44d2-b34a-ed9ccc52ce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:42.934310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03097d77-d1e6-44d2-b34a-ed9ccc52ce8a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:42.934600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03097d77-d1e6-44d2-b34a-ed9ccc52ce8a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:42.934883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03097d77-d1e6-44d2-b34a-ed9ccc52ce8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:42.936076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03097d77-d1e6-44d2-b34a-ed9ccc52ce8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:42.937568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03097d77-d1e6-44d2-b34a-ed9ccc52ce8a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:42.939188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 26/55] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:17:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:17:42.944957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03097d77-d1e6-44d2-b34a-ed9ccc52ce8a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:43.000071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:43.017641 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b416b-713e-4c01-8a48-b7add7d8f8a0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:43.046262 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03097d77-d1e6-44d2-b34a-ed9ccc52ce8a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:43.051168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c82ca-5e53-4241-b8be-5c0fabd8ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:43.051828 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c82ca-5e53-4241-b8be-5c0fabd8ec9b None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:43.052117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c82ca-5e53-4241-b8be-5c0fabd8ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:43.052397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c82ca-5e53-4241-b8be-5c0fabd8ec9b None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:43.053152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c82ca-5e53-4241-b8be-5c0fabd8ec9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:43.055121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c82ca-5e53-4241-b8be-5c0fabd8ec9b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:43.079968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 30/56] 10.222.0.39 () {60 vars in 1140 bytes} [Thu May 26 12:17:42 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:17:43.081489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce27d68-7930-45ff-b6b4-e2e2b332b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:43.082161 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce27d68-7930-45ff-b6b4-e2e2b332b8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:43.082455 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce27d68-7930-45ff-b6b4-e2e2b332b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:43.082791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce27d68-7930-45ff-b6b4-e2e2b332b8d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:43.083655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce27d68-7930-45ff-b6b4-e2e2b332b8d4 None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.domain.id=default, user.id=6cb812d57b84461b8b6450ef1b357cc1) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:43.084009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce27d68-7930-45ff-b6b4-e2e2b332b8d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:43.085542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce27d68-7930-45ff-b6b4-e2e2b332b8d4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:43.095681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 27/57] 10.222.0.39 () {56 vars in 1322 bytes} [Thu May 26 12:17:42 2022] GET /identity/v3/role_assignments?user.id=6cb812d57b84461b8b6450ef1b357cc1&scope.domain.id=default&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:17:45.329949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931815ac-1ec7-408b-bb2d-933ca766a1b6 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:45.330490 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931815ac-1ec7-408b-bb2d-933ca766a1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:45.330576 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931815ac-1ec7-408b-bb2d-933ca766a1b6 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:45.331902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 31/58] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:45.337399 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f7a4f-8d2d-4dd9-acdb-2a55afa52764 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:45.337784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f7a4f-8d2d-4dd9-acdb-2a55afa52764 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:45.337968 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f7a4f-8d2d-4dd9-acdb-2a55afa52764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:45.354597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d36f7a4f-8d2d-4dd9-acdb-2a55afa52764 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:45.355782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d36f7a4f-8d2d-4dd9-acdb-2a55afa52764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:45.420779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 28/59] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:45.445777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931815ac-1ec7-408b-bb2d-933ca766a1b6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:45.449726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:45.549403 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931815ac-1ec7-408b-bb2d-933ca766a1b6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:45.582564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e91d8-e1a2-4f45-b5e6-669d4f8e40d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:45.583292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e91d8-e1a2-4f45-b5e6-669d4f8e40d9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:45.583579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e91d8-e1a2-4f45-b5e6-669d4f8e40d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:45.583860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e91d8-e1a2-4f45-b5e6-669d4f8e40d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:45.585057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e91d8-e1a2-4f45-b5e6-669d4f8e40d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:45.586764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e91d8-e1a2-4f45-b5e6-669d4f8e40d9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:45.588343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 32/60] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:17:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:45.593730 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f7a4f-8d2d-4dd9-acdb-2a55afa52764 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:45.642349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:45.690601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f7a4f-8d2d-4dd9-acdb-2a55afa52764 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:45.723698 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74924888-6e0c-434e-9266-774f10af282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:45.724399 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924888-6e0c-434e-9266-774f10af282e None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:45.724686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924888-6e0c-434e-9266-774f10af282e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:45.724994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74924888-6e0c-434e-9266-774f10af282e None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:45.725706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74924888-6e0c-434e-9266-774f10af282e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:45.727878 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74924888-6e0c-434e-9266-774f10af282e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:45.752904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 29/61] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:17:45 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:17:49.742231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de0673-7fd2-404d-8277-bd4d1b068e81 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:49.743265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de0673-7fd2-404d-8277-bd4d1b068e81 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:49.743761 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de0673-7fd2-404d-8277-bd4d1b068e81 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:49.745764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 33/62] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:49.752573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7e5be-cfea-44f1-9b79-e1814c050e2f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:49.754190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7e5be-cfea-44f1-9b79-e1814c050e2f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:49.754735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7e5be-cfea-44f1-9b79-e1814c050e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:49.789969 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-11b7e5be-cfea-44f1-9b79-e1814c050e2f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:49.791763 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-11b7e5be-cfea-44f1-9b79-e1814c050e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:49.857349 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ec509-addc-4484-a162-57102292f534 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:49.858008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ec509-addc-4484-a162-57102292f534 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:49.858498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ec509-addc-4484-a162-57102292f534 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:49.860327 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 34/63] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:49.865169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bd40c-8e13-4586-aba3-c4a8b9b6339b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:49.865702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bd40c-8e13-4586-aba3-c4a8b9b6339b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:49.866205 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bd40c-8e13-4586-aba3-c4a8b9b6339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:49.890531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-dd1bd40c-8e13-4586-aba3-c4a8b9b6339b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:49.892172 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dd1bd40c-8e13-4586-aba3-c4a8b9b6339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:49.907680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 30/64] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:17:49.914067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7bae1-d2e2-413c-a0ca-d50b43f90c99 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:49.914606 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7bae1-d2e2-413c-a0ca-d50b43f90c99 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:49.915091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7bae1-d2e2-413c-a0ca-d50b43f90c99 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:49.916794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 31/65] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:49.922957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab56077-bfc1-4bd4-9f52-3e7c7c419cb9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:49.923627 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab56077-bfc1-4bd4-9f52-3e7c7c419cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:49.924105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab56077-bfc1-4bd4-9f52-3e7c7c419cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:49.953874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fab56077-bfc1-4bd4-9f52-3e7c7c419cb9 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:49.955405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fab56077-bfc1-4bd4-9f52-3e7c7c419cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:49.979395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 35/66] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:49.984792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09178-b3a5-491d-9405-6578ccb6eb55 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:49.984792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09178-b3a5-491d-9405-6578ccb6eb55 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:49.984792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09178-b3a5-491d-9405-6578ccb6eb55 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:49.987269 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 36/67] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:49.988250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc09178-b3a5-491d-9405-6578ccb6eb55 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:49.991879 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:50.002145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:50.050428 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 32/68] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:17:50.053294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d64bb-ed6a-48f0-b262-1024fb820d53 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:50.053294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d64bb-ed6a-48f0-b262-1024fb820d53 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:50.053294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d64bb-ed6a-48f0-b262-1024fb820d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:50.081234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f17d64bb-ed6a-48f0-b262-1024fb820d53 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:50.082590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f17d64bb-ed6a-48f0-b262-1024fb820d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:50.117817 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc09178-b3a5-491d-9405-6578ccb6eb55 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:50.160499 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53091172-d38c-4b0d-8c0f-d4b75aaf0f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:50.168889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 33/69] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:50.169058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53091172-d38c-4b0d-8c0f-d4b75aaf0f8a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:50.169058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53091172-d38c-4b0d-8c0f-d4b75aaf0f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:50.169058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53091172-d38c-4b0d-8c0f-d4b75aaf0f8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:50.169270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d64bb-ed6a-48f0-b262-1024fb820d53 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:50.181675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53091172-d38c-4b0d-8c0f-d4b75aaf0f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-53091172-d38c-4b0d-8c0f-d4b75aaf0f8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:17:50.195336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:50.196347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:50.197398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:50.197398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:50.197398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:50.197398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:50.197398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:17:50.197398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:17:50.197398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:17:50.197398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:17:50.197398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:17:50.197398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:17:50.197398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:17:50.197398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:17:50.197398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 37/70] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:17:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:17:50.198376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53091172-d38c-4b0d-8c0f-d4b75aaf0f8a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:50.265287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:50.274105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:50.280513 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d64bb-ed6a-48f0-b262-1024fb820d53 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:50.308075 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53091172-d38c-4b0d-8c0f-d4b75aaf0f8a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:50.314793 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f4fe2-28d1-4c93-ba5e-a9e4d93c4527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:50.315601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f4fe2-28d1-4c93-ba5e-a9e4d93c4527 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:50.315890 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f4fe2-28d1-4c93-ba5e-a9e4d93c4527 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:50.316168 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f4fe2-28d1-4c93-ba5e-a9e4d93c4527 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:50.327345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f4fe2-28d1-4c93-ba5e-a9e4d93c4527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-343f4fe2-28d1-4c93-ba5e-a9e4d93c4527 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:17:50.335554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:50.337021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:50.337865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:50.337865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:50.337865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:50.337865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:50.337865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:17:50.337865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:17:50.337865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:17:50.337865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:17:50.337865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:17:50.337865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:17:50.337865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:17:50.337865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:17:50.337865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 34/71] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:17:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:17:50.338692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa52ea5-f003-43e0-979d-23eae50ee963 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:50.338692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa52ea5-f003-43e0-979d-23eae50ee963 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:50.338857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa52ea5-f003-43e0-979d-23eae50ee963 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:50.340021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 35/72] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:50.340868 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa52ea5-f003-43e0-979d-23eae50ee963 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:50.357841 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54ba01-8487-408b-997d-ca838daef952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:50.358773 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54ba01-8487-408b-997d-ca838daef952 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:50.359059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54ba01-8487-408b-997d-ca838daef952 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:50.359337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54ba01-8487-408b-997d-ca838daef952 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:50.371873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54ba01-8487-408b-997d-ca838daef952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-eb54ba01-8487-408b-997d-ca838daef952 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:17:50.379880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:50.380797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:50.381587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:50.381587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:50.381587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:50.381587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:50.381587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:17:50.381587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:17:50.381587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:17:50.381587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:17:50.381587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:17:50.381587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:17:50.381587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:17:50.381587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:17:50.381587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 38/73] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:17:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:17:50.382933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54ba01-8487-408b-997d-ca838daef952 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:50.453732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa52ea5-f003-43e0-979d-23eae50ee963 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:50.488360 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fca83c-e9a4-4a1c-afd8-d2ca1af61125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:50.489202 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fca83c-e9a4-4a1c-afd8-d2ca1af61125 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:50.489491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fca83c-e9a4-4a1c-afd8-d2ca1af61125 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:50.489767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fca83c-e9a4-4a1c-afd8-d2ca1af61125 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:50.497478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54ba01-8487-408b-997d-ca838daef952 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:50.500577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fca83c-e9a4-4a1c-afd8-d2ca1af61125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-95fca83c-e9a4-4a1c-afd8-d2ca1af61125 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:17:50.508982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:50.509994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:50.510774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:50.510774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:50.510774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:50.510774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:50.510774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:17:50.510774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:17:50.510774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:17:50.510774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:17:50.510774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:17:50.510774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:17:50.510774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:17:50.510774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:17:50.510774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 36/74] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:17:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:17:50.511677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fca83c-e9a4-4a1c-afd8-d2ca1af61125 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:50.530100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:50.530273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:50.543819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968510cd-a32f-4367-a23a-adab2c587a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:50.544497 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968510cd-a32f-4367-a23a-adab2c587a57 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:50.544814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968510cd-a32f-4367-a23a-adab2c587a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:50.545094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968510cd-a32f-4367-a23a-adab2c587a57 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:50.545920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968510cd-a32f-4367-a23a-adab2c587a57 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:50.546172 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968510cd-a32f-4367-a23a-adab2c587a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:50.547571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968510cd-a32f-4367-a23a-adab2c587a57 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:50.557418 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 39/75] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:17:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:50.558895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cd93a-d123-4dd8-89d0-83507fca6cee None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:50.559388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cd93a-d123-4dd8-89d0-83507fca6cee None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:50.559692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cd93a-d123-4dd8-89d0-83507fca6cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:50.585333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-922cd93a-d123-4dd8-89d0-83507fca6cee None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:50.586619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-922cd93a-d123-4dd8-89d0-83507fca6cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:50.625989 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fca83c-e9a4-4a1c-afd8-d2ca1af61125 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:50.660916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 40/76] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:50.661938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cd93a-d123-4dd8-89d0-83507fca6cee None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:50.665055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded1d78-2711-4398-b152-b66144885ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:50.668102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1d78-2711-4398-b152-b66144885ebb None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:50.669494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1d78-2711-4398-b152-b66144885ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:50.669789 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1d78-2711-4398-b152-b66144885ebb None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:50.670736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded1d78-2711-4398-b152-b66144885ebb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:50.671052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded1d78-2711-4398-b152-b66144885ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:50.672995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded1d78-2711-4398-b152-b66144885ebb None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:50.689307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 37/77] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:17:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:50.689307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded1d78-2711-4398-b152-b66144885ebb None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:50.764131 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cd93a-d123-4dd8-89d0-83507fca6cee None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:50.768683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:50.781006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:50.793235 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded1d78-2711-4398-b152-b66144885ebb None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:50.802164 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f0db5-eae6-4979-a05c-f6724d60d8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:50.802843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f0db5-eae6-4979-a05c-f6724d60d8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:50.803130 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f0db5-eae6-4979-a05c-f6724d60d8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:50.803415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f0db5-eae6-4979-a05c-f6724d60d8d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:50.804755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f0db5-eae6-4979-a05c-f6724d60d8d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:50.805060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f0db5-eae6-4979-a05c-f6724d60d8d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:50.806458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f0db5-eae6-4979-a05c-f6724d60d8d5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:50.814480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 41/78] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:17:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:50.816419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f0db5-eae6-4979-a05c-f6724d60d8d5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:50.828660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01082c4b-1a19-48de-a82e-629fe8bd2a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:50.829362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01082c4b-1a19-48de-a82e-629fe8bd2a4f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:50.829651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01082c4b-1a19-48de-a82e-629fe8bd2a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:50.829936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01082c4b-1a19-48de-a82e-629fe8bd2a4f None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:50.830692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01082c4b-1a19-48de-a82e-629fe8bd2a4f None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:50.831004 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01082c4b-1a19-48de-a82e-629fe8bd2a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:50.832388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01082c4b-1a19-48de-a82e-629fe8bd2a4f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:50.840577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 38/79] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:17:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:50.841519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01082c4b-1a19-48de-a82e-629fe8bd2a4f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:50.923465 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f0db5-eae6-4979-a05c-f6724d60d8d5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:50.962167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9913b53-dad8-4b93-b5cb-4a6bd811c74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:50.963041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9913b53-dad8-4b93-b5cb-4a6bd811c74f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:50.963323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9913b53-dad8-4b93-b5cb-4a6bd811c74f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:50.963602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9913b53-dad8-4b93-b5cb-4a6bd811c74f None admin] PATH_INFO: `/v3/users/99e8056eecf3447b9595d527690fedf8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:50.966439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01082c4b-1a19-48de-a82e-629fe8bd2a4f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:50.978407 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9913b53-dad8-4b93-b5cb-4a6bd811c74f None admin] RBAC: Authorizing `identity:get_user(user_id=99e8056eecf3447b9595d527690fedf8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:50.979894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9913b53-dad8-4b93-b5cb-4a6bd811c74f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:50.981625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 42/80] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:17:50 2022] GET /identity/v3/users/99e8056eecf3447b9595d527690fedf8 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:50.982393 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9913b53-dad8-4b93-b5cb-4a6bd811c74f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:51.001884 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3c423-b6bb-49c4-ad9e-64a9f84703ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:51.002775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3c423-b6bb-49c4-ad9e-64a9f84703ae None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:51.003067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3c423-b6bb-49c4-ad9e-64a9f84703ae None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:51.003349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3c423-b6bb-49c4-ad9e-64a9f84703ae None admin] PATH_INFO: `/v3/users/6cb812d57b84461b8b6450ef1b357cc1` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:51.004559 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3c423-b6bb-49c4-ad9e-64a9f84703ae None admin] RBAC: Authorizing `identity:get_user(user_id=6cb812d57b84461b8b6450ef1b357cc1)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:51.006059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3c423-b6bb-49c4-ad9e-64a9f84703ae None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:51.007741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 39/81] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:17:50 2022] GET /identity/v3/users/6cb812d57b84461b8b6450ef1b357cc1 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:51.008499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3c423-b6bb-49c4-ad9e-64a9f84703ae None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:51.016623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:51.020519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:51.081789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9913b53-dad8-4b93-b5cb-4a6bd811c74f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:51.111201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3c423-b6bb-49c4-ad9e-64a9f84703ae None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:51.116093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537a0d-288e-4d86-837d-c8abb94d0d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:51.116929 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537a0d-288e-4d86-837d-c8abb94d0d34 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:51.117223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537a0d-288e-4d86-837d-c8abb94d0d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:51.117504 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3537a0d-288e-4d86-837d-c8abb94d0d34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:51.118778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3537a0d-288e-4d86-837d-c8abb94d0d34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:51.120250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3537a0d-288e-4d86-837d-c8abb94d0d34 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:51.121939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 43/82] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:17:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:51.122711 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537a0d-288e-4d86-837d-c8abb94d0d34 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:51.144849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3840f-1985-43dd-ad95-fe89d64753a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:51.145730 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3840f-1985-43dd-ad95-fe89d64753a9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:51.146029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3840f-1985-43dd-ad95-fe89d64753a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:51.146313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3840f-1985-43dd-ad95-fe89d64753a9 None admin] PATH_INFO: `/v3/users/99e8056eecf3447b9595d527690fedf8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:51.148026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3840f-1985-43dd-ad95-fe89d64753a9 None admin] RBAC: Authorizing `identity:get_user(user_id=99e8056eecf3447b9595d527690fedf8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:51.149514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3840f-1985-43dd-ad95-fe89d64753a9 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:51.151147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 40/83] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:17:51 2022] GET /identity/v3/users/99e8056eecf3447b9595d527690fedf8 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:51.151912 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3840f-1985-43dd-ad95-fe89d64753a9 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:51.220667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3537a0d-288e-4d86-837d-c8abb94d0d34 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:51.222335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:51.230570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:51.255023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3840f-1985-43dd-ad95-fe89d64753a9 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:51.256905 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58f008-4fb4-406c-99ad-90fcc6aedfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:51.258014 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58f008-4fb4-406c-99ad-90fcc6aedfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:51.258303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58f008-4fb4-406c-99ad-90fcc6aedfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:51.258580 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58f008-4fb4-406c-99ad-90fcc6aedfc2 None admin] PATH_INFO: `/v3/users/99e8056eecf3447b9595d527690fedf8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:51.259785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58f008-4fb4-406c-99ad-90fcc6aedfc2 None admin] RBAC: Authorizing `identity:get_user(user_id=99e8056eecf3447b9595d527690fedf8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:51.261269 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58f008-4fb4-406c-99ad-90fcc6aedfc2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:51.262897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 44/84] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:17:51 2022] GET /identity/v3/users/99e8056eecf3447b9595d527690fedf8 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:51.265851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58f008-4fb4-406c-99ad-90fcc6aedfc2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:51.289814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644db48-6a6d-4e8e-bcc6-2814864aaaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:51.290457 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644db48-6a6d-4e8e-bcc6-2814864aaaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:51.290747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644db48-6a6d-4e8e-bcc6-2814864aaaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:51.291021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644db48-6a6d-4e8e-bcc6-2814864aaaf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:51.357088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644db48-6a6d-4e8e-bcc6-2814864aaaf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:51.358474 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644db48-6a6d-4e8e-bcc6-2814864aaaf1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:51.364185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58f008-4fb4-406c-99ad-90fcc6aedfc2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:51.399215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdecc4-9df0-4666-aaf0-dfa05597cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:51.399863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdecc4-9df0-4666-aaf0-dfa05597cc31 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:51.400146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdecc4-9df0-4666-aaf0-dfa05597cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:51.400424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdecc4-9df0-4666-aaf0-dfa05597cc31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:51.436269 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:51.440338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:51.461132 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 41/85] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:17:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:17:51.461971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644db48-6a6d-4e8e-bcc6-2814864aaaf1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:51.474837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdecc4-9df0-4666-aaf0-dfa05597cc31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:51.476394 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bdecc4-9df0-4666-aaf0-dfa05597cc31 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:51.557641 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644db48-6a6d-4e8e-bcc6-2814864aaaf1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:51.573303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 45/86] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:17:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:17:51.573974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdecc4-9df0-4666-aaf0-dfa05597cc31 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:51.592075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54922b5f-f9f4-45ff-99b4-a932568a286d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:51.592768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922b5f-f9f4-45ff-99b4-a932568a286d None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:51.593056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922b5f-f9f4-45ff-99b4-a932568a286d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:51.593332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922b5f-f9f4-45ff-99b4-a932568a286d None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:51.594041 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54922b5f-f9f4-45ff-99b4-a932568a286d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:51.595473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54922b5f-f9f4-45ff-99b4-a932568a286d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:51.615460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 42/87] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:17:51 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:17:51.616208 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54922b5f-f9f4-45ff-99b4-a932568a286d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:51.651027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:51.654960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:51.687725 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bdecc4-9df0-4666-aaf0-dfa05597cc31 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:51.727684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e93f1-5bb5-41d7-bbe6-0674b24f07b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:51.728356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e93f1-5bb5-41d7-bbe6-0674b24f07b8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:51.728647 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e93f1-5bb5-41d7-bbe6-0674b24f07b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:51.728962 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e93f1-5bb5-41d7-bbe6-0674b24f07b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:51.743176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54922b5f-f9f4-45ff-99b4-a932568a286d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:51.785201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ef58d-b35d-401d-9ad0-2c2d581a4988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:51.785911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ef58d-b35d-401d-9ad0-2c2d581a4988 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:51.786179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ef58d-b35d-401d-9ad0-2c2d581a4988 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:51.786471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ef58d-b35d-401d-9ad0-2c2d581a4988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:51.810720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e93f1-5bb5-41d7-bbe6-0674b24f07b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:51.812597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e93f1-5bb5-41d7-bbe6-0674b24f07b8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:51.871115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ef58d-b35d-401d-9ad0-2c2d581a4988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:51.873322 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ef58d-b35d-401d-9ad0-2c2d581a4988 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:51.914716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:51.918229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:51.953202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 46/88] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:17:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:17:51.953896 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e93f1-5bb5-41d7-bbe6-0674b24f07b8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:52.008498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 43/89] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:17:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:17:52.009619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ef58d-b35d-401d-9ad0-2c2d581a4988 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:52.087728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e93f1-5bb5-41d7-bbe6-0674b24f07b8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:52.129209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ef58d-b35d-401d-9ad0-2c2d581a4988 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:52.129746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c18d05-044d-4201-a6c8-bb1f381dc2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:52.130644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c18d05-044d-4201-a6c8-bb1f381dc2bc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:52.131025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c18d05-044d-4201-a6c8-bb1f381dc2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:52.131312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c18d05-044d-4201-a6c8-bb1f381dc2bc None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:52.134403 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c18d05-044d-4201-a6c8-bb1f381dc2bc None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:52.135900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c18d05-044d-4201-a6c8-bb1f381dc2bc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:52.138127 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 47/90] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:17:51 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:52.138931 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c18d05-044d-4201-a6c8-bb1f381dc2bc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:52.164070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:52.170910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffbf8d-399e-4e1f-b755-55884c641fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:52.172075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffbf8d-399e-4e1f-b755-55884c641fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:52.172592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffbf8d-399e-4e1f-b755-55884c641fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:52.173101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffbf8d-399e-4e1f-b755-55884c641fa8 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:52.174521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffbf8d-399e-4e1f-b755-55884c641fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:52.176233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffbf8d-399e-4e1f-b755-55884c641fa8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:52.178435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 44/91] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:17:52 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:52.179959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffbf8d-399e-4e1f-b755-55884c641fa8 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:52.189744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:52.261088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c18d05-044d-4201-a6c8-bb1f381dc2bc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:52.292938 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffbf8d-399e-4e1f-b755-55884c641fa8 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:52.308796 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59fdd5-460c-4be8-9110-01526556269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:52.309789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59fdd5-460c-4be8-9110-01526556269e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:52.310080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59fdd5-460c-4be8-9110-01526556269e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:52.310365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59fdd5-460c-4be8-9110-01526556269e None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:52.311668 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59fdd5-460c-4be8-9110-01526556269e None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:52.313193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59fdd5-460c-4be8-9110-01526556269e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:52.315162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 48/92] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:17:52 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:52.315988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59fdd5-460c-4be8-9110-01526556269e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:52.334336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ef7dd-bd4a-4781-ab72-537bfbb56942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:52.336150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ef7dd-bd4a-4781-ab72-537bfbb56942 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:52.336661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ef7dd-bd4a-4781-ab72-537bfbb56942 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:52.337190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ef7dd-bd4a-4781-ab72-537bfbb56942 None admin] PATH_INFO: `/v3/projects/b76e43674e884119998104ebcfc7992e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:52.338881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ef7dd-bd4a-4781-ab72-537bfbb56942 None admin] RBAC: Authorizing `identity:get_project(project_id=b76e43674e884119998104ebcfc7992e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:52.340582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ef7dd-bd4a-4781-ab72-537bfbb56942 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:52.343129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 45/93] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:17:52 2022] GET /identity/v3/projects/b76e43674e884119998104ebcfc7992e => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:52.344145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ef7dd-bd4a-4781-ab72-537bfbb56942 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:52.418934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:52.445638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59fdd5-460c-4be8-9110-01526556269e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:52.456391 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:52.461002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ef7dd-bd4a-4781-ab72-537bfbb56942 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:52.490060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c381a-5162-4585-8c0e-fea11e19f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:52.490060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c381a-5162-4585-8c0e-fea11e19f4bd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:52.492989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c381a-5162-4585-8c0e-fea11e19f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:52.492989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c381a-5162-4585-8c0e-fea11e19f4bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:52.492989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c381a-5162-4585-8c0e-fea11e19f4bd None admin] RBAC: Adding query filter params (role.id=512083f4095a4f23a8dd4e8789fa20b3, scope.project.id=7cc93986f17a48809b5e9aa58ea66925, user.id=99e8056eecf3447b9595d527690fedf8) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:52.492989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c381a-5162-4585-8c0e-fea11e19f4bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:52.493907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c381a-5162-4585-8c0e-fea11e19f4bd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:52.505162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 49/94] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:17:52 2022] GET /identity/v3/role_assignments?user.id=99e8056eecf3447b9595d527690fedf8&scope.project.id=7cc93986f17a48809b5e9aa58ea66925&role.id=512083f4095a4f23a8dd4e8789fa20b3 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:52.506314 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c381a-5162-4585-8c0e-fea11e19f4bd None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:52.516810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfd11d-dca4-4d74-b2af-2be9a04ff655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:52.518861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfd11d-dca4-4d74-b2af-2be9a04ff655 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:52.519390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfd11d-dca4-4d74-b2af-2be9a04ff655 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:52.519858 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfd11d-dca4-4d74-b2af-2be9a04ff655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:52.520942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfd11d-dca4-4d74-b2af-2be9a04ff655 None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=7cc93986f17a48809b5e9aa58ea66925, user.id=6cb812d57b84461b8b6450ef1b357cc1) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:52.521456 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfd11d-dca4-4d74-b2af-2be9a04ff655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:52.523306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfd11d-dca4-4d74-b2af-2be9a04ff655 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:52.530960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 46/95] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:17:52 2022] GET /identity/v3/role_assignments?user.id=6cb812d57b84461b8b6450ef1b357cc1&scope.project.id=7cc93986f17a48809b5e9aa58ea66925&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:52.532696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfd11d-dca4-4d74-b2af-2be9a04ff655 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:52.675282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfd11d-dca4-4d74-b2af-2be9a04ff655 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:52.711861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:52.718644 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261a83f-9916-41e6-9256-020c8ccec706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:52.719731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261a83f-9916-41e6-9256-020c8ccec706 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:52.720213 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261a83f-9916-41e6-9256-020c8ccec706 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:52.720705 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261a83f-9916-41e6-9256-020c8ccec706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:52.721913 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261a83f-9916-41e6-9256-020c8ccec706 None admin] RBAC: Adding query filter params (role.id=c860ed9e0b784b18a457abd0ddb5f508, scope.project.id=b76e43674e884119998104ebcfc7992e, user.id=99e8056eecf3447b9595d527690fedf8) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:52.722459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261a83f-9916-41e6-9256-020c8ccec706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:52.724291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261a83f-9916-41e6-9256-020c8ccec706 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:52.732087 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 47/96] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:17:52 2022] GET /identity/v3/role_assignments?user.id=99e8056eecf3447b9595d527690fedf8&scope.project.id=b76e43674e884119998104ebcfc7992e&role.id=c860ed9e0b784b18a457abd0ddb5f508 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:52.760901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c381a-5162-4585-8c0e-fea11e19f4bd None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:52.819707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2060a22-80e4-4bef-9fda-2df16aa1ee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:52.820619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2060a22-80e4-4bef-9fda-2df16aa1ee38 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:52.820891 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2060a22-80e4-4bef-9fda-2df16aa1ee38 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:52.821061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2060a22-80e4-4bef-9fda-2df16aa1ee38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:52.821956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2060a22-80e4-4bef-9fda-2df16aa1ee38 None admin] RBAC: Adding query filter params (role.id=c860ed9e0b784b18a457abd0ddb5f508, scope.project.id=7cc93986f17a48809b5e9aa58ea66925, user.id=99e8056eecf3447b9595d527690fedf8) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:52.822281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2060a22-80e4-4bef-9fda-2df16aa1ee38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:52.823845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2060a22-80e4-4bef-9fda-2df16aa1ee38 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:52.833798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 50/97] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:17:52 2022] GET /identity/v3/role_assignments?user.id=99e8056eecf3447b9595d527690fedf8&scope.project.id=7cc93986f17a48809b5e9aa58ea66925&role.id=c860ed9e0b784b18a457abd0ddb5f508 => generated 259 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:54.462700 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3b39-7da9-43e1-9be7-a2fe88cb627e None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:54.463198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3b39-7da9-43e1-9be7-a2fe88cb627e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:54.463305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3b39-7da9-43e1-9be7-a2fe88cb627e None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:54.464798 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 48/98] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:54.486941 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d99e8a-83a5-4cc6-a671-6e0b34b92c9c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:54.487482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d99e8a-83a5-4cc6-a671-6e0b34b92c9c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:54.487482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d99e8a-83a5-4cc6-a671-6e0b34b92c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:54.513727 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b0d99e8a-83a5-4cc6-a671-6e0b34b92c9c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:54.514938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b0d99e8a-83a5-4cc6-a671-6e0b34b92c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:54.544594 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:54.594509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 51/99] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:54.634230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c3b39-7da9-43e1-9be7-a2fe88cb627e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:54.715374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c973a-0c6e-45c1-a26b-cb156ea154b0 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:54.715702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c973a-0c6e-45c1-a26b-cb156ea154b0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:54.715874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c973a-0c6e-45c1-a26b-cb156ea154b0 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:54.717316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 52/100] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:54.738338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defb53e-cd6f-4d5c-bf2a-e00923460f98 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:54.738656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defb53e-cd6f-4d5c-bf2a-e00923460f98 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:54.738910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defb53e-cd6f-4d5c-bf2a-e00923460f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:54.766400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3defb53e-cd6f-4d5c-bf2a-e00923460f98 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:54.767630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3defb53e-cd6f-4d5c-bf2a-e00923460f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:54.823259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c3b39-7da9-43e1-9be7-a2fe88cb627e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:54.906101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5df6f-46c9-499a-a9e7-88b23206386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:54.906923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5df6f-46c9-499a-a9e7-88b23206386f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:54.907217 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5df6f-46c9-499a-a9e7-88b23206386f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:54.907498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5df6f-46c9-499a-a9e7-88b23206386f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:54.909701 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5df6f-46c9-499a-a9e7-88b23206386f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:54.911179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5df6f-46c9-499a-a9e7-88b23206386f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:54.912903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 49/101] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:17:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:54.919002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5df6f-46c9-499a-a9e7-88b23206386f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:54.949109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 53/102] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:17:55.028139 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defb53e-cd6f-4d5c-bf2a-e00923460f98 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:55.031666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:55.098899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5df6f-46c9-499a-a9e7-88b23206386f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:55.166712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78272250-5caa-44dc-af5f-c840d01cfb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:55.167389 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78272250-5caa-44dc-af5f-c840d01cfb2a None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:55.167678 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78272250-5caa-44dc-af5f-c840d01cfb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:55.167959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78272250-5caa-44dc-af5f-c840d01cfb2a None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:55.168682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78272250-5caa-44dc-af5f-c840d01cfb2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:55.170736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78272250-5caa-44dc-af5f-c840d01cfb2a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:55.227124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:55.236354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defb53e-cd6f-4d5c-bf2a-e00923460f98 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:55.242857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 50/103] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:17:54 2022] POST /identity/v3/projects => generated 302 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:17:55.298114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213c021-2b22-403c-bf75-be4edb7c95f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:55.298855 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213c021-2b22-403c-bf75-be4edb7c95f1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:55.299153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213c021-2b22-403c-bf75-be4edb7c95f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:55.299437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213c021-2b22-403c-bf75-be4edb7c95f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:55.317811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213c021-2b22-403c-bf75-be4edb7c95f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0213c021-2b22-403c-bf75-be4edb7c95f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:17:55.326254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:55.327122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:55.327922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:55.327922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:55.327922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:55.327922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:55.327922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:17:55.327922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:17:55.327922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:17:55.327922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:17:55.327922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:17:55.327922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:17:55.327922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:17:55.327922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:17:55.330113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 54/104] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:17:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:17:55.335779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78272250-5caa-44dc-af5f-c840d01cfb2a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:55.557599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78272250-5caa-44dc-af5f-c840d01cfb2a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:55.579205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:55.605495 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c04925-57c9-4cbb-8afd-e1f398ce011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:55.606206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c04925-57c9-4cbb-8afd-e1f398ce011b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:55.606922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c04925-57c9-4cbb-8afd-e1f398ce011b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:55.607471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c04925-57c9-4cbb-8afd-e1f398ce011b None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:55.608595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c04925-57c9-4cbb-8afd-e1f398ce011b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:55.609208 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c04925-57c9-4cbb-8afd-e1f398ce011b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:55.611119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c04925-57c9-4cbb-8afd-e1f398ce011b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:55.623456 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 51/105] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:17:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:55.629057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213c021-2b22-403c-bf75-be4edb7c95f1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:55.767843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213c021-2b22-403c-bf75-be4edb7c95f1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:55.810754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc355f6b-3b6d-4d0e-a6f1-18b82dc69565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:55.811541 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc355f6b-3b6d-4d0e-a6f1-18b82dc69565 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:55.811832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc355f6b-3b6d-4d0e-a6f1-18b82dc69565 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:55.812116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc355f6b-3b6d-4d0e-a6f1-18b82dc69565 None admin] PATH_INFO: `/v3/users/8b8ad06dbb8b40e085589301978ec729` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:55.828763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc355f6b-3b6d-4d0e-a6f1-18b82dc69565 None admin] RBAC: Authorizing `identity:get_user(user_id=8b8ad06dbb8b40e085589301978ec729)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:55.830629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc355f6b-3b6d-4d0e-a6f1-18b82dc69565 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:55.832674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 55/106] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:17:55 2022] GET /identity/v3/users/8b8ad06dbb8b40e085589301978ec729 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:55.839271 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c04925-57c9-4cbb-8afd-e1f398ce011b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:55.846489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d877c-ab3d-431a-ae12-c9602fc5dbb1 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:55.847034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d877c-ab3d-431a-ae12-c9602fc5dbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:55.847494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d877c-ab3d-431a-ae12-c9602fc5dbb1 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:55.849165 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 56/107] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:17:55.862768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd90825-35f4-4fd2-8c0b-7ef1c0e8ce5a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:55.863313 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd90825-35f4-4fd2-8c0b-7ef1c0e8ce5a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:55.863797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd90825-35f4-4fd2-8c0b-7ef1c0e8ce5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:55.884011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0fd90825-35f4-4fd2-8c0b-7ef1c0e8ce5a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:55.885719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0fd90825-35f4-4fd2-8c0b-7ef1c0e8ce5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:55.896113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:55.994043 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 57/108] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:17:56.034247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd90825-35f4-4fd2-8c0b-7ef1c0e8ce5a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:56.111441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c04925-57c9-4cbb-8afd-e1f398ce011b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:56.179749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159d079-0de8-452e-b992-75c1d35e5e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:56.181457 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159d079-0de8-452e-b992-75c1d35e5e84 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:56.181765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159d079-0de8-452e-b992-75c1d35e5e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:56.182447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159d079-0de8-452e-b992-75c1d35e5e84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:56.236275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd90825-35f4-4fd2-8c0b-7ef1c0e8ce5a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:56.273901 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:56.278918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137e9bc-c9d7-493f-9137-4880f9e146b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:56.279805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137e9bc-c9d7-493f-9137-4880f9e146b1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:56.280222 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137e9bc-c9d7-493f-9137-4880f9e146b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:56.280575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137e9bc-c9d7-493f-9137-4880f9e146b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:56.293185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137e9bc-c9d7-493f-9137-4880f9e146b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:17:56.299697 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159d079-0de8-452e-b992-75c1d35e5e84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8137e9bc-c9d7-493f-9137-4880f9e146b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:17:56.301232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:56.302258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:56.303842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:56.303842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:56.303842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:56.303842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:56.303842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:17:56.303842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:17:56.303842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:17:56.303842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:17:56.303842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:17:56.303842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:17:56.303842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:17:56.303842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:17:56.305318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e159d079-0de8-452e-b992-75c1d35e5e84 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:56.305449 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 58/109] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:17:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:17:56.308783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4d514-2698-4c00-8e55-c6abdd6b3bb8 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:56.308783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4d514-2698-4c00-8e55-c6abdd6b3bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:56.308783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4d514-2698-4c00-8e55-c6abdd6b3bb8 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:56.308783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 59/110] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:56.310061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1762-aaf7-4658-b293-cd683787ae46 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:56.310425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1762-aaf7-4658-b293-cd683787ae46 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:56.310781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1762-aaf7-4658-b293-cd683787ae46 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:56.312095 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 60/111] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:56.317288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976c3d5-f6b7-4513-997b-8eda420f7cac None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:56.317668 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976c3d5-f6b7-4513-997b-8eda420f7cac None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:56.318025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976c3d5-f6b7-4513-997b-8eda420f7cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:56.323357 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:56.338226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b976c3d5-f6b7-4513-997b-8eda420f7cac None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:56.339843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b976c3d5-f6b7-4513-997b-8eda420f7cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:56.409096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 52/112] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:17:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:17:56.409974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159d079-0de8-452e-b992-75c1d35e5e84 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:56.411636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 61/113] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:56.413228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88413-8e72-4c2a-840a-36800d004adf None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:56.413752 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88413-8e72-4c2a-840a-36800d004adf None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:56.414039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88413-8e72-4c2a-840a-36800d004adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:56.431042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-70f88413-8e72-4c2a-840a-36800d004adf None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:56.432290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-70f88413-8e72-4c2a-840a-36800d004adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:56.503106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:56.505993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 62/114] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:56.516529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b57a6d-bd5d-4782-913b-0defa47e7adb None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:56.516529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b57a6d-bd5d-4782-913b-0defa47e7adb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:56.516529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b57a6d-bd5d-4782-913b-0defa47e7adb None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:56.516529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 63/115] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:56.516529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b57a6d-bd5d-4782-913b-0defa47e7adb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:56.541974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159d079-0de8-452e-b992-75c1d35e5e84 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:56.579130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fa14b-36d1-4940-a5df-e7f0f4d850c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:56.579815 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fa14b-36d1-4940-a5df-e7f0f4d850c2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:56.580109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fa14b-36d1-4940-a5df-e7f0f4d850c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:56.580394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fa14b-36d1-4940-a5df-e7f0f4d850c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:56.581235 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fa14b-36d1-4940-a5df-e7f0f4d850c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:56.581548 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fa14b-36d1-4940-a5df-e7f0f4d850c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:56.582956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fa14b-36d1-4940-a5df-e7f0f4d850c2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:56.587325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:56.592322 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 53/116] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:17:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:56.597716 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fa14b-36d1-4940-a5df-e7f0f4d850c2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:56.631592 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b57a6d-bd5d-4782-913b-0defa47e7adb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:56.668656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584ecdd-c23e-4d7b-a558-2c5d48ee7e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:56.669466 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584ecdd-c23e-4d7b-a558-2c5d48ee7e19 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:56.669758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584ecdd-c23e-4d7b-a558-2c5d48ee7e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:56.670040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584ecdd-c23e-4d7b-a558-2c5d48ee7e19 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:56.671228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584ecdd-c23e-4d7b-a558-2c5d48ee7e19 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:56.672694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584ecdd-c23e-4d7b-a558-2c5d48ee7e19 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:56.674420 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 64/117] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:17:56 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:56.675540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad7623-3901-494c-a9fe-d8d7f7868d55 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:56.675834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad7623-3901-494c-a9fe-d8d7f7868d55 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:56.676117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad7623-3901-494c-a9fe-d8d7f7868d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:56.693556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-caad7623-3901-494c-a9fe-d8d7f7868d55 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:56.695316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-caad7623-3901-494c-a9fe-d8d7f7868d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:56.714806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fa14b-36d1-4940-a5df-e7f0f4d850c2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:56.749047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1283df7-8dcc-4fb3-b2a1-17142f089720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:56.749862 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1283df7-8dcc-4fb3-b2a1-17142f089720 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:56.750153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1283df7-8dcc-4fb3-b2a1-17142f089720 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:56.750440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1283df7-8dcc-4fb3-b2a1-17142f089720 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:56.759005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:56.762683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1283df7-8dcc-4fb3-b2a1-17142f089720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:17:56.768112 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 65/118] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-f1283df7-8dcc-4fb3-b2a1-17142f089720 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:17:56.771454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:56.772373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:56.773530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:56.773530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:56.773530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:56.773530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:56.773530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:17:56.773530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:17:56.773530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:17:56.773530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:17:56.773530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:17:56.773530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:17:56.773530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:17:56.773530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:17:56.777763 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 54/119] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:17:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:17:56.778471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1283df7-8dcc-4fb3-b2a1-17142f089720 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:56.779351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad7623-3901-494c-a9fe-d8d7f7868d55 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:56.846352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:56.888022 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1283df7-8dcc-4fb3-b2a1-17142f089720 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:56.894494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad7623-3901-494c-a9fe-d8d7f7868d55 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:56.929114 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135422a6-b999-4d18-b4de-919f67845049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:56.929452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f863c1f-58c4-4b17-8d42-e12bf0f87a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:56.929843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135422a6-b999-4d18-b4de-919f67845049 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:56.930137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135422a6-b999-4d18-b4de-919f67845049 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:56.930337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f863c1f-58c4-4b17-8d42-e12bf0f87a68 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:56.930445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135422a6-b999-4d18-b4de-919f67845049 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:56.930628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f863c1f-58c4-4b17-8d42-e12bf0f87a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:56.930912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f863c1f-58c4-4b17-8d42-e12bf0f87a68 None admin] PATH_INFO: `/v3/users/6cb812d57b84461b8b6450ef1b357cc1` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:56.932094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f863c1f-58c4-4b17-8d42-e12bf0f87a68 None admin] RBAC: Authorizing `identity:get_user(user_id=6cb812d57b84461b8b6450ef1b357cc1)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:56.933600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f863c1f-58c4-4b17-8d42-e12bf0f87a68 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:56.939777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 66/120] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:17:56 2022] GET /identity/v3/users/6cb812d57b84461b8b6450ef1b357cc1 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:56.939777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f863c1f-58c4-4b17-8d42-e12bf0f87a68 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:56.947105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135422a6-b999-4d18-b4de-919f67845049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-135422a6-b999-4d18-b4de-919f67845049 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:17:56.955484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:56.956356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:56.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:56.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:56.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:56.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:56.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:17:56.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:17:56.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:17:56.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:17:56.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:17:56.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:17:56.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:17:56.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:17:56.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 55/121] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:17:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:17:56.962489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135422a6-b999-4d18-b4de-919f67845049 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:57.033101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:57.052286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f863c1f-58c4-4b17-8d42-e12bf0f87a68 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:57.079555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135422a6-b999-4d18-b4de-919f67845049 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:57.080439 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:57.090937 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44c852-4706-46d2-aa0d-4d742115ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:57.091953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44c852-4706-46d2-aa0d-4d742115ca60 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:57.092378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44c852-4706-46d2-aa0d-4d742115ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:57.092671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44c852-4706-46d2-aa0d-4d742115ca60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:57.093548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44c852-4706-46d2-aa0d-4d742115ca60 None admin] RBAC: Adding query filter params (role.id=d85cfbcde27e45afbe2c7ec009e1c0c7, scope.project.id=7cc93986f17a48809b5e9aa58ea66925, user.id=8b8ad06dbb8b40e085589301978ec729) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:57.093873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44c852-4706-46d2-aa0d-4d742115ca60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:57.095337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44c852-4706-46d2-aa0d-4d742115ca60 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:57.101731 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 67/122] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:17:56 2022] GET /identity/v3/role_assignments?user.id=8b8ad06dbb8b40e085589301978ec729&scope.project.id=7cc93986f17a48809b5e9aa58ea66925&role.id=d85cfbcde27e45afbe2c7ec009e1c0c7 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:57.102522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44c852-4706-46d2-aa0d-4d742115ca60 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:57.125660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb4dfa-f9ab-4e29-9f8d-a6909fbefce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:57.126462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb4dfa-f9ab-4e29-9f8d-a6909fbefce8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:57.126823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb4dfa-f9ab-4e29-9f8d-a6909fbefce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:57.127179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb4dfa-f9ab-4e29-9f8d-a6909fbefce8 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:57.128054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb4dfa-f9ab-4e29-9f8d-a6909fbefce8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:57.128449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb4dfa-f9ab-4e29-9f8d-a6909fbefce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:57.130310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb4dfa-f9ab-4e29-9f8d-a6909fbefce8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:57.140040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 56/123] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:17:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:57.145887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb4dfa-f9ab-4e29-9f8d-a6909fbefce8 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:57.250313 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44c852-4706-46d2-aa0d-4d742115ca60 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:57.269040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb4dfa-f9ab-4e29-9f8d-a6909fbefce8 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:57.294351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0615b61-90ac-4997-84c3-faa32c3c09b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:57.295167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615b61-90ac-4997-84c3-faa32c3c09b2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:57.295460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615b61-90ac-4997-84c3-faa32c3c09b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:57.295740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615b61-90ac-4997-84c3-faa32c3c09b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:57.296763 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:57.310393 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0615b61-90ac-4997-84c3-faa32c3c09b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:17:57.312838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ecf4-98d1-4df8-ad86-7bd9adf676fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:57.314680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ecf4-98d1-4df8-ad86-7bd9adf676fc None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:57.315226 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ecf4-98d1-4df8-ad86-7bd9adf676fc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:57.315761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280ecf4-98d1-4df8-ad86-7bd9adf676fc None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:57.317986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280ecf4-98d1-4df8-ad86-7bd9adf676fc None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f0615b61-90ac-4997-84c3-faa32c3c09b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:17:57.318279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:17:57.319953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 68/124] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:17:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:17:57.321664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0615b61-90ac-4997-84c3-faa32c3c09b2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:57.322357 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280ecf4-98d1-4df8-ad86-7bd9adf676fc None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:57.324758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 57/125] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:17:57 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:57.324758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ecf4-98d1-4df8-ad86-7bd9adf676fc None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:57.387568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:57.436919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280ecf4-98d1-4df8-ad86-7bd9adf676fc None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:57.443111 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0615b61-90ac-4997-84c3-faa32c3c09b2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:57.474291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedf7f8-e5fd-4676-928c-84c3549d77c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:57.475795 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf7f8-e5fd-4676-928c-84c3549d77c7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:57.476088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf7f8-e5fd-4676-928c-84c3549d77c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:57.476523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bedf7f8-e5fd-4676-928c-84c3549d77c7 None admin] PATH_INFO: `/v3/users/99e8056eecf3447b9595d527690fedf8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:57.477901 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedf7f8-e5fd-4676-928c-84c3549d77c7 None admin] RBAC: Authorizing `identity:get_user(user_id=99e8056eecf3447b9595d527690fedf8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:57.479497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bedf7f8-e5fd-4676-928c-84c3549d77c7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:57.481570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 58/126] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:17:57 2022] GET /identity/v3/users/99e8056eecf3447b9595d527690fedf8 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:57.482362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedf7f8-e5fd-4676-928c-84c3549d77c7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:57.487931 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d4aaf-4bd3-4ba1-b9f7-28399548234e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:57.488664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d4aaf-4bd3-4ba1-b9f7-28399548234e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:57.488994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d4aaf-4bd3-4ba1-b9f7-28399548234e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:57.489324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d4aaf-4bd3-4ba1-b9f7-28399548234e None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:57.490105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d4aaf-4bd3-4ba1-b9f7-28399548234e None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:57.490425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d4aaf-4bd3-4ba1-b9f7-28399548234e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:57.492629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d4aaf-4bd3-4ba1-b9f7-28399548234e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:57.502935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 69/127] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:17:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:57.503804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d4aaf-4bd3-4ba1-b9f7-28399548234e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:57.554407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:57.602824 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bedf7f8-e5fd-4676-928c-84c3549d77c7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:57.622299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d4aaf-4bd3-4ba1-b9f7-28399548234e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:57.638316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:57.641892 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab27320-8cf8-410b-a01c-396ce2f3734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:57.642772 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab27320-8cf8-410b-a01c-396ce2f3734f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:57.643225 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab27320-8cf8-410b-a01c-396ce2f3734f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:57.643650 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab27320-8cf8-410b-a01c-396ce2f3734f None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:57.644556 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab27320-8cf8-410b-a01c-396ce2f3734f None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:17:57.645103 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab27320-8cf8-410b-a01c-396ce2f3734f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:57.646657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab27320-8cf8-410b-a01c-396ce2f3734f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:57.656324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 59/128] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:17:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:57.657545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab27320-8cf8-410b-a01c-396ce2f3734f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:57.661848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b203802-a7f0-42fc-9890-4595308ed35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:57.663354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b203802-a7f0-42fc-9890-4595308ed35a None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:57.663654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b203802-a7f0-42fc-9890-4595308ed35a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:57.663944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b203802-a7f0-42fc-9890-4595308ed35a None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925/users/6cb812d57b84461b8b6450ef1b357cc1/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:57.666147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b203802-a7f0-42fc-9890-4595308ed35a None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc93986f17a48809b5e9aa58ea66925, user_id=6cb812d57b84461b8b6450ef1b357cc1, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:57.667628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b203802-a7f0-42fc-9890-4595308ed35a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:57.683238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 70/129] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:17:57 2022] PUT /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925/users/6cb812d57b84461b8b6450ef1b357cc1/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:17:57.689888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b203802-a7f0-42fc-9890-4595308ed35a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:57.780695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab27320-8cf8-410b-a01c-396ce2f3734f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:57.809380 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:57.832784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84e9d5-c035-427a-befb-0c93d383c9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:57.832784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84e9d5-c035-427a-befb-0c93d383c9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:57.832784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84e9d5-c035-427a-befb-0c93d383c9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:57.832784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84e9d5-c035-427a-befb-0c93d383c9c2 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:57.835496 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84e9d5-c035-427a-befb-0c93d383c9c2 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:57.839339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84e9d5-c035-427a-befb-0c93d383c9c2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:57.842871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 60/130] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:17:57 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:57.846144 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84e9d5-c035-427a-befb-0c93d383c9c2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:57.912180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b203802-a7f0-42fc-9890-4595308ed35a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:57.993717 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bbae5-af3a-43c5-a641-301785a3c165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:57.994611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bbae5-af3a-43c5-a641-301785a3c165 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:57.994904 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bbae5-af3a-43c5-a641-301785a3c165 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:57.995187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bbae5-af3a-43c5-a641-301785a3c165 None admin] PATH_INFO: `/v3/users/99e8056eecf3447b9595d527690fedf8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:57.996539 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bbae5-af3a-43c5-a641-301785a3c165 None admin] RBAC: Authorizing `identity:get_user(user_id=99e8056eecf3447b9595d527690fedf8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:57.998181 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bbae5-af3a-43c5-a641-301785a3c165 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:57.999855 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 71/131] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:17:57 2022] GET /identity/v3/users/99e8056eecf3447b9595d527690fedf8 => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:58.000863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bbae5-af3a-43c5-a641-301785a3c165 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:58.038581 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84e9d5-c035-427a-befb-0c93d383c9c2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:58.049837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:58.089103 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affa7b7-c66c-4632-9be4-201d63d403ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:58.090645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affa7b7-c66c-4632-9be4-201d63d403ad None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:58.091382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affa7b7-c66c-4632-9be4-201d63d403ad None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:58.091826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affa7b7-c66c-4632-9be4-201d63d403ad None admin] PATH_INFO: `/v3/users/99e8056eecf3447b9595d527690fedf8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:58.093932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affa7b7-c66c-4632-9be4-201d63d403ad None admin] RBAC: Authorizing `identity:get_user(user_id=99e8056eecf3447b9595d527690fedf8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:58.096096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affa7b7-c66c-4632-9be4-201d63d403ad None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:58.098435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 61/132] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:17:57 2022] GET /identity/v3/users/99e8056eecf3447b9595d527690fedf8 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:58.099441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affa7b7-c66c-4632-9be4-201d63d403ad None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:58.112988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bbae5-af3a-43c5-a641-301785a3c165 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:58.150728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbf26f-4710-468f-9057-79e00bd08191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:58.151637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf26f-4710-468f-9057-79e00bd08191 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:58.151930 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf26f-4710-468f-9057-79e00bd08191 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:58.152216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf26f-4710-468f-9057-79e00bd08191 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925/users/99e8056eecf3447b9595d527690fedf8/roles/512083f4095a4f23a8dd4e8789fa20b3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:58.154643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbf26f-4710-468f-9057-79e00bd08191 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc93986f17a48809b5e9aa58ea66925, user_id=99e8056eecf3447b9595d527690fedf8, role_id=512083f4095a4f23a8dd4e8789fa20b3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:58.156226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbf26f-4710-468f-9057-79e00bd08191 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:58.172646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:58.174652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 72/133] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:17:57 2022] PUT /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925/users/99e8056eecf3447b9595d527690fedf8/roles/512083f4095a4f23a8dd4e8789fa20b3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:17:58.175908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483c85e-1529-4762-84e8-36df3ee5184d None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:58.176209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483c85e-1529-4762-84e8-36df3ee5184d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:58.176563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483c85e-1529-4762-84e8-36df3ee5184d None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:58.179794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 73/134] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:58.184541 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483c85e-1529-4762-84e8-36df3ee5184d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:58.286782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affa7b7-c66c-4632-9be4-201d63d403ad None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:58.304587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483c85e-1529-4762-84e8-36df3ee5184d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:58.306293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:58.350452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d0d40-a812-42ea-be7b-b044b0c9c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:58.351609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0d40-a812-42ea-be7b-b044b0c9c410 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:58.351899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0d40-a812-42ea-be7b-b044b0c9c410 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:58.352175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0d40-a812-42ea-be7b-b044b0c9c410 None admin] PATH_INFO: `/v3/projects/b76e43674e884119998104ebcfc7992e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:58.355389 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d0d40-a812-42ea-be7b-b044b0c9c410 None admin] RBAC: Authorizing `identity:get_project(project_id=b76e43674e884119998104ebcfc7992e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:58.355389 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d0d40-a812-42ea-be7b-b044b0c9c410 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:58.356863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 74/135] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:17:58 2022] GET /identity/v3/projects/b76e43674e884119998104ebcfc7992e => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:58.358106 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582977b-486e-4d0f-8d8b-e29191d8919d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:58.358400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582977b-486e-4d0f-8d8b-e29191d8919d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:58.358686 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582977b-486e-4d0f-8d8b-e29191d8919d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:58.370610 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cdc43-4a79-4b8e-ac1e-3b9d99aeb4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:58.371981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cdc43-4a79-4b8e-ac1e-3b9d99aeb4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:58.372500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cdc43-4a79-4b8e-ac1e-3b9d99aeb4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:58.373027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cdc43-4a79-4b8e-ac1e-3b9d99aeb4f2 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:58.376468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5582977b-486e-4d0f-8d8b-e29191d8919d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:58.377596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cdc43-4a79-4b8e-ac1e-3b9d99aeb4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:58.377719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5582977b-486e-4d0f-8d8b-e29191d8919d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:58.379568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49cdc43-4a79-4b8e-ac1e-3b9d99aeb4f2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:58.383194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 62/136] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:17:58 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:58.384206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cdc43-4a79-4b8e-ac1e-3b9d99aeb4f2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:58.457092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 75/137] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:58.458090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582977b-486e-4d0f-8d8b-e29191d8919d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:58.545480 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cdc43-4a79-4b8e-ac1e-3b9d99aeb4f2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:58.566349 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:58.569970 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582977b-486e-4d0f-8d8b-e29191d8919d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:58.581210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:58.587882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def5a8a-018a-45c2-bf35-e8da77500340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:58.588924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def5a8a-018a-45c2-bf35-e8da77500340 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:58.589219 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def5a8a-018a-45c2-bf35-e8da77500340 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:58.589596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def5a8a-018a-45c2-bf35-e8da77500340 None admin] PATH_INFO: `/v3/projects/b76e43674e884119998104ebcfc7992e/users/99e8056eecf3447b9595d527690fedf8/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:58.591642 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def5a8a-018a-45c2-bf35-e8da77500340 None admin] RBAC: Authorizing `identity:create_grant(project_id=b76e43674e884119998104ebcfc7992e, user_id=99e8056eecf3447b9595d527690fedf8, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:58.593468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def5a8a-018a-45c2-bf35-e8da77500340 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:58.615049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016848f5-08ab-4b38-9ff1-2da5514d5db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:58.616600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016848f5-08ab-4b38-9ff1-2da5514d5db2 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:58.617128 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016848f5-08ab-4b38-9ff1-2da5514d5db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:58.617410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016848f5-08ab-4b38-9ff1-2da5514d5db2 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925/users/99e8056eecf3447b9595d527690fedf8/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:58.619672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016848f5-08ab-4b38-9ff1-2da5514d5db2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc93986f17a48809b5e9aa58ea66925, user_id=99e8056eecf3447b9595d527690fedf8, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:58.621330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016848f5-08ab-4b38-9ff1-2da5514d5db2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:58.634031 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 63/138] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:17:58 2022] PUT /identity/v3/projects/b76e43674e884119998104ebcfc7992e/users/99e8056eecf3447b9595d527690fedf8/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:17:58.635011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def5a8a-018a-45c2-bf35-e8da77500340 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:58.636741 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 76/139] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:17:58 2022] PUT /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925/users/99e8056eecf3447b9595d527690fedf8/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:17:58.767233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def5a8a-018a-45c2-bf35-e8da77500340 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:58.808451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb2d1c-9f1c-4f75-b48a-e78a45d50762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:58.809440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb2d1c-9f1c-4f75-b48a-e78a45d50762 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:58.809736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb2d1c-9f1c-4f75-b48a-e78a45d50762 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:58.810023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb2d1c-9f1c-4f75-b48a-e78a45d50762 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:58.811332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb2d1c-9f1c-4f75-b48a-e78a45d50762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:58.812836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb2d1c-9f1c-4f75-b48a-e78a45d50762 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:58.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 64/140] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:17:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:17:58.821364 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016848f5-08ab-4b38-9ff1-2da5514d5db2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:58.972774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016848f5-08ab-4b38-9ff1-2da5514d5db2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:17:59.013019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356a062-3989-4734-8cbe-1cf8d2d3888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:17:59.013702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356a062-3989-4734-8cbe-1cf8d2d3888b None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:59.013986 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356a062-3989-4734-8cbe-1cf8d2d3888b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:59.014264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356a062-3989-4734-8cbe-1cf8d2d3888b None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:59.014990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356a062-3989-4734-8cbe-1cf8d2d3888b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:17:59.016754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356a062-3989-4734-8cbe-1cf8d2d3888b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:17:59.047849 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 77/141] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:17:58 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:17:59.745313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459e4f2-9b40-4aa5-9208-842481941d4c None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:59.745815 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459e4f2-9b40-4aa5-9208-842481941d4c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:59.745899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459e4f2-9b40-4aa5-9208-842481941d4c None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:59.747259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 65/142] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:17:59.758740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404a17e-f3bd-47db-ba7b-06139bf12b8b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:17:59.759035 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404a17e-f3bd-47db-ba7b-06139bf12b8b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:17:59.759298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404a17e-f3bd-47db-ba7b-06139bf12b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:17:59.779516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f404a17e-f3bd-47db-ba7b-06139bf12b8b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:17:59.780707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f404a17e-f3bd-47db-ba7b-06139bf12b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:17:59.796833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:17:59.872306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 78/143] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:17:59.904567 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459e4f2-9b40-4aa5-9208-842481941d4c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:17:59.970317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:00.025627 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459e4f2-9b40-4aa5-9208-842481941d4c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:00.073277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e989-697e-47ce-a463-58750d141923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:00.074086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e989-697e-47ce-a463-58750d141923 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:00.074374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e989-697e-47ce-a463-58750d141923 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:00.074653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e989-697e-47ce-a463-58750d141923 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:00.090148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396e989-697e-47ce-a463-58750d141923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0396e989-697e-47ce-a463-58750d141923 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:00.097838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:00.099954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:00.101883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:00.101883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:00.101883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:00.101883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:00.101883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:00.101883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:00.101883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:00.101883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:00.101883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:00.101883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:00.101883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:00.101883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:00.101883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 66/144] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:17:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:00.108754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404a17e-f3bd-47db-ba7b-06139bf12b8b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:00.232024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404a17e-f3bd-47db-ba7b-06139bf12b8b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:00.279459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538b64f-45e8-4cf9-9fdd-4b51081c2993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:00.280134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538b64f-45e8-4cf9-9fdd-4b51081c2993 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:00.280425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538b64f-45e8-4cf9-9fdd-4b51081c2993 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:00.280785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538b64f-45e8-4cf9-9fdd-4b51081c2993 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:00.281560 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538b64f-45e8-4cf9-9fdd-4b51081c2993 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:00.281875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538b64f-45e8-4cf9-9fdd-4b51081c2993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:00.283294 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538b64f-45e8-4cf9-9fdd-4b51081c2993 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:00.295437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 79/145] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:00.301241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e989-697e-47ce-a463-58750d141923 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:00.440852 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e989-697e-47ce-a463-58750d141923 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:00.458729 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:00.486338 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593192ac-43a0-4634-8129-2b1f5017e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:00.487242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593192ac-43a0-4634-8129-2b1f5017e8ce None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:00.487527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593192ac-43a0-4634-8129-2b1f5017e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:00.487803 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593192ac-43a0-4634-8129-2b1f5017e8ce None admin] PATH_INFO: `/v3/users/8b8ad06dbb8b40e085589301978ec729` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:00.489046 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593192ac-43a0-4634-8129-2b1f5017e8ce None admin] RBAC: Authorizing `identity:get_user(user_id=8b8ad06dbb8b40e085589301978ec729)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:00.490568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593192ac-43a0-4634-8129-2b1f5017e8ce None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:00.492379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 67/146] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:00 2022] GET /identity/v3/users/8b8ad06dbb8b40e085589301978ec729 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:00.498194 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538b64f-45e8-4cf9-9fdd-4b51081c2993 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:00.518798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:00.632475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538b64f-45e8-4cf9-9fdd-4b51081c2993 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:00.667536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb597708-4ded-4ab7-9c80-b9157fd3acc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:00.668402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb597708-4ded-4ab7-9c80-b9157fd3acc9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:00.668680 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb597708-4ded-4ab7-9c80-b9157fd3acc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:00.668978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb597708-4ded-4ab7-9c80-b9157fd3acc9 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:00.670182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb597708-4ded-4ab7-9c80-b9157fd3acc9 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:00.671645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb597708-4ded-4ab7-9c80-b9157fd3acc9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:00.673370 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 80/147] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:00 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:00.679377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593192ac-43a0-4634-8129-2b1f5017e8ce None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:00.827007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593192ac-43a0-4634-8129-2b1f5017e8ce None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:00.879227 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512099da-43e5-4f8d-a121-cf0196dc877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:00.880142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512099da-43e5-4f8d-a121-cf0196dc877a None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:00.880431 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512099da-43e5-4f8d-a121-cf0196dc877a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:00.880707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512099da-43e5-4f8d-a121-cf0196dc877a None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925/users/8b8ad06dbb8b40e085589301978ec729/roles/d85cfbcde27e45afbe2c7ec009e1c0c7` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:00.882992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512099da-43e5-4f8d-a121-cf0196dc877a None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc93986f17a48809b5e9aa58ea66925, user_id=8b8ad06dbb8b40e085589301978ec729, role_id=d85cfbcde27e45afbe2c7ec009e1c0c7)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:00.884947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512099da-43e5-4f8d-a121-cf0196dc877a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:00.913753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 68/148] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:18:00 2022] PUT /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925/users/8b8ad06dbb8b40e085589301978ec729/roles/d85cfbcde27e45afbe2c7ec009e1c0c7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:18:01.419977 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a33dab-94eb-4c22-92fe-c9112fc14514 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:01.420666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a33dab-94eb-4c22-92fe-c9112fc14514 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:01.420666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a33dab-94eb-4c22-92fe-c9112fc14514 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:01.421934 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 81/149] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:01.427341 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7be24-41c7-4631-98b6-3419661c332b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:01.427638 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7be24-41c7-4631-98b6-3419661c332b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:01.428031 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7be24-41c7-4631-98b6-3419661c332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:01.449446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ede7be24-41c7-4631-98b6-3419661c332b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:01.450636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ede7be24-41c7-4631-98b6-3419661c332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:01.499749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:01.538334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 69/150] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:01.594207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a33dab-94eb-4c22-92fe-c9112fc14514 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:01.612149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ced56-1008-4f50-a80e-cfc89010fa75 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:01.612472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ced56-1008-4f50-a80e-cfc89010fa75 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:01.612744 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ced56-1008-4f50-a80e-cfc89010fa75 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:01.614577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 70/151] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:01.620699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07237a-51b0-4f65-b2f3-9648947ea736 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:01.621031 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07237a-51b0-4f65-b2f3-9648947ea736 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:01.621266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07237a-51b0-4f65-b2f3-9648947ea736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:01.653814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ee07237a-51b0-4f65-b2f3-9648947ea736 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:01.655329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ee07237a-51b0-4f65-b2f3-9648947ea736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:01.716444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:01.749997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a33dab-94eb-4c22-92fe-c9112fc14514 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:01.802062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc885f-caec-49cf-b30a-5793106abc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:01.803392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc885f-caec-49cf-b30a-5793106abc65 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:01.803839 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc885f-caec-49cf-b30a-5793106abc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:01.804123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc885f-caec-49cf-b30a-5793106abc65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:01.825886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc885f-caec-49cf-b30a-5793106abc65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:01.828435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 71/152] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-fabc885f-caec-49cf-b30a-5793106abc65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:01.835441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:01.836265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:01.837047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:01.837047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:01.837047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:01.837047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:01.837047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:01.837047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:01.837047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:01.837047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:01.837047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:01.837047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:01.837047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:01.837047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:01.837047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 82/153] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:18:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:01.842450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07237a-51b0-4f65-b2f3-9648947ea736 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:01.909261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc885f-caec-49cf-b30a-5793106abc65 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:02.032955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07237a-51b0-4f65-b2f3-9648947ea736 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:02.037045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:02.103285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a469b6-edc3-4d72-9ebd-05bbfb1d6089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:02.104118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a469b6-edc3-4d72-9ebd-05bbfb1d6089 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:02.104402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a469b6-edc3-4d72-9ebd-05bbfb1d6089 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:02.104682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a469b6-edc3-4d72-9ebd-05bbfb1d6089 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:02.105622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a469b6-edc3-4d72-9ebd-05bbfb1d6089 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:02.105934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a469b6-edc3-4d72-9ebd-05bbfb1d6089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:02.107330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a469b6-edc3-4d72-9ebd-05bbfb1d6089 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:02.127495 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 72/154] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:02.130622 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc885f-caec-49cf-b30a-5793106abc65 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:02.142199 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a469b6-edc3-4d72-9ebd-05bbfb1d6089 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:02.229436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa2ea2-8d9c-4fe9-ac39-c2af88e5ff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:02.230274 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa2ea2-8d9c-4fe9-ac39-c2af88e5ff3c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:02.230563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa2ea2-8d9c-4fe9-ac39-c2af88e5ff3c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:02.230844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa2ea2-8d9c-4fe9-ac39-c2af88e5ff3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:02.240797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:02.265396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aa2ea2-8d9c-4fe9-ac39-c2af88e5ff3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-07aa2ea2-8d9c-4fe9-ac39-c2af88e5ff3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:02.274734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:02.276032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:02.277460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:02.277460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:02.277460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:02.277460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:02.277460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:02.277460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:02.277460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:02.277460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:02.277460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:02.277460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:02.277460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:02.277460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:02.277460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 83/155] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:18:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:02.285837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa2ea2-8d9c-4fe9-ac39-c2af88e5ff3c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:02.362383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a469b6-edc3-4d72-9ebd-05bbfb1d6089 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:02.430232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee45215-0f00-47c1-b519-1e8350bfd30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:02.431144 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee45215-0f00-47c1-b519-1e8350bfd30a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:02.431438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee45215-0f00-47c1-b519-1e8350bfd30a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:02.431720 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee45215-0f00-47c1-b519-1e8350bfd30a None admin] PATH_INFO: `/v3/users/6cb812d57b84461b8b6450ef1b357cc1` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:02.437447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee45215-0f00-47c1-b519-1e8350bfd30a None admin] RBAC: Authorizing `identity:get_user(user_id=6cb812d57b84461b8b6450ef1b357cc1)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:02.439028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee45215-0f00-47c1-b519-1e8350bfd30a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:02.440950 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 73/156] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:02 2022] GET /identity/v3/users/6cb812d57b84461b8b6450ef1b357cc1 => generated 247 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:02.464348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee45215-0f00-47c1-b519-1e8350bfd30a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:02.517219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa2ea2-8d9c-4fe9-ac39-c2af88e5ff3c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:02.533100 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:02.570964 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53611ec6-8067-4176-812c-192fe5e48ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:02.571570 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53611ec6-8067-4176-812c-192fe5e48ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:02.571858 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53611ec6-8067-4176-812c-192fe5e48ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:02.572141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53611ec6-8067-4176-812c-192fe5e48ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:02.572969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53611ec6-8067-4176-812c-192fe5e48ec9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:02.573283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53611ec6-8067-4176-812c-192fe5e48ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:02.574690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53611ec6-8067-4176-812c-192fe5e48ec9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:02.587641 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 84/157] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:02.593390 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53611ec6-8067-4176-812c-192fe5e48ec9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:02.633624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee45215-0f00-47c1-b519-1e8350bfd30a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:02.689079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:02.694071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a707a-ff9e-44a6-924a-9d965d042191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:02.694753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a707a-ff9e-44a6-924a-9d965d042191 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:02.695043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a707a-ff9e-44a6-924a-9d965d042191 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:02.695326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a707a-ff9e-44a6-924a-9d965d042191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:02.742716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53611ec6-8067-4176-812c-192fe5e48ec9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:02.791368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a707a-ff9e-44a6-924a-9d965d042191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:02.793250 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a707a-ff9e-44a6-924a-9d965d042191 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:02.811270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff69e7-01cb-4d44-9359-4c6b851f717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:02.812385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff69e7-01cb-4d44-9359-4c6b851f717c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:02.812843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff69e7-01cb-4d44-9359-4c6b851f717c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:02.813284 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff69e7-01cb-4d44-9359-4c6b851f717c None admin] PATH_INFO: `/v3/users/99e8056eecf3447b9595d527690fedf8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:02.817422 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff69e7-01cb-4d44-9359-4c6b851f717c None admin] RBAC: Authorizing `identity:get_user(user_id=99e8056eecf3447b9595d527690fedf8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:02.819754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff69e7-01cb-4d44-9359-4c6b851f717c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:02.822040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 85/158] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:02 2022] GET /identity/v3/users/99e8056eecf3447b9595d527690fedf8 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:02.827495 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff69e7-01cb-4d44-9359-4c6b851f717c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:02.854964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:03.001146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff69e7-01cb-4d44-9359-4c6b851f717c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:03.048660 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:03.049737 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 74/159] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:18:03.051241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8975c8-9d82-4913-84cc-f1c50408bb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:03.052114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8975c8-9d82-4913-84cc-f1c50408bb57 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:03.052622 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8975c8-9d82-4913-84cc-f1c50408bb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:03.053143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8975c8-9d82-4913-84cc-f1c50408bb57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:03.077190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a707a-ff9e-44a6-924a-9d965d042191 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:03.156121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8975c8-9d82-4913-84cc-f1c50408bb57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:03.162328 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8975c8-9d82-4913-84cc-f1c50408bb57 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:03.244541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a707a-ff9e-44a6-924a-9d965d042191 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:03.305104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:03.316837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 86/160] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:18:03.318392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e661-3121-48c1-a4cd-fb77074abb5a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:03.318687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e661-3121-48c1-a4cd-fb77074abb5a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:03.318968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e661-3121-48c1-a4cd-fb77074abb5a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:03.320466 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 87/161] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:03.325570 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783d516-e61b-480b-8508-5b7c1ac5b3cf None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:03.325863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783d516-e61b-480b-8508-5b7c1ac5b3cf None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:03.326149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783d516-e61b-480b-8508-5b7c1ac5b3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:03.329142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4f0dd-f18b-4d1f-827e-27157b558354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:03.329958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4f0dd-f18b-4d1f-827e-27157b558354 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:03.330242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4f0dd-f18b-4d1f-827e-27157b558354 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:03.330518 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4f0dd-f18b-4d1f-827e-27157b558354 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:03.331716 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4f0dd-f18b-4d1f-827e-27157b558354 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:03.333209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4f0dd-f18b-4d1f-827e-27157b558354 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:03.335776 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 75/162] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:03 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:03.336630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4f0dd-f18b-4d1f-827e-27157b558354 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:03.359752 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3783d516-e61b-480b-8508-5b7c1ac5b3cf None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:03.361321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3783d516-e61b-480b-8508-5b7c1ac5b3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:03.400185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:03.513960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 88/163] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:03.514623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783d516-e61b-480b-8508-5b7c1ac5b3cf None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:03.574070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4f0dd-f18b-4d1f-827e-27157b558354 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:03.650426 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d205-e813-4327-a223-cf78899203df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:03.651228 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d205-e813-4327-a223-cf78899203df None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:03.651510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d205-e813-4327-a223-cf78899203df None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:03.651787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d205-e813-4327-a223-cf78899203df None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:03.653014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062d205-e813-4327-a223-cf78899203df None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:03.654477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062d205-e813-4327-a223-cf78899203df None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:03.656177 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 76/164] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:03 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:03.657534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720d14-8893-464e-8594-79f25f74e313 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:03.658069 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720d14-8893-464e-8594-79f25f74e313 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:03.658549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720d14-8893-464e-8594-79f25f74e313 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:03.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 77/165] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:03.660850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93720d14-8893-464e-8594-79f25f74e313 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:03.727378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783d516-e61b-480b-8508-5b7c1ac5b3cf None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:03.743342 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:03.794824 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93720d14-8893-464e-8594-79f25f74e313 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:03.831387 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6654537-a0dc-4ae5-bab5-a51d47fd253f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:03.832523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6654537-a0dc-4ae5-bab5-a51d47fd253f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:03.832971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6654537-a0dc-4ae5-bab5-a51d47fd253f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:03.833385 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6654537-a0dc-4ae5-bab5-a51d47fd253f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:03.834253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde509a-30fa-48aa-8899-42cae6f6728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:03.835145 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde509a-30fa-48aa-8899-42cae6f6728d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:03.835583 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde509a-30fa-48aa-8899-42cae6f6728d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:03.836011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde509a-30fa-48aa-8899-42cae6f6728d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:03.837057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde509a-30fa-48aa-8899-42cae6f6728d None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=7cc93986f17a48809b5e9aa58ea66925, user.id=6cb812d57b84461b8b6450ef1b357cc1) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:03.837522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde509a-30fa-48aa-8899-42cae6f6728d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:03.839246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde509a-30fa-48aa-8899-42cae6f6728d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:03.844392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6654537-a0dc-4ae5-bab5-a51d47fd253f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-a6654537-a0dc-4ae5-bab5-a51d47fd253f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:03.853294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:03.854367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:03.856000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:03.856000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:03.856000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:03.856000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:03.856000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:03.856000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:03.856000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:03.856000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:03.856000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:03.856000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:03.856000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:03.856000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:03.858229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 78/166] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:03.859712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e3898-c9a5-455d-9280-08575a4f33de None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:03.860137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e3898-c9a5-455d-9280-08575a4f33de None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:03.860628 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e3898-c9a5-455d-9280-08575a4f33de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:03.861322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 89/167] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:03 2022] GET /identity/v3/role_assignments?user.id=6cb812d57b84461b8b6450ef1b357cc1&scope.project.id=7cc93986f17a48809b5e9aa58ea66925&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 608 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:03.862222 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde509a-30fa-48aa-8899-42cae6f6728d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:03.880620 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fd4e3898-c9a5-455d-9280-08575a4f33de None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:03.882600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fd4e3898-c9a5-455d-9280-08575a4f33de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:03.936284 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:04.062148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 79/168] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:04.063134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e3898-c9a5-455d-9280-08575a4f33de None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:04.086910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde509a-30fa-48aa-8899-42cae6f6728d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:04.127880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d746e3-62af-49b3-b579-6c4e41ec37f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:04.128945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d746e3-62af-49b3-b579-6c4e41ec37f6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:04.129423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d746e3-62af-49b3-b579-6c4e41ec37f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:04.129889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d746e3-62af-49b3-b579-6c4e41ec37f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:04.131658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d746e3-62af-49b3-b579-6c4e41ec37f6 None admin] RBAC: Adding query filter params (role.id=512083f4095a4f23a8dd4e8789fa20b3, scope.project.id=7cc93986f17a48809b5e9aa58ea66925, user.id=99e8056eecf3447b9595d527690fedf8) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:04.132229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d746e3-62af-49b3-b579-6c4e41ec37f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:04.133982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d746e3-62af-49b3-b579-6c4e41ec37f6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:04.141665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 90/169] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:03 2022] GET /identity/v3/role_assignments?user.id=99e8056eecf3447b9595d527690fedf8&scope.project.id=7cc93986f17a48809b5e9aa58ea66925&role.id=512083f4095a4f23a8dd4e8789fa20b3 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:04.147573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d746e3-62af-49b3-b579-6c4e41ec37f6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:04.282266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:04.283473 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:04.299488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d746e3-62af-49b3-b579-6c4e41ec37f6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:04.354918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cacca-950a-40c6-902d-ddf62c790d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:04.356290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cacca-950a-40c6-902d-ddf62c790d5c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:04.356580 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cacca-950a-40c6-902d-ddf62c790d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:04.356886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cacca-950a-40c6-902d-ddf62c790d5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:04.374684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cacca-950a-40c6-902d-ddf62c790d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-2e9cacca-950a-40c6-902d-ddf62c790d5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:04.387994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:04.388996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:04.389784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:04.389784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:04.389784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:04.389784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:04.389784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:04.389784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:04.389784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:04.389784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:04.389784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:04.389784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:04.389784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:04.389784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:04.389784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 91/170] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:04.399011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cacca-950a-40c6-902d-ddf62c790d5c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:04.467716 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e3898-c9a5-455d-9280-08575a4f33de None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:04.561027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3e51-282b-4d20-9a42-5afc3de119ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:04.561635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3e51-282b-4d20-9a42-5afc3de119ac None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:04.561922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3e51-282b-4d20-9a42-5afc3de119ac None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:04.562202 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3e51-282b-4d20-9a42-5afc3de119ac None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:04.562973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3e51-282b-4d20-9a42-5afc3de119ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:04.563287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3e51-282b-4d20-9a42-5afc3de119ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:04.564700 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3e51-282b-4d20-9a42-5afc3de119ac None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:04.588448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 80/171] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:04.590061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5cafb-267a-4c23-aee3-9dc6ab9c79d9 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:04.590359 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5cafb-267a-4c23-aee3-9dc6ab9c79d9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:04.590640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5cafb-267a-4c23-aee3-9dc6ab9c79d9 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:04.593297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 81/172] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:04.594096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5cafb-267a-4c23-aee3-9dc6ab9c79d9 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:04.603267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cacca-950a-40c6-902d-ddf62c790d5c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:04.685675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b9926-694b-4deb-8e3a-0d46d98b34a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:04.686395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b9926-694b-4deb-8e3a-0d46d98b34a8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:04.686688 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b9926-694b-4deb-8e3a-0d46d98b34a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:04.686969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b9926-694b-4deb-8e3a-0d46d98b34a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:04.687778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b9926-694b-4deb-8e3a-0d46d98b34a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:04.688096 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b9926-694b-4deb-8e3a-0d46d98b34a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:04.689634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b9926-694b-4deb-8e3a-0d46d98b34a8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:04.714606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 92/173] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:04.717890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308eb18-c792-45f1-a3ef-766703071ebe None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:04.718180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308eb18-c792-45f1-a3ef-766703071ebe None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:04.718461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308eb18-c792-45f1-a3ef-766703071ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:04.747458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:04.758625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7308eb18-c792-45f1-a3ef-766703071ebe None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:04.759859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7308eb18-c792-45f1-a3ef-766703071ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:04.826750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5cafb-267a-4c23-aee3-9dc6ab9c79d9 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:04.850300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 93/174] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:04.851302 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308eb18-c792-45f1-a3ef-766703071ebe None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:04.870407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:04.918360 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173b6d6-fa99-4ac5-9e28-539bcd3cc243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:04.919417 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b6d6-fa99-4ac5-9e28-539bcd3cc243 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:04.919706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b6d6-fa99-4ac5-9e28-539bcd3cc243 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:04.919986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b6d6-fa99-4ac5-9e28-539bcd3cc243 None admin] PATH_INFO: `/v3/users/99e8056eecf3447b9595d527690fedf8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:04.921270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173b6d6-fa99-4ac5-9e28-539bcd3cc243 None admin] RBAC: Authorizing `identity:get_user(user_id=99e8056eecf3447b9595d527690fedf8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:04.922829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173b6d6-fa99-4ac5-9e28-539bcd3cc243 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:04.924539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 82/175] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:04 2022] GET /identity/v3/users/99e8056eecf3447b9595d527690fedf8 => generated 275 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:04.926068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812fd2c-c8bc-4f31-8359-5e143fe6f61d None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:04.926355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812fd2c-c8bc-4f31-8359-5e143fe6f61d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:04.926634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f812fd2c-c8bc-4f31-8359-5e143fe6f61d None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:04.928062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 83/176] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:04.928872 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812fd2c-c8bc-4f31-8359-5e143fe6f61d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:04.996372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308eb18-c792-45f1-a3ef-766703071ebe None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:05.032124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fd527-e34f-4b32-af14-3564e0ff39c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:05.033042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fd527-e34f-4b32-af14-3564e0ff39c2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.033328 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fd527-e34f-4b32-af14-3564e0ff39c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.033603 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fd527-e34f-4b32-af14-3564e0ff39c2 None admin] PATH_INFO: `/v3/users/99e8056eecf3447b9595d527690fedf8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.034800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fd527-e34f-4b32-af14-3564e0ff39c2 None admin] RBAC: Authorizing `identity:get_user(user_id=99e8056eecf3447b9595d527690fedf8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:05.036248 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fd527-e34f-4b32-af14-3564e0ff39c2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:05.038640 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 94/177] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:04 2022] GET /identity/v3/users/99e8056eecf3447b9595d527690fedf8 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:05.041568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fd527-e34f-4b32-af14-3564e0ff39c2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:05.044954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:05.049162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f812fd2c-c8bc-4f31-8359-5e143fe6f61d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:05.083561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41ab1b-fe85-44ff-aee8-77ea2b1efc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:05.084355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41ab1b-fe85-44ff-aee8-77ea2b1efc9a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.084641 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41ab1b-fe85-44ff-aee8-77ea2b1efc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.084952 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41ab1b-fe85-44ff-aee8-77ea2b1efc9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.094991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41ab1b-fe85-44ff-aee8-77ea2b1efc9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ee41ab1b-fe85-44ff-aee8-77ea2b1efc9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:05.103088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:05.103985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:05.105071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:05.105071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:05.105071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:05.105071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:05.105071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:05.105071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:05.105071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:05.105071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:05.105071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:05.105071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:05.105071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:05.105071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:05.105071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 84/178] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:18:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:05.105719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10625e66-286e-4723-8c30-ae16b95d025b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.105719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10625e66-286e-4723-8c30-ae16b95d025b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.105978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10625e66-286e-4723-8c30-ae16b95d025b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.122672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-10625e66-286e-4723-8c30-ae16b95d025b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:05.123864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-10625e66-286e-4723-8c30-ae16b95d025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:05.143913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fd527-e34f-4b32-af14-3564e0ff39c2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:05.167423 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:05.178699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf962-ecca-4476-a1e9-26cce54d4c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:05.179345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf962-ecca-4476-a1e9-26cce54d4c56 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.179634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf962-ecca-4476-a1e9-26cce54d4c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.179914 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf962-ecca-4476-a1e9-26cce54d4c56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.192596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 85/179] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:05.193976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63743f-3a84-4c55-8c64-bd3ac25adfc7 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.194270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63743f-3a84-4c55-8c64-bd3ac25adfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.194551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63743f-3a84-4c55-8c64-bd3ac25adfc7 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.195830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 86/180] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:05.196920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aba1b-f164-4c89-a2da-ae2d32417ce0 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.197206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aba1b-f164-4c89-a2da-ae2d32417ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.197487 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27aba1b-f164-4c89-a2da-ae2d32417ce0 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.198706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 87/181] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:05.199407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aba1b-f164-4c89-a2da-ae2d32417ce0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:05.252179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bf962-ecca-4476-a1e9-26cce54d4c56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:05.253702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bf962-ecca-4476-a1e9-26cce54d4c56 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:05.257209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:05.311774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27aba1b-f164-4c89-a2da-ae2d32417ce0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:05.353921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c8a77-537f-4ad7-8054-d14972a1b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:05.354486 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c8a77-537f-4ad7-8054-d14972a1b71d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.354773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c8a77-537f-4ad7-8054-d14972a1b71d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.355045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c8a77-537f-4ad7-8054-d14972a1b71d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.361685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 95/182] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:05.362532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf962-ecca-4476-a1e9-26cce54d4c56 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:05.400080 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:05.423225 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c8a77-537f-4ad7-8054-d14972a1b71d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:05.424705 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c8a77-537f-4ad7-8054-d14972a1b71d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:05.461023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf962-ecca-4476-a1e9-26cce54d4c56 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:05.463253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:05.496354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c46f1-f876-43f7-aba3-0c5fec931c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:05.497058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c46f1-f876-43f7-aba3-0c5fec931c17 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.497345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c46f1-f876-43f7-aba3-0c5fec931c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.497628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c46f1-f876-43f7-aba3-0c5fec931c17 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.498374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c46f1-f876-43f7-aba3-0c5fec931c17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:05.498684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c46f1-f876-43f7-aba3-0c5fec931c17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:05.500077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c46f1-f876-43f7-aba3-0c5fec931c17 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:05.508166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 96/183] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:05.509383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd159b63-de47-4804-be47-75ff26069248 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.509677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd159b63-de47-4804-be47-75ff26069248 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.509957 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd159b63-de47-4804-be47-75ff26069248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.523510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 88/184] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:05.526209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503d6ed-30f3-4778-a55d-ce5d7e3408d1 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.526209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503d6ed-30f3-4778-a55d-ce5d7e3408d1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.526209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503d6ed-30f3-4778-a55d-ce5d7e3408d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.527078 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-dd159b63-de47-4804-be47-75ff26069248 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:05.528278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dd159b63-de47-4804-be47-75ff26069248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:05.541429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b503d6ed-30f3-4778-a55d-ce5d7e3408d1 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:05.542775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b503d6ed-30f3-4778-a55d-ce5d7e3408d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:05.596343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 97/185] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:05.608947 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd159b63-de47-4804-be47-75ff26069248 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:05.620734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 89/186] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:05.620734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503d6ed-30f3-4778-a55d-ce5d7e3408d1 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:05.620734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:05.695088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:05.701215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd159b63-de47-4804-be47-75ff26069248 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:05.715024 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503d6ed-30f3-4778-a55d-ce5d7e3408d1 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:05.734810 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b985c-783f-40d7-a689-50dca73e2d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:05.735695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b985c-783f-40d7-a689-50dca73e2d4c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.735989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b985c-783f-40d7-a689-50dca73e2d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.736268 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b985c-783f-40d7-a689-50dca73e2d4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.747148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b985c-783f-40d7-a689-50dca73e2d4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:05.748935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a9d28-c1f5-4f07-adde-532c74d830c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:05.749797 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a9d28-c1f5-4f07-adde-532c74d830c6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.750081 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a9d28-c1f5-4f07-adde-532c74d830c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.750356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a9d28-c1f5-4f07-adde-532c74d830c6 None admin] PATH_INFO: `/v3/projects/b76e43674e884119998104ebcfc7992e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.751536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a9d28-c1f5-4f07-adde-532c74d830c6 None admin] RBAC: Authorizing `identity:get_project(project_id=b76e43674e884119998104ebcfc7992e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:05.753002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a9d28-c1f5-4f07-adde-532c74d830c6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:05.754691 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 90/187] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:05 2022] GET /identity/v3/projects/b76e43674e884119998104ebcfc7992e => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-832b985c-783f-40d7-a689-50dca73e2d4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:05.755332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:05.756846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:05.757767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:05.757767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:05.757767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:05.757767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:05.757767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:05.757767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:05.757767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:05.757767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:05.757767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:05.757767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:05.757767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:05.757767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:05.758454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a9d28-c1f5-4f07-adde-532c74d830c6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:05.758536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 98/188] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:18:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:05.758536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b985c-783f-40d7-a689-50dca73e2d4c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:05.833527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:05.859026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a9d28-c1f5-4f07-adde-532c74d830c6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:05.859166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b985c-783f-40d7-a689-50dca73e2d4c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:05.893427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7e520-b6a1-493b-9afa-0fab8966ef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:05.894297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7e520-b6a1-493b-9afa-0fab8966ef72 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.894580 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7e520-b6a1-493b-9afa-0fab8966ef72 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.894856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7e520-b6a1-493b-9afa-0fab8966ef72 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.896034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7e520-b6a1-493b-9afa-0fab8966ef72 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:05.897325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5d690-a062-4474-b45a-430225526bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:05.897859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7e520-b6a1-493b-9afa-0fab8966ef72 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:05.898212 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5d690-a062-4474-b45a-430225526bab None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:05.898499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5d690-a062-4474-b45a-430225526bab None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:05.898775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5d690-a062-4474-b45a-430225526bab None admin] PATH_INFO: `/v3/users/36dd0bbc1d984a4d9a8b22fcfde451bd` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:05.899560 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 99/189] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:05 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:05.900318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7e520-b6a1-493b-9afa-0fab8966ef72 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:05.918735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5d690-a062-4474-b45a-430225526bab None admin] RBAC: Authorizing `identity:get_user(user_id=36dd0bbc1d984a4d9a8b22fcfde451bd)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:05.920212 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5d690-a062-4474-b45a-430225526bab None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:05.921972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 91/190] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:05 2022] GET /identity/v3/users/36dd0bbc1d984a4d9a8b22fcfde451bd => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:05.922740 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5d690-a062-4474-b45a-430225526bab None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:05.928959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:06.004964 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7e520-b6a1-493b-9afa-0fab8966ef72 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:06.024820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5d690-a062-4474-b45a-430225526bab None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:06.039392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70168523-0246-4c92-a7e5-a22bd09f965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:06.040192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70168523-0246-4c92-a7e5-a22bd09f965d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:06.040479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70168523-0246-4c92-a7e5-a22bd09f965d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:06.040791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70168523-0246-4c92-a7e5-a22bd09f965d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:06.041969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70168523-0246-4c92-a7e5-a22bd09f965d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:06.043464 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70168523-0246-4c92-a7e5-a22bd09f965d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:06.045121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 100/191] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:06.045889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70168523-0246-4c92-a7e5-a22bd09f965d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:06.059801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:06.065146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6917cb1-7c89-4aaf-9f3f-cb5a88c9961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:06.065946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6917cb1-7c89-4aaf-9f3f-cb5a88c9961c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:06.066229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6917cb1-7c89-4aaf-9f3f-cb5a88c9961c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:06.066502 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6917cb1-7c89-4aaf-9f3f-cb5a88c9961c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:06.077018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6917cb1-7c89-4aaf-9f3f-cb5a88c9961c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b6917cb1-7c89-4aaf-9f3f-cb5a88c9961c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:06.085304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:06.086329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 92/192] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:06.092143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6917cb1-7c89-4aaf-9f3f-cb5a88c9961c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:06.145411 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:06.154975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70168523-0246-4c92-a7e5-a22bd09f965d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:06.187915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e581040-99d0-4ac1-814d-c74a14bb4e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:06.188567 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e581040-99d0-4ac1-814d-c74a14bb4e90 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:06.188890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e581040-99d0-4ac1-814d-c74a14bb4e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:06.189172 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e581040-99d0-4ac1-814d-c74a14bb4e90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:06.189444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6917cb1-7c89-4aaf-9f3f-cb5a88c9961c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:06.190011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e581040-99d0-4ac1-814d-c74a14bb4e90 None admin] RBAC: Adding query filter params (role.id=c860ed9e0b784b18a457abd0ddb5f508, scope.project.id=b76e43674e884119998104ebcfc7992e, user.id=99e8056eecf3447b9595d527690fedf8) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:06.190328 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e581040-99d0-4ac1-814d-c74a14bb4e90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:06.191799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e581040-99d0-4ac1-814d-c74a14bb4e90 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:06.197777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 101/193] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:06 2022] GET /identity/v3/role_assignments?user.id=99e8056eecf3447b9595d527690fedf8&scope.project.id=b76e43674e884119998104ebcfc7992e&role.id=c860ed9e0b784b18a457abd0ddb5f508 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:06.198569 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e581040-99d0-4ac1-814d-c74a14bb4e90 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:06.237505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fc6b8-6932-4465-b2fb-b14327345379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:06.238189 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fc6b8-6932-4465-b2fb-b14327345379 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:06.238477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fc6b8-6932-4465-b2fb-b14327345379 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:06.239524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fc6b8-6932-4465-b2fb-b14327345379 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:06.239524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fc6b8-6932-4465-b2fb-b14327345379 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:06.239834 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fc6b8-6932-4465-b2fb-b14327345379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:06.242212 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fc6b8-6932-4465-b2fb-b14327345379 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:06.251599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 93/194] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:06.252510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fc6b8-6932-4465-b2fb-b14327345379 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:06.324257 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:06.325406 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e581040-99d0-4ac1-814d-c74a14bb4e90 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:06.365695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c6e7a-d63a-4259-8995-e54f0ac300e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:06.366435 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c6e7a-d63a-4259-8995-e54f0ac300e0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:06.366724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c6e7a-d63a-4259-8995-e54f0ac300e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:06.367323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c6e7a-d63a-4259-8995-e54f0ac300e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:06.367891 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c6e7a-d63a-4259-8995-e54f0ac300e0 None admin] RBAC: Adding query filter params (role.id=c860ed9e0b784b18a457abd0ddb5f508, scope.project.id=7cc93986f17a48809b5e9aa58ea66925, user.id=99e8056eecf3447b9595d527690fedf8) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:06.368297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c6e7a-d63a-4259-8995-e54f0ac300e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:06.369723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c6e7a-d63a-4259-8995-e54f0ac300e0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:06.376017 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 102/195] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:06 2022] GET /identity/v3/role_assignments?user.id=99e8056eecf3447b9595d527690fedf8&scope.project.id=7cc93986f17a48809b5e9aa58ea66925&role.id=c860ed9e0b784b18a457abd0ddb5f508 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:06.377113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fc6b8-6932-4465-b2fb-b14327345379 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:06.378051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c6e7a-d63a-4259-8995-e54f0ac300e0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:06.412648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:06.426044 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5a5df-2fe0-41a3-9b4c-6e6d42a5055c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:06.426719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5a5df-2fe0-41a3-9b4c-6e6d42a5055c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:06.427005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5a5df-2fe0-41a3-9b4c-6e6d42a5055c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:06.427288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5a5df-2fe0-41a3-9b4c-6e6d42a5055c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:06.518365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c6e7a-d63a-4259-8995-e54f0ac300e0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:06.526901 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5a5df-2fe0-41a3-9b4c-6e6d42a5055c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:06.529300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5a5df-2fe0-41a3-9b4c-6e6d42a5055c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:06.557101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120d8fa-9e25-463d-9019-d3a270ca7d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:06.557969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d8fa-9e25-463d-9019-d3a270ca7d28 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:06.558255 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d8fa-9e25-463d-9019-d3a270ca7d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:06.558953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120d8fa-9e25-463d-9019-d3a270ca7d28 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:06.560027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120d8fa-9e25-463d-9019-d3a270ca7d28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:06.562052 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120d8fa-9e25-463d-9019-d3a270ca7d28 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:06.589668 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 103/196] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:18:06 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:18:06.591802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120d8fa-9e25-463d-9019-d3a270ca7d28 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:06.595640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:06.686463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 94/197] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:06.686463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5a5df-2fe0-41a3-9b4c-6e6d42a5055c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:06.720133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:06.747906 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120d8fa-9e25-463d-9019-d3a270ca7d28 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:06.786646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0725d26-6ac4-405a-9681-f542d63c6545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:06.788354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0725d26-6ac4-405a-9681-f542d63c6545 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:06.788643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0725d26-6ac4-405a-9681-f542d63c6545 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:06.789546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0725d26-6ac4-405a-9681-f542d63c6545 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:06.789729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0725d26-6ac4-405a-9681-f542d63c6545 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:06.790027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0725d26-6ac4-405a-9681-f542d63c6545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:06.791428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0725d26-6ac4-405a-9681-f542d63c6545 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:06.800466 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 104/198] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:06.802144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0725d26-6ac4-405a-9681-f542d63c6545 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:06.810415 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5a5df-2fe0-41a3-9b4c-6e6d42a5055c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:06.853815 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe292de-7410-48b1-add2-e9b22d8ed2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:06.855037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe292de-7410-48b1-add2-e9b22d8ed2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:06.855319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe292de-7410-48b1-add2-e9b22d8ed2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:06.855586 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe292de-7410-48b1-add2-e9b22d8ed2f6 None admin] PATH_INFO: `/v3/users/36dd0bbc1d984a4d9a8b22fcfde451bd` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:06.856855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe292de-7410-48b1-add2-e9b22d8ed2f6 None admin] RBAC: Authorizing `identity:get_user(user_id=36dd0bbc1d984a4d9a8b22fcfde451bd)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:06.858318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe292de-7410-48b1-add2-e9b22d8ed2f6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:06.860009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 95/199] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:06 2022] GET /identity/v3/users/36dd0bbc1d984a4d9a8b22fcfde451bd => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:06.866809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe292de-7410-48b1-add2-e9b22d8ed2f6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:06.905495 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:06.943356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0725d26-6ac4-405a-9681-f542d63c6545 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:06.985451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a21a1a-9aa2-47d0-a0c4-43f800474543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:06.986706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a21a1a-9aa2-47d0-a0c4-43f800474543 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:06.987162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a21a1a-9aa2-47d0-a0c4-43f800474543 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:06.987608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a21a1a-9aa2-47d0-a0c4-43f800474543 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:06.989107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a21a1a-9aa2-47d0-a0c4-43f800474543 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:06.991277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a21a1a-9aa2-47d0-a0c4-43f800474543 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:06.993312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 105/200] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:06 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:06.994267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a21a1a-9aa2-47d0-a0c4-43f800474543 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:07.008912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:07.016215 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe292de-7410-48b1-add2-e9b22d8ed2f6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:07.062103 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0f8ba-785f-4a54-95a9-f53add912d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:07.063651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0f8ba-785f-4a54-95a9-f53add912d56 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:07.064116 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0f8ba-785f-4a54-95a9-f53add912d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:07.064573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0f8ba-785f-4a54-95a9-f53add912d56 None admin] PATH_INFO: `/v3/users/8b8ad06dbb8b40e085589301978ec729` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:07.066564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0f8ba-785f-4a54-95a9-f53add912d56 None admin] RBAC: Authorizing `identity:get_user(user_id=8b8ad06dbb8b40e085589301978ec729)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:07.069210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0f8ba-785f-4a54-95a9-f53add912d56 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:07.071846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 96/201] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:06 2022] GET /identity/v3/users/8b8ad06dbb8b40e085589301978ec729 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:07.073577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0f8ba-785f-4a54-95a9-f53add912d56 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:07.119739 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a21a1a-9aa2-47d0-a0c4-43f800474543 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:07.157011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b1d9a-f1e8-4fe1-86c1-ecb2f47857a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:07.157759 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b1d9a-f1e8-4fe1-86c1-ecb2f47857a8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:07.158109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b1d9a-f1e8-4fe1-86c1-ecb2f47857a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:07.158677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b1d9a-f1e8-4fe1-86c1-ecb2f47857a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:07.199996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:07.210768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0f8ba-785f-4a54-95a9-f53add912d56 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:07.236622 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b1d9a-f1e8-4fe1-86c1-ecb2f47857a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:07.238214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b1d9a-f1e8-4fe1-86c1-ecb2f47857a8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:07.247035 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:07.250291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce204b-91ea-4392-9511-d18f311bfa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:07.251197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce204b-91ea-4392-9511-d18f311bfa98 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:07.251677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce204b-91ea-4392-9511-d18f311bfa98 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:07.252169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce204b-91ea-4392-9511-d18f311bfa98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:07.254786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce204b-91ea-4392-9511-d18f311bfa98 None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=6252742811f240f8936cf0519e7401b8, user.id=36dd0bbc1d984a4d9a8b22fcfde451bd) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:07.256621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce204b-91ea-4392-9511-d18f311bfa98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:07.258223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce204b-91ea-4392-9511-d18f311bfa98 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:07.268820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 97/202] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:07 2022] GET /identity/v3/role_assignments?user.id=36dd0bbc1d984a4d9a8b22fcfde451bd&scope.project.id=6252742811f240f8936cf0519e7401b8&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:07.269799 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce204b-91ea-4392-9511-d18f311bfa98 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:07.359426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 106/203] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:07.366075 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b1d9a-f1e8-4fe1-86c1-ecb2f47857a8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:07.493386 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b1d9a-f1e8-4fe1-86c1-ecb2f47857a8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:07.509509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:07.517429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce204b-91ea-4392-9511-d18f311bfa98 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:07.544507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb54d8-3354-4611-9423-656b66cb50a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:07.545474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb54d8-3354-4611-9423-656b66cb50a4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:07.545911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb54d8-3354-4611-9423-656b66cb50a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:07.546241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb54d8-3354-4611-9423-656b66cb50a4 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:07.547638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb54d8-3354-4611-9423-656b66cb50a4 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:07.549225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb54d8-3354-4611-9423-656b66cb50a4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:07.551334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 107/204] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:07 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:07.559585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb54d8-3354-4611-9423-656b66cb50a4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:07.562828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bdf10-3387-4740-9454-b6ad157de93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:07.563689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bdf10-3387-4740-9454-b6ad157de93c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:07.564159 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bdf10-3387-4740-9454-b6ad157de93c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:07.564610 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92bdf10-3387-4740-9454-b6ad157de93c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:07.593520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:07.683794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb54d8-3354-4611-9423-656b66cb50a4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:07.688575 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bdf10-3387-4740-9454-b6ad157de93c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:07.694630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92bdf10-3387-4740-9454-b6ad157de93c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:07.723265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14e5fc-73d8-4dd5-a19d-90ed45f88d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:07.723922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14e5fc-73d8-4dd5-a19d-90ed45f88d26 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:07.724297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14e5fc-73d8-4dd5-a19d-90ed45f88d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:07.728734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14e5fc-73d8-4dd5-a19d-90ed45f88d26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:07.728734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14e5fc-73d8-4dd5-a19d-90ed45f88d26 None admin] RBAC: Adding query filter params (role.id=512083f4095a4f23a8dd4e8789fa20b3, scope.project.id=6252742811f240f8936cf0519e7401b8, user.id=36dd0bbc1d984a4d9a8b22fcfde451bd) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:07.728734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14e5fc-73d8-4dd5-a19d-90ed45f88d26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:07.728734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14e5fc-73d8-4dd5-a19d-90ed45f88d26 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:07.734467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 108/205] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:07 2022] GET /identity/v3/role_assignments?user.id=36dd0bbc1d984a4d9a8b22fcfde451bd&scope.project.id=6252742811f240f8936cf0519e7401b8&role.id=512083f4095a4f23a8dd4e8789fa20b3 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:07.874998 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 98/206] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:07.882987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14e5fc-73d8-4dd5-a19d-90ed45f88d26 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:07.946997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:08.013755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14e5fc-73d8-4dd5-a19d-90ed45f88d26 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:08.053348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad13cb-eb9b-4437-8b4c-aedb4e7b7815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:08.054530 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad13cb-eb9b-4437-8b4c-aedb4e7b7815 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:08.054812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad13cb-eb9b-4437-8b4c-aedb4e7b7815 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:08.055084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad13cb-eb9b-4437-8b4c-aedb4e7b7815 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:08.056297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad13cb-eb9b-4437-8b4c-aedb4e7b7815 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:08.057788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad13cb-eb9b-4437-8b4c-aedb4e7b7815 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:08.059651 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 109/207] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:07 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:08.065294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bdf10-3387-4740-9454-b6ad157de93c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:08.125849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:08.173497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92bdf10-3387-4740-9454-b6ad157de93c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:08.213525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46739118-dc3a-4b8a-ae1d-714cbb3e0dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:08.214200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46739118-dc3a-4b8a-ae1d-714cbb3e0dbf None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:08.214488 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46739118-dc3a-4b8a-ae1d-714cbb3e0dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:08.214769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46739118-dc3a-4b8a-ae1d-714cbb3e0dbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:08.215618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46739118-dc3a-4b8a-ae1d-714cbb3e0dbf None admin] RBAC: Adding query filter params (role.id=d85cfbcde27e45afbe2c7ec009e1c0c7, scope.project.id=7cc93986f17a48809b5e9aa58ea66925, user.id=8b8ad06dbb8b40e085589301978ec729) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:08.215931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46739118-dc3a-4b8a-ae1d-714cbb3e0dbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:08.217449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46739118-dc3a-4b8a-ae1d-714cbb3e0dbf None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:08.224762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 99/208] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:08 2022] GET /identity/v3/role_assignments?user.id=8b8ad06dbb8b40e085589301978ec729&scope.project.id=7cc93986f17a48809b5e9aa58ea66925&role.id=d85cfbcde27e45afbe2c7ec009e1c0c7 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:09.120639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b8edb-7dc9-4d1b-a263-d631182f3f01 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:09.121198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b8edb-7dc9-4d1b-a263-d631182f3f01 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:09.121198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b8edb-7dc9-4d1b-a263-d631182f3f01 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:09.122718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 110/209] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:09.128476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0b87-5f23-4a64-8a5d-383c3c30d2b9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:09.129423 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0b87-5f23-4a64-8a5d-383c3c30d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:09.129905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0b87-5f23-4a64-8a5d-383c3c30d2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:09.148122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-926b0b87-5f23-4a64-8a5d-383c3c30d2b9 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:09.149640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-926b0b87-5f23-4a64-8a5d-383c3c30d2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:09.223609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 100/210] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:09.249498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b8edb-7dc9-4d1b-a263-d631182f3f01 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:09.361670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b8edb-7dc9-4d1b-a263-d631182f3f01 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:09.370431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:09.389233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dacb8-5fb1-4de5-931d-5fe6e28a62b0 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:09.389845 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dacb8-5fb1-4de5-931d-5fe6e28a62b0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:09.390346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dacb8-5fb1-4de5-931d-5fe6e28a62b0 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:09.392170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 101/211] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:18:09.398966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fd1b7-a761-4897-92ac-80f9bd46c1e6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:09.399449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fd1b7-a761-4897-92ac-80f9bd46c1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:09.399738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fd1b7-a761-4897-92ac-80f9bd46c1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:09.400498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af4e56-e422-44ea-a838-8c9477086de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:09.401329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af4e56-e422-44ea-a838-8c9477086de5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:09.401611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af4e56-e422-44ea-a838-8c9477086de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:09.401884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af4e56-e422-44ea-a838-8c9477086de5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:09.403048 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af4e56-e422-44ea-a838-8c9477086de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:09.404499 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af4e56-e422-44ea-a838-8c9477086de5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:09.407476 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 111/212] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:09.417372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af4e56-e422-44ea-a838-8c9477086de5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:09.422362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4f7fd1b7-a761-4897-92ac-80f9bd46c1e6 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:09.423647 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4f7fd1b7-a761-4897-92ac-80f9bd46c1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:09.478993 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:09.511747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 102/213] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:09.531041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af4e56-e422-44ea-a838-8c9477086de5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:09.534396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fd1b7-a761-4897-92ac-80f9bd46c1e6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:09.570718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f626fb2-4e8f-484e-ba15-51ec710b3677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:09.571662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f626fb2-4e8f-484e-ba15-51ec710b3677 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:09.572059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f626fb2-4e8f-484e-ba15-51ec710b3677 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:09.572576 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f626fb2-4e8f-484e-ba15-51ec710b3677 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:09.573501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f626fb2-4e8f-484e-ba15-51ec710b3677 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:09.575079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f626fb2-4e8f-484e-ba15-51ec710b3677 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:09.609059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 112/214] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:18:09 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:18:09.649626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fd1b7-a761-4897-92ac-80f9bd46c1e6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:09.691142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3931ed9-5fe0-4183-b718-fee2830d4f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:09.692047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3931ed9-5fe0-4183-b718-fee2830d4f38 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:09.692330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3931ed9-5fe0-4183-b718-fee2830d4f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:09.692604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3931ed9-5fe0-4183-b718-fee2830d4f38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:09.706101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3931ed9-5fe0-4183-b718-fee2830d4f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-c3931ed9-5fe0-4183-b718-fee2830d4f38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:09.714390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:09.715384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:09.716186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:09.716186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:09.716186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:09.716186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:09.716186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:09.716186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:09.716186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:09.716186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:09.716186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:09.716186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:09.716186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:09.716186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:09.716186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 103/215] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:09.727275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f626fb2-4e8f-484e-ba15-51ec710b3677 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:09.763564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:09.843967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f626fb2-4e8f-484e-ba15-51ec710b3677 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:09.877231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727907df-df76-4241-9db1-763f34938b1e None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:09.877574 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727907df-df76-4241-9db1-763f34938b1e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:09.877791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727907df-df76-4241-9db1-763f34938b1e None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:09.879451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 104/216] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:09.882954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6fd52-8c9a-451e-9507-603bdc589420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:09.883889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6fd52-8c9a-451e-9507-603bdc589420 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:09.884941 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6fd52-8c9a-451e-9507-603bdc589420 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:09.885409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6fd52-8c9a-451e-9507-603bdc589420 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:09.886338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6fd52-8c9a-451e-9507-603bdc589420 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:09.886809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6fd52-8c9a-451e-9507-603bdc589420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:09.888376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6fd52-8c9a-451e-9507-603bdc589420 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:09.890001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddd6c0-6527-44a8-81bd-a640c60fbeb4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:09.890492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddd6c0-6527-44a8-81bd-a640c60fbeb4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:09.891213 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddd6c0-6527-44a8-81bd-a640c60fbeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:09.898597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 113/217] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:09.904036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6fd52-8c9a-451e-9507-603bdc589420 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:09.917650 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c6ddd6c0-6527-44a8-81bd-a640c60fbeb4 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:09.919669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c6ddd6c0-6527-44a8-81bd-a640c60fbeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:09.959778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:10.016683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 105/218] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:10.022685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:10.032588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6fd52-8c9a-451e-9507-603bdc589420 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:10.045066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddd6c0-6527-44a8-81bd-a640c60fbeb4 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:10.081218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f84b7-0293-424c-82c7-4516e8101cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:10.082110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f84b7-0293-424c-82c7-4516e8101cbf None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:10.082488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f84b7-0293-424c-82c7-4516e8101cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:10.082779 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f84b7-0293-424c-82c7-4516e8101cbf None admin] PATH_INFO: `/v3/users/7c6ed56d6ce147f0b040c74aee8cfc70` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:10.098537 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f84b7-0293-424c-82c7-4516e8101cbf None admin] RBAC: Authorizing `identity:get_user(user_id=7c6ed56d6ce147f0b040c74aee8cfc70)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:10.100243 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f84b7-0293-424c-82c7-4516e8101cbf None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:10.102368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 114/219] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:09 2022] GET /identity/v3/users/7c6ed56d6ce147f0b040c74aee8cfc70 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:10.111633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f84b7-0293-424c-82c7-4516e8101cbf None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:10.157425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddd6c0-6527-44a8-81bd-a640c60fbeb4 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:10.195444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a73bb5-5214-4003-975c-0b02abdfc351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:10.196353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a73bb5-5214-4003-975c-0b02abdfc351 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:10.196708 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a73bb5-5214-4003-975c-0b02abdfc351 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:10.197079 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a73bb5-5214-4003-975c-0b02abdfc351 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:10.207701 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a73bb5-5214-4003-975c-0b02abdfc351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-70a73bb5-5214-4003-975c-0b02abdfc351 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:10.215654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:10.216784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:10.217790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:10.217790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:10.217790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:10.217790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:10.217790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:10.217790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:10.217790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:10.217790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:10.217790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:10.217790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:10.217790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:10.217790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:10.219362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 106/220] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:18:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:10.225651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a73bb5-5214-4003-975c-0b02abdfc351 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:10.266563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:10.340020 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a73bb5-5214-4003-975c-0b02abdfc351 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:10.352406 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f84b7-0293-424c-82c7-4516e8101cbf None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:10.377108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f65ab-128a-40f3-91e3-3545429b01e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:10.377883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f65ab-128a-40f3-91e3-3545429b01e2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:10.378214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f65ab-128a-40f3-91e3-3545429b01e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:10.378526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f65ab-128a-40f3-91e3-3545429b01e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:10.379284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f65ab-128a-40f3-91e3-3545429b01e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:10.379590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f65ab-128a-40f3-91e3-3545429b01e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:10.383018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f65ab-128a-40f3-91e3-3545429b01e2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:10.390351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75fb40-b472-4f84-baa2-3288d06d9661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:10.391396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75fb40-b472-4f84-baa2-3288d06d9661 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:10.391778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75fb40-b472-4f84-baa2-3288d06d9661 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:10.392163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da75fb40-b472-4f84-baa2-3288d06d9661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:10.392628 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 107/221] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:10.394164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3834699-9bf6-4707-b6d2-8e400cc2388b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:10.394455 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3834699-9bf6-4707-b6d2-8e400cc2388b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:10.394731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3834699-9bf6-4707-b6d2-8e400cc2388b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:10.396975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 108/222] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:10.398932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3834699-9bf6-4707-b6d2-8e400cc2388b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:10.418167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:10.474532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75fb40-b472-4f84-baa2-3288d06d9661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:10.477262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da75fb40-b472-4f84-baa2-3288d06d9661 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:10.503632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:10.517185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3834699-9bf6-4707-b6d2-8e400cc2388b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:10.563058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d8b3a-9a39-4d9e-8ef1-a01521ed4701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:10.564525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d8b3a-9a39-4d9e-8ef1-a01521ed4701 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:10.564994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d8b3a-9a39-4d9e-8ef1-a01521ed4701 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:10.565284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d8b3a-9a39-4d9e-8ef1-a01521ed4701 None admin] PATH_INFO: `/v3/users/36dd0bbc1d984a4d9a8b22fcfde451bd` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:10.566497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d8b3a-9a39-4d9e-8ef1-a01521ed4701 None admin] RBAC: Authorizing `identity:get_user(user_id=36dd0bbc1d984a4d9a8b22fcfde451bd)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:10.568850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d8b3a-9a39-4d9e-8ef1-a01521ed4701 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:10.571262 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 109/223] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:10 2022] GET /identity/v3/users/36dd0bbc1d984a4d9a8b22fcfde451bd => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:10.572604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a2913-3656-49b0-b26d-4303a0454461 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:10.573174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a2913-3656-49b0-b26d-4303a0454461 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:10.573460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a2913-3656-49b0-b26d-4303a0454461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:10.595015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-da3a2913-3656-49b0-b26d-4303a0454461 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:10.596759 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-da3a2913-3656-49b0-b26d-4303a0454461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:10.613663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 115/224] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:10.615306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75fb40-b472-4f84-baa2-3288d06d9661 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:10.685916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:10.688150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 110/225] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:10.688938 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a2913-3656-49b0-b26d-4303a0454461 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:10.756925 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da75fb40-b472-4f84-baa2-3288d06d9661 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:10.794920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aef7f-6367-4802-9feb-6906412667f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:10.796073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aef7f-6367-4802-9feb-6906412667f0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:10.796536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aef7f-6367-4802-9feb-6906412667f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:10.797004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aef7f-6367-4802-9feb-6906412667f0 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:10.798392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217aef7f-6367-4802-9feb-6906412667f0 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:10.799591 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:10.800599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217aef7f-6367-4802-9feb-6906412667f0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:10.803501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 116/226] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:10 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:10.804460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aef7f-6367-4802-9feb-6906412667f0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:10.813714 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a2913-3656-49b0-b26d-4303a0454461 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:10.856363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8948e1-1351-4cb3-8d08-4493aff6d767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:10.857278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8948e1-1351-4cb3-8d08-4493aff6d767 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:10.857565 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8948e1-1351-4cb3-8d08-4493aff6d767 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:10.857842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8948e1-1351-4cb3-8d08-4493aff6d767 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:10.859047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8948e1-1351-4cb3-8d08-4493aff6d767 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:10.860509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8948e1-1351-4cb3-8d08-4493aff6d767 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:10.862429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 111/227] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:10 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:10.863088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8948e1-1351-4cb3-8d08-4493aff6d767 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:10.915503 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aef7f-6367-4802-9feb-6906412667f0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:10.934087 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:10.956008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55531fff-548d-4fc2-a77d-584a6c7b71fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:10.957125 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55531fff-548d-4fc2-a77d-584a6c7b71fb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:10.957600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55531fff-548d-4fc2-a77d-584a6c7b71fb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:10.958061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55531fff-548d-4fc2-a77d-584a6c7b71fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:10.968817 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55531fff-548d-4fc2-a77d-584a6c7b71fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-55531fff-548d-4fc2-a77d-584a6c7b71fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:10.977472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:10.978331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:10.979121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:10.979121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:10.979121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:10.979121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:10.979121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:10.979121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:10.979121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:10.979121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:10.979121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:10.979121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:10.979121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:10.979121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:10.979728 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8948e1-1351-4cb3-8d08-4493aff6d767 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:10.981534 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 117/228] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:18:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:10.982556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55531fff-548d-4fc2-a77d-584a6c7b71fb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:11.015419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455eee6-e3a6-4a38-be49-0846d50e3db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:11.016606 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455eee6-e3a6-4a38-be49-0846d50e3db1 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:11.016929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455eee6-e3a6-4a38-be49-0846d50e3db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:11.017313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455eee6-e3a6-4a38-be49-0846d50e3db1 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8/users/36dd0bbc1d984a4d9a8b22fcfde451bd/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:11.019384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455eee6-e3a6-4a38-be49-0846d50e3db1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6252742811f240f8936cf0519e7401b8, user_id=36dd0bbc1d984a4d9a8b22fcfde451bd, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:11.021302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455eee6-e3a6-4a38-be49-0846d50e3db1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:11.038876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 112/229] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:18:10 2022] PUT /identity/v3/projects/6252742811f240f8936cf0519e7401b8/users/36dd0bbc1d984a4d9a8b22fcfde451bd/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:18:11.046002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455eee6-e3a6-4a38-be49-0846d50e3db1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:11.077487 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:11.098972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55531fff-548d-4fc2-a77d-584a6c7b71fb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:11.139697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c556fd-8bb1-4dd2-8ca8-7df2eb41b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:11.141034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c556fd-8bb1-4dd2-8ca8-7df2eb41b365 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:11.141519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c556fd-8bb1-4dd2-8ca8-7df2eb41b365 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:11.142046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c556fd-8bb1-4dd2-8ca8-7df2eb41b365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:11.143148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c556fd-8bb1-4dd2-8ca8-7df2eb41b365 None admin] RBAC: Adding query filter params (role.id=c860ed9e0b784b18a457abd0ddb5f508, scope.project.id=6252742811f240f8936cf0519e7401b8, user.id=7c6ed56d6ce147f0b040c74aee8cfc70) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:11.143692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c556fd-8bb1-4dd2-8ca8-7df2eb41b365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:11.145444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c556fd-8bb1-4dd2-8ca8-7df2eb41b365 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:11.153172 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 118/230] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:10 2022] GET /identity/v3/role_assignments?user.id=7c6ed56d6ce147f0b040c74aee8cfc70&scope.project.id=6252742811f240f8936cf0519e7401b8&role.id=c860ed9e0b784b18a457abd0ddb5f508 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:11.233458 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455eee6-e3a6-4a38-be49-0846d50e3db1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:11.275528 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee7bac-3d5b-4ece-bada-60c781a724a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:11.276620 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee7bac-3d5b-4ece-bada-60c781a724a2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:11.277128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee7bac-3d5b-4ece-bada-60c781a724a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:11.277597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee7bac-3d5b-4ece-bada-60c781a724a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:11.278623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee7bac-3d5b-4ece-bada-60c781a724a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:11.279138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee7bac-3d5b-4ece-bada-60c781a724a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:11.280802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee7bac-3d5b-4ece-bada-60c781a724a2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:11.291309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 113/231] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:11.297279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c556fd-8bb1-4dd2-8ca8-7df2eb41b365 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:11.361633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:11.429575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c556fd-8bb1-4dd2-8ca8-7df2eb41b365 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:11.468334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bd1eb-ff44-4fa0-9620-990ad9dba545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:11.469258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bd1eb-ff44-4fa0-9620-990ad9dba545 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:11.469546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bd1eb-ff44-4fa0-9620-990ad9dba545 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:11.469824 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bd1eb-ff44-4fa0-9620-990ad9dba545 None admin] PATH_INFO: `/v3/users/36dd0bbc1d984a4d9a8b22fcfde451bd` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:11.473433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bd1eb-ff44-4fa0-9620-990ad9dba545 None admin] RBAC: Authorizing `identity:get_user(user_id=36dd0bbc1d984a4d9a8b22fcfde451bd)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:11.475090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bd1eb-ff44-4fa0-9620-990ad9dba545 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:11.476758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 119/232] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:11 2022] GET /identity/v3/users/36dd0bbc1d984a4d9a8b22fcfde451bd => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:11.482407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee7bac-3d5b-4ece-bada-60c781a724a2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:11.568424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:11.602867 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee7bac-3d5b-4ece-bada-60c781a724a2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:11.651777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa02fa-683f-483a-a81b-f37afbadfe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:11.652663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa02fa-683f-483a-a81b-f37afbadfe4a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:11.652977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa02fa-683f-483a-a81b-f37afbadfe4a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:11.653258 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa02fa-683f-483a-a81b-f37afbadfe4a None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:11.654479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa02fa-683f-483a-a81b-f37afbadfe4a None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:11.655943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa02fa-683f-483a-a81b-f37afbadfe4a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:11.658034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 114/233] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:11 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:11.665780 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bd1eb-ff44-4fa0-9620-990ad9dba545 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:11.801797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bd1eb-ff44-4fa0-9620-990ad9dba545 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:11.815907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:11.853001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56bb20-f47c-4e1a-ae78-c611571ceb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:11.853827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56bb20-f47c-4e1a-ae78-c611571ceb7f None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:11.854110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56bb20-f47c-4e1a-ae78-c611571ceb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:11.854387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56bb20-f47c-4e1a-ae78-c611571ceb7f None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8/users/36dd0bbc1d984a4d9a8b22fcfde451bd/roles/512083f4095a4f23a8dd4e8789fa20b3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:11.856666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56bb20-f47c-4e1a-ae78-c611571ceb7f None admin] RBAC: Authorizing `identity:create_grant(project_id=6252742811f240f8936cf0519e7401b8, user_id=36dd0bbc1d984a4d9a8b22fcfde451bd, role_id=512083f4095a4f23a8dd4e8789fa20b3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:11.858158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56bb20-f47c-4e1a-ae78-c611571ceb7f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:11.891271 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 120/234] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:18:11 2022] PUT /identity/v3/projects/6252742811f240f8936cf0519e7401b8/users/36dd0bbc1d984a4d9a8b22fcfde451bd/roles/512083f4095a4f23a8dd4e8789fa20b3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:18:12.530842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb0ae-f5fe-475d-a336-4480f448c534 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:12.531377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb0ae-f5fe-475d-a336-4480f448c534 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:12.531377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb0ae-f5fe-475d-a336-4480f448c534 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:12.532800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 115/235] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:12.538640 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699b6ab-53f3-4076-804d-4c711118e29b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:12.539073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699b6ab-53f3-4076-804d-4c711118e29b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:12.539252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699b6ab-53f3-4076-804d-4c711118e29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:12.561816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9699b6ab-53f3-4076-804d-4c711118e29b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:12.563032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9699b6ab-53f3-4076-804d-4c711118e29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:12.592264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d628-55ab-4567-9477-cbe77083f70b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:12.592557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d628-55ab-4567-9477-cbe77083f70b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:12.592852 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d628-55ab-4567-9477-cbe77083f70b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:12.594234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 116/236] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:12.602724 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5ba96-c191-4dd8-8ab4-a517d0e079a4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:12.603011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5ba96-c191-4dd8-8ab4-a517d0e079a4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:12.603294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5ba96-c191-4dd8-8ab4-a517d0e079a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:12.631036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-73c5ba96-c191-4dd8-8ab4-a517d0e079a4 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:12.632389 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-73c5ba96-c191-4dd8-8ab4-a517d0e079a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:12.685762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 121/237] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:12.727205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 117/238] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:18:12.729752 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699b6ab-53f3-4076-804d-4c711118e29b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:12.752583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5ba96-c191-4dd8-8ab4-a517d0e079a4 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:12.856670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699b6ab-53f3-4076-804d-4c711118e29b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:12.861062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:12.928608 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:12.964491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc98d80-960c-4380-8b3f-662428474ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:12.965333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc98d80-960c-4380-8b3f-662428474ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:12.965619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc98d80-960c-4380-8b3f-662428474ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:12.965900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc98d80-960c-4380-8b3f-662428474ad8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:12.968553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc98d80-960c-4380-8b3f-662428474ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:12.970084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc98d80-960c-4380-8b3f-662428474ad8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:12.983360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 122/239] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:12.986310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5ba96-c191-4dd8-8ab4-a517d0e079a4 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:12.997647 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc98d80-960c-4380-8b3f-662428474ad8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:13.067409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7df3a-8e09-46e6-a877-f573d41219b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:13.068253 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7df3a-8e09-46e6-a877-f573d41219b2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:13.068536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7df3a-8e09-46e6-a877-f573d41219b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:13.068827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7df3a-8e09-46e6-a877-f573d41219b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:13.097599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7df3a-8e09-46e6-a877-f573d41219b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-afe7df3a-8e09-46e6-a877-f573d41219b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:13.112825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:13.113721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:13.114554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:13.114554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:13.114554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:13.114554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:13.114554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:13.114554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:13.114554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:13.114554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:13.114554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:13.114554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:13.114554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:13.114554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:13.117529 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 118/240] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:13.123065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7df3a-8e09-46e6-a877-f573d41219b2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:13.134272 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc98d80-960c-4380-8b3f-662428474ad8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:13.171602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea64b0-3024-410a-a2e1-f4719e390c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:13.172424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea64b0-3024-410a-a2e1-f4719e390c19 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:13.172730 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea64b0-3024-410a-a2e1-f4719e390c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:13.173023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea64b0-3024-410a-a2e1-f4719e390c19 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:13.173752 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea64b0-3024-410a-a2e1-f4719e390c19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:13.175392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea64b0-3024-410a-a2e1-f4719e390c19 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:13.200128 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 123/241] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:18:12 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:18:13.331523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7df3a-8e09-46e6-a877-f573d41219b2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:13.379543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82eecb-4672-4c99-8ba8-c4e3eeaa3278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:13.380196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82eecb-4672-4c99-8ba8-c4e3eeaa3278 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:13.380485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82eecb-4672-4c99-8ba8-c4e3eeaa3278 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:13.380813 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82eecb-4672-4c99-8ba8-c4e3eeaa3278 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:13.381594 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82eecb-4672-4c99-8ba8-c4e3eeaa3278 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:13.381911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82eecb-4672-4c99-8ba8-c4e3eeaa3278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:13.383353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82eecb-4672-4c99-8ba8-c4e3eeaa3278 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:13.386121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:13.394501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 119/242] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:13.400010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea64b0-3024-410a-a2e1-f4719e390c19 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:13.433096 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:13.516365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea64b0-3024-410a-a2e1-f4719e390c19 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:13.557298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13f99a-aa69-4a22-844a-a24d6cb928d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:13.558353 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f99a-aa69-4a22-844a-a24d6cb928d3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:13.558642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f99a-aa69-4a22-844a-a24d6cb928d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:13.558922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f99a-aa69-4a22-844a-a24d6cb928d3 None admin] PATH_INFO: `/v3/users/d89c4bd107594447abe698664f208572` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:13.576577 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13f99a-aa69-4a22-844a-a24d6cb928d3 None admin] RBAC: Authorizing `identity:get_user(user_id=d89c4bd107594447abe698664f208572)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:13.578136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13f99a-aa69-4a22-844a-a24d6cb928d3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:13.580266 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 124/243] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:13 2022] GET /identity/v3/users/d89c4bd107594447abe698664f208572 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:13.585694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82eecb-4672-4c99-8ba8-c4e3eeaa3278 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:13.694927 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82eecb-4672-4c99-8ba8-c4e3eeaa3278 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:13.731956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b62198-419d-4298-ae36-2ed619236de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:13.732617 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b62198-419d-4298-ae36-2ed619236de1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:13.732954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b62198-419d-4298-ae36-2ed619236de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:13.733270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b62198-419d-4298-ae36-2ed619236de1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:13.760571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e531a0-400b-45b8-9a29-730908fb3398 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:13.760922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e531a0-400b-45b8-9a29-730908fb3398 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:13.761156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e531a0-400b-45b8-9a29-730908fb3398 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:13.763225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 125/244] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:18:13.775024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ab49c-adf3-433d-989a-cb67677e5aff None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:13.775345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ab49c-adf3-433d-989a-cb67677e5aff None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:13.775596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ab49c-adf3-433d-989a-cb67677e5aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:13.803612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-262ab49c-adf3-433d-989a-cb67677e5aff None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:13.805095 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-262ab49c-adf3-433d-989a-cb67677e5aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:13.819744 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:13.824482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b62198-419d-4298-ae36-2ed619236de1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:13.826303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b62198-419d-4298-ae36-2ed619236de1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:13.905024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 126/245] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:18:13.928060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ab49c-adf3-433d-989a-cb67677e5aff None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:13.944127 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:13.945311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 120/246] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:18:13.950064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b62198-419d-4298-ae36-2ed619236de1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:14.073759 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:14.078275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b62198-419d-4298-ae36-2ed619236de1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:14.082514 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ab49c-adf3-433d-989a-cb67677e5aff None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:14.119107 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a81b28-63d0-49e3-8f6a-4cd390ccb5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:14.120649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a81b28-63d0-49e3-8f6a-4cd390ccb5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:14.120969 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a81b28-63d0-49e3-8f6a-4cd390ccb5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:14.121536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a81b28-63d0-49e3-8f6a-4cd390ccb5c1 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:14.122768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a81b28-63d0-49e3-8f6a-4cd390ccb5c1 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:14.124224 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a81b28-63d0-49e3-8f6a-4cd390ccb5c1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:14.125820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a79cc-68bf-4266-bfa2-51b6117df32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:14.126457 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 121/247] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:13 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:14.126694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a79cc-68bf-4266-bfa2-51b6117df32b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:14.126899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a79cc-68bf-4266-bfa2-51b6117df32b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:14.127176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a79cc-68bf-4266-bfa2-51b6117df32b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:14.127738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3243f-f2f1-4875-b07f-f971f8e1b8f0 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:14.128028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3243f-f2f1-4875-b07f-f971f8e1b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:14.128307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3243f-f2f1-4875-b07f-f971f8e1b8f0 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:14.130844 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 122/248] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:14.133209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3243f-f2f1-4875-b07f-f971f8e1b8f0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:14.149834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a79cc-68bf-4266-bfa2-51b6117df32b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-706a79cc-68bf-4266-bfa2-51b6117df32b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:14.159785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:14.160681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:14.162683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:14.162683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:14.162683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:14.162683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:14.162683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:14.162683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:14.162683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:14.162683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:14.162683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:14.162683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:14.162683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:14.162683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:14.162683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 127/249] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:14.164279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d35b8-59f9-4124-a49a-87521b085405 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:14.164279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d35b8-59f9-4124-a49a-87521b085405 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:14.164279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d35b8-59f9-4124-a49a-87521b085405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:14.185024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c87d35b8-59f9-4124-a49a-87521b085405 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:14.186833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c87d35b8-59f9-4124-a49a-87521b085405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:14.257380 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3243f-f2f1-4875-b07f-f971f8e1b8f0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:14.280961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 128/250] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:14.282397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d35b8-59f9-4124-a49a-87521b085405 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:14.291104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:14.299459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b8d6d-8dae-4ef5-bd89-17007ba5fcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:14.300171 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8d6d-8dae-4ef5-bd89-17007ba5fcd0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:14.300452 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8d6d-8dae-4ef5-bd89-17007ba5fcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:14.300806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8d6d-8dae-4ef5-bd89-17007ba5fcd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:14.302203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b8d6d-8dae-4ef5-bd89-17007ba5fcd0 None admin] RBAC: Adding query filter params (role.id=d85cfbcde27e45afbe2c7ec009e1c0c7, scope.project.id=6252742811f240f8936cf0519e7401b8, user.id=d89c4bd107594447abe698664f208572) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:14.302684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b8d6d-8dae-4ef5-bd89-17007ba5fcd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:14.304186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b8d6d-8dae-4ef5-bd89-17007ba5fcd0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:14.310252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 123/251] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:14 2022] GET /identity/v3/role_assignments?user.id=d89c4bd107594447abe698664f208572&scope.project.id=6252742811f240f8936cf0519e7401b8&role.id=d85cfbcde27e45afbe2c7ec009e1c0c7 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:14.366187 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b8d6d-8dae-4ef5-bd89-17007ba5fcd0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:14.413991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d35b8-59f9-4124-a49a-87521b085405 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:14.423413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:14.473593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b55c85-46ec-4659-b3f6-7f8fade4c517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:14.475250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b55c85-46ec-4659-b3f6-7f8fade4c517 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:14.475770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b55c85-46ec-4659-b3f6-7f8fade4c517 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:14.476247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b55c85-46ec-4659-b3f6-7f8fade4c517 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:14.477275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b55c85-46ec-4659-b3f6-7f8fade4c517 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:14.477817 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b55c85-46ec-4659-b3f6-7f8fade4c517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:14.479453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b55c85-46ec-4659-b3f6-7f8fade4c517 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:14.493135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 129/252] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:14.499420 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b55c85-46ec-4659-b3f6-7f8fade4c517 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:14.516694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b8d6d-8dae-4ef5-bd89-17007ba5fcd0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:14.557957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552aca3-50b7-4f5c-a399-464258722b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:14.558780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552aca3-50b7-4f5c-a399-464258722b02 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:14.559063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552aca3-50b7-4f5c-a399-464258722b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:14.559346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552aca3-50b7-4f5c-a399-464258722b02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:14.571981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552aca3-50b7-4f5c-a399-464258722b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-6552aca3-50b7-4f5c-a399-464258722b02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:14.579936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:14.580981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:14.589945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:14.589945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:14.589945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:14.589945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:14.589945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:14.589945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:14.589945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:14.589945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:14.589945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:14.589945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:14.589945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:14.589945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:14.589945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 124/253] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:18:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:14.594113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552aca3-50b7-4f5c-a399-464258722b02 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:14.613718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:14.664775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b55c85-46ec-4659-b3f6-7f8fade4c517 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:14.701308 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37add34a-556a-4200-bed8-5562b82dede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:14.702258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37add34a-556a-4200-bed8-5562b82dede4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:14.702561 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37add34a-556a-4200-bed8-5562b82dede4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:14.702823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37add34a-556a-4200-bed8-5562b82dede4 None admin] PATH_INFO: `/v3/users/7c6ed56d6ce147f0b040c74aee8cfc70` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:14.705643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37add34a-556a-4200-bed8-5562b82dede4 None admin] RBAC: Authorizing `identity:get_user(user_id=7c6ed56d6ce147f0b040c74aee8cfc70)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:14.707169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37add34a-556a-4200-bed8-5562b82dede4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:14.709361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 130/254] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:14 2022] GET /identity/v3/users/7c6ed56d6ce147f0b040c74aee8cfc70 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:14.716418 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37add34a-556a-4200-bed8-5562b82dede4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:14.767526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:14.774769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552aca3-50b7-4f5c-a399-464258722b02 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:14.841106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5143be-1829-4eec-a899-37580f205403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:14.841800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5143be-1829-4eec-a899-37580f205403 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:14.842086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5143be-1829-4eec-a899-37580f205403 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:14.842366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5143be-1829-4eec-a899-37580f205403 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:14.843135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5143be-1829-4eec-a899-37580f205403 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:14.843451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5143be-1829-4eec-a899-37580f205403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:14.844857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5143be-1829-4eec-a899-37580f205403 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:14.852657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37add34a-556a-4200-bed8-5562b82dede4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:14.874731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 125/255] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:14.876057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6cedb-17c2-4489-ab49-e2b1c044463a None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:14.876347 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6cedb-17c2-4489-ab49-e2b1c044463a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:14.876628 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6cedb-17c2-4489-ab49-e2b1c044463a None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:14.878052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 126/256] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:14.886187 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f5ba8-f9d5-4f8b-ad99-3d1c4bcb395b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:14.886481 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f5ba8-f9d5-4f8b-ad99-3d1c4bcb395b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:14.886766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f5ba8-f9d5-4f8b-ad99-3d1c4bcb395b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:14.898223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:14.904990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df4753-cc1f-4755-858f-0b311b8bff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:14.905472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4753-cc1f-4755-858f-0b311b8bff97 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:14.905778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4753-cc1f-4755-858f-0b311b8bff97 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:14.906062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4753-cc1f-4755-858f-0b311b8bff97 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:14.907281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df4753-cc1f-4755-858f-0b311b8bff97 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:14.908783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df4753-cc1f-4755-858f-0b311b8bff97 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:14.915870 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 131/257] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:14 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:14.916790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df4753-cc1f-4755-858f-0b311b8bff97 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:14.928782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-849f5ba8-f9d5-4f8b-ad99-3d1c4bcb395b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:14.929993 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-849f5ba8-f9d5-4f8b-ad99-3d1c4bcb395b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:15.024016 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df4753-cc1f-4755-858f-0b311b8bff97 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:15.065138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e16f6-1e84-43a2-b732-da4eb59754da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:15.066028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e16f6-1e84-43a2-b732-da4eb59754da None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:15.066315 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e16f6-1e84-43a2-b732-da4eb59754da None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:15.066596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e16f6-1e84-43a2-b732-da4eb59754da None admin] PATH_INFO: `/v3/users/36dd0bbc1d984a4d9a8b22fcfde451bd` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:15.068393 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e16f6-1e84-43a2-b732-da4eb59754da None admin] RBAC: Authorizing `identity:get_user(user_id=36dd0bbc1d984a4d9a8b22fcfde451bd)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:15.070074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e16f6-1e84-43a2-b732-da4eb59754da None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:15.076221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 132/258] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:14 2022] GET /identity/v3/users/36dd0bbc1d984a4d9a8b22fcfde451bd => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:15.077090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e16f6-1e84-43a2-b732-da4eb59754da None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:15.080767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 127/259] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:15.081795 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f5ba8-f9d5-4f8b-ad99-3d1c4bcb395b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:15.190770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:15.195667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:15.226091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f5ba8-f9d5-4f8b-ad99-3d1c4bcb395b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:15.252772 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e16f6-1e84-43a2-b732-da4eb59754da None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:15.285321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d8048-0690-4d9e-a72c-b3e7f469849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:15.287187 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d8048-0690-4d9e-a72c-b3e7f469849b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:15.290303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d8048-0690-4d9e-a72c-b3e7f469849b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:15.290742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d8048-0690-4d9e-a72c-b3e7f469849b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:15.319448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbe802-99c4-4d77-9739-d21833b6f3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:15.320621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbe802-99c4-4d77-9739-d21833b6f3d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:15.321077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbe802-99c4-4d77-9739-d21833b6f3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:15.321564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbe802-99c4-4d77-9739-d21833b6f3d8 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8/users/7c6ed56d6ce147f0b040c74aee8cfc70/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:15.323880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbe802-99c4-4d77-9739-d21833b6f3d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6252742811f240f8936cf0519e7401b8, user_id=7c6ed56d6ce147f0b040c74aee8cfc70, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:15.325695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbe802-99c4-4d77-9739-d21833b6f3d8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:15.342593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 133/260] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:18:15 2022] PUT /identity/v3/projects/6252742811f240f8936cf0519e7401b8/users/7c6ed56d6ce147f0b040c74aee8cfc70/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:18:15.343893 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbe802-99c4-4d77-9739-d21833b6f3d8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:15.424833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d8048-0690-4d9e-a72c-b3e7f469849b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:15.426345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d8048-0690-4d9e-a72c-b3e7f469849b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:15.467001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbe802-99c4-4d77-9739-d21833b6f3d8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:15.505674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:15.526637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91553864-4087-4ecf-9f80-9d16d31d40c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:15.528503 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91553864-4087-4ecf-9f80-9d16d31d40c8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:15.529452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91553864-4087-4ecf-9f80-9d16d31d40c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:15.530202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91553864-4087-4ecf-9f80-9d16d31d40c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:15.545305 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91553864-4087-4ecf-9f80-9d16d31d40c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-91553864-4087-4ecf-9f80-9d16d31d40c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:15.554726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:15.555789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:15.556587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:15.556587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:15.556587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:15.556587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:15.556587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:15.556587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:15.556587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:15.556587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:15.556587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:15.556587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:15.556587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:15.556587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:15.559428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 134/261] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:18:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:15.565542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91553864-4087-4ecf-9f80-9d16d31d40c8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:15.566166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:15.601041 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 128/262] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:15.608654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d8048-0690-4d9e-a72c-b3e7f469849b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:15.691965 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91553864-4087-4ecf-9f80-9d16d31d40c8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:15.735055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bdab4-e3a9-417b-81ca-8dba832d6876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:15.736201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bdab4-e3a9-417b-81ca-8dba832d6876 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:15.736835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bdab4-e3a9-417b-81ca-8dba832d6876 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:15.737321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bdab4-e3a9-417b-81ca-8dba832d6876 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:15.738311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bdab4-e3a9-417b-81ca-8dba832d6876 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:15.738825 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bdab4-e3a9-417b-81ca-8dba832d6876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:15.740694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bdab4-e3a9-417b-81ca-8dba832d6876 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:15.750988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 135/263] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:15.757088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bdab4-e3a9-417b-81ca-8dba832d6876 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:15.757257 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d8048-0690-4d9e-a72c-b3e7f469849b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:15.814671 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da458c6-440c-4054-95e1-01f210811634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:15.815489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da458c6-440c-4054-95e1-01f210811634 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:15.815771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da458c6-440c-4054-95e1-01f210811634 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:15.816046 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da458c6-440c-4054-95e1-01f210811634 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:15.821689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da458c6-440c-4054-95e1-01f210811634 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:15.824558 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da458c6-440c-4054-95e1-01f210811634 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:15.826672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 129/264] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:15 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:15.827351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:15.832557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da458c6-440c-4054-95e1-01f210811634 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:15.888233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bdab4-e3a9-417b-81ca-8dba832d6876 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:15.911506 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:15.936614 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a098f-4553-4769-ba57-2d659a505d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:15.937534 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a098f-4553-4769-ba57-2d659a505d75 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:15.937812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a098f-4553-4769-ba57-2d659a505d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:15.938083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a098f-4553-4769-ba57-2d659a505d75 None admin] PATH_INFO: `/v3/users/36dd0bbc1d984a4d9a8b22fcfde451bd` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:15.940706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a098f-4553-4769-ba57-2d659a505d75 None admin] RBAC: Authorizing `identity:get_user(user_id=36dd0bbc1d984a4d9a8b22fcfde451bd)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:15.942203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a098f-4553-4769-ba57-2d659a505d75 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:15.945233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 136/265] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:15 2022] GET /identity/v3/users/36dd0bbc1d984a4d9a8b22fcfde451bd => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:15.953664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a098f-4553-4769-ba57-2d659a505d75 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:15.984331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da458c6-440c-4054-95e1-01f210811634 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:16.027610 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e379c6-5971-4614-b95b-6953850f1b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:16.029433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e379c6-5971-4614-b95b-6953850f1b5f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:16.031053 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e379c6-5971-4614-b95b-6953850f1b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:16.031500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e379c6-5971-4614-b95b-6953850f1b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:16.034834 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e379c6-5971-4614-b95b-6953850f1b5f None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=6252742811f240f8936cf0519e7401b8, user.id=36dd0bbc1d984a4d9a8b22fcfde451bd) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:16.035340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e379c6-5971-4614-b95b-6953850f1b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:16.037201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e379c6-5971-4614-b95b-6953850f1b5f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:16.050925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 130/266] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:15 2022] GET /identity/v3/role_assignments?user.id=36dd0bbc1d984a4d9a8b22fcfde451bd&scope.project.id=6252742811f240f8936cf0519e7401b8&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:16.122082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a098f-4553-4769-ba57-2d659a505d75 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:16.141439 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:16.166221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd93a6-e97a-4057-8cf4-21c4935f234d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:16.167153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd93a6-e97a-4057-8cf4-21c4935f234d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:16.167617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd93a6-e97a-4057-8cf4-21c4935f234d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:16.168046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd93a6-e97a-4057-8cf4-21c4935f234d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:16.251326 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd93a6-e97a-4057-8cf4-21c4935f234d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:16.253199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd93a6-e97a-4057-8cf4-21c4935f234d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:16.377109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 137/267] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:16.382663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e379c6-5971-4614-b95b-6953850f1b5f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:16.541279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e379c6-5971-4614-b95b-6953850f1b5f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:16.564535 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:16.588185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e2dce-4556-430d-affc-a520c533c83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:16.589465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e2dce-4556-430d-affc-a520c533c83e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:16.589983 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e2dce-4556-430d-affc-a520c533c83e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:16.590463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e2dce-4556-430d-affc-a520c533c83e None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:16.591885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e2dce-4556-430d-affc-a520c533c83e None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:16.593591 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e2dce-4556-430d-affc-a520c533c83e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:16.595551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 131/268] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:16 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:16.601649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd93a6-e97a-4057-8cf4-21c4935f234d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:16.625129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:16.728790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd93a6-e97a-4057-8cf4-21c4935f234d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:16.768025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dd0c1-ebaf-48fe-a786-b362228acbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:16.768694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dd0c1-ebaf-48fe-a786-b362228acbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:16.769004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dd0c1-ebaf-48fe-a786-b362228acbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:16.769288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dd0c1-ebaf-48fe-a786-b362228acbf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:16.770149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666dd0c1-ebaf-48fe-a786-b362228acbf7 None admin] RBAC: Adding query filter params (role.id=512083f4095a4f23a8dd4e8789fa20b3, scope.project.id=6252742811f240f8936cf0519e7401b8, user.id=36dd0bbc1d984a4d9a8b22fcfde451bd) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:16.770467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666dd0c1-ebaf-48fe-a786-b362228acbf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:16.772468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666dd0c1-ebaf-48fe-a786-b362228acbf7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:16.779221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 138/269] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:16 2022] GET /identity/v3/role_assignments?user.id=36dd0bbc1d984a4d9a8b22fcfde451bd&scope.project.id=6252742811f240f8936cf0519e7401b8&role.id=512083f4095a4f23a8dd4e8789fa20b3 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:16.866001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d6ad8-49b2-4e60-b10d-465f59d1801b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:16.866507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d6ad8-49b2-4e60-b10d-465f59d1801b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:16.866579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d6ad8-49b2-4e60-b10d-465f59d1801b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:16.868301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 132/270] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:16.874009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a062b6f-570a-4782-a47a-736fb85a6a58 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:16.874424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a062b6f-570a-4782-a47a-736fb85a6a58 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:16.874819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a062b6f-570a-4782-a47a-736fb85a6a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:16.894704 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6a062b6f-570a-4782-a47a-736fb85a6a58 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:16.896198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6a062b6f-570a-4782-a47a-736fb85a6a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:16.979446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 139/271] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:17.027850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d6ad8-49b2-4e60-b10d-465f59d1801b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:17.149161 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d6ad8-49b2-4e60-b10d-465f59d1801b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:17.187488 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f75c2-78cd-4c30-ae3c-34997833c3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:17.188354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f75c2-78cd-4c30-ae3c-34997833c3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:17.188643 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f75c2-78cd-4c30-ae3c-34997833c3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:17.189004 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f75c2-78cd-4c30-ae3c-34997833c3f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:17.200246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f75c2-78cd-4c30-ae3c-34997833c3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-a47f75c2-78cd-4c30-ae3c-34997833c3f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:17.208339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:17.209637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:17.210405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:17.210405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:17.210405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:17.210405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:17.210405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:17.210405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:17.210405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:17.210405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:17.210405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:17.210405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:17.210405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:17.210405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:17.210405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 133/272] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:17.216857 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a062b6f-570a-4782-a47a-736fb85a6a58 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:17.232834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:17.326063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a062b6f-570a-4782-a47a-736fb85a6a58 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:17.349230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98857b-3db9-4bee-9a52-75fc8e3141be None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:17.349515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98857b-3db9-4bee-9a52-75fc8e3141be None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:17.349915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98857b-3db9-4bee-9a52-75fc8e3141be None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:17.352040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 134/273] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:17.362737 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbbef5-93f3-4b14-8c91-cb1763ecf703 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:17.363261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbbef5-93f3-4b14-8c91-cb1763ecf703 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:17.366925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbbef5-93f3-4b14-8c91-cb1763ecf703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:17.377114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b1d1a-47a8-47bf-bbd3-1582310de308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:17.377788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b1d1a-47a8-47bf-bbd3-1582310de308 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:17.378069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b1d1a-47a8-47bf-bbd3-1582310de308 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:17.378340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b1d1a-47a8-47bf-bbd3-1582310de308 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:17.379557 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b1d1a-47a8-47bf-bbd3-1582310de308 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:17.379878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b1d1a-47a8-47bf-bbd3-1582310de308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:17.382062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b1d1a-47a8-47bf-bbd3-1582310de308 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:17.386036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f7bbbef5-93f3-4b14-8c91-cb1763ecf703 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:17.387462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f7bbbef5-93f3-4b14-8c91-cb1763ecf703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:17.391767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 140/274] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:17.397875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b1d1a-47a8-47bf-bbd3-1582310de308 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:17.439561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:17.485073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 135/275] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:17.493292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:17.516173 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbbef5-93f3-4b14-8c91-cb1763ecf703 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:17.529448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b1d1a-47a8-47bf-bbd3-1582310de308 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:17.572671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d72e66-5bbe-4271-ad07-339e3e8bf3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:17.573656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d72e66-5bbe-4271-ad07-339e3e8bf3ab None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:17.573938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d72e66-5bbe-4271-ad07-339e3e8bf3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:17.574213 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d72e66-5bbe-4271-ad07-339e3e8bf3ab None admin] PATH_INFO: `/v3/users/2219c34a7fe04d1b8863e006f2c9e73b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:17.591842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d72e66-5bbe-4271-ad07-339e3e8bf3ab None admin] RBAC: Authorizing `identity:get_user(user_id=2219c34a7fe04d1b8863e006f2c9e73b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:17.593428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d72e66-5bbe-4271-ad07-339e3e8bf3ab None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:17.595668 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 141/276] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:17 2022] GET /identity/v3/users/2219c34a7fe04d1b8863e006f2c9e73b => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:17.601763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d72e66-5bbe-4271-ad07-339e3e8bf3ab None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:17.631844 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbbef5-93f3-4b14-8c91-cb1763ecf703 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:17.670470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc830d-0d0d-4b82-b548-cbc4f60dd9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:17.671658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc830d-0d0d-4b82-b548-cbc4f60dd9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:17.672157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc830d-0d0d-4b82-b548-cbc4f60dd9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:17.672634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc830d-0d0d-4b82-b548-cbc4f60dd9d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:17.674154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc830d-0d0d-4b82-b548-cbc4f60dd9d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:17.675830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc830d-0d0d-4b82-b548-cbc4f60dd9d1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:17.682520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 136/277] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:17.683614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc830d-0d0d-4b82-b548-cbc4f60dd9d1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:17.715346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d72e66-5bbe-4271-ad07-339e3e8bf3ab None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:17.728370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:17.752753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:17.760708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8831e8-749e-46a9-af58-3a5a0a86b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:17.761404 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8831e8-749e-46a9-af58-3a5a0a86b12a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:17.761685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8831e8-749e-46a9-af58-3a5a0a86b12a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:17.761957 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8831e8-749e-46a9-af58-3a5a0a86b12a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:17.762792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8831e8-749e-46a9-af58-3a5a0a86b12a None admin] RBAC: Adding query filter params (role.id=c860ed9e0b784b18a457abd0ddb5f508, user.id=2219c34a7fe04d1b8863e006f2c9e73b, scope.system=all) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:17.763109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8831e8-749e-46a9-af58-3a5a0a86b12a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:17.764661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8831e8-749e-46a9-af58-3a5a0a86b12a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:17.771812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 142/278] 10.222.0.39 () {56 vars in 1308 bytes} [Thu May 26 12:18:17 2022] GET /identity/v3/role_assignments?user.id=2219c34a7fe04d1b8863e006f2c9e73b&scope.system=all&role.id=c860ed9e0b784b18a457abd0ddb5f508 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:17.773742 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86791ed1-8a51-483c-a178-1ca79204dc97 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:17.774148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86791ed1-8a51-483c-a178-1ca79204dc97 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:17.774715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86791ed1-8a51-483c-a178-1ca79204dc97 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:17.776634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 143/279] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:17.783167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f19f8-bf80-4f6f-a746-0fd589c9e931 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:17.783577 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f19f8-bf80-4f6f-a746-0fd589c9e931 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:17.784072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f19f8-bf80-4f6f-a746-0fd589c9e931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:17.796765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc830d-0d0d-4b82-b548-cbc4f60dd9d1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:17.806378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-df4f19f8-bf80-4f6f-a746-0fd589c9e931 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:17.807898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-df4f19f8-bf80-4f6f-a746-0fd589c9e931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:17.837507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76926e71-431e-41f0-aa34-0092dc2aba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:17.838203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76926e71-431e-41f0-aa34-0092dc2aba81 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:17.838493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76926e71-431e-41f0-aa34-0092dc2aba81 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:17.838774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76926e71-431e-41f0-aa34-0092dc2aba81 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:17.839516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76926e71-431e-41f0-aa34-0092dc2aba81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:17.841123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76926e71-431e-41f0-aa34-0092dc2aba81 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:17.866249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 137/280] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:18:17 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:18:17.911848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 144/281] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:17.935581 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76926e71-431e-41f0-aa34-0092dc2aba81 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:18.053731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:18.062715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76926e71-431e-41f0-aa34-0092dc2aba81 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:18.104300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2444d9d-5dfe-40a2-83c8-07551d261230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:18.105169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2444d9d-5dfe-40a2-83c8-07551d261230 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:18.105459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2444d9d-5dfe-40a2-83c8-07551d261230 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:18.105736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2444d9d-5dfe-40a2-83c8-07551d261230 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:18.118036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2444d9d-5dfe-40a2-83c8-07551d261230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-a2444d9d-5dfe-40a2-83c8-07551d261230 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:18.125937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:18.126839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:18.127626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:18.127626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:18.127626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:18.127626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:18.127626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:18.127626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:18.127626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:18.127626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:18.127626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:18.127626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:18.127626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:18.127626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:18.132200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 138/282] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:18.134352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f19f8-bf80-4f6f-a746-0fd589c9e931 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:18.252445 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f19f8-bf80-4f6f-a746-0fd589c9e931 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:18.282653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:18.288042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e778e65-7d50-4286-a0c9-e1530dd8ce35 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:18.288644 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e778e65-7d50-4286-a0c9-e1530dd8ce35 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:18.289169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e778e65-7d50-4286-a0c9-e1530dd8ce35 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:18.290762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 139/283] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:18:18.296324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a47cd9-ff0c-4c33-8306-4f6e7b7b8509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:18.297052 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a47cd9-ff0c-4c33-8306-4f6e7b7b8509 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:18.297338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a47cd9-ff0c-4c33-8306-4f6e7b7b8509 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:18.297613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a47cd9-ff0c-4c33-8306-4f6e7b7b8509 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:18.298378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a47cd9-ff0c-4c33-8306-4f6e7b7b8509 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:18.298686 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a47cd9-ff0c-4c33-8306-4f6e7b7b8509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:18.299035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec219-0197-4863-a26d-00c7e62301fd None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:18.299521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec219-0197-4863-a26d-00c7e62301fd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:18.299985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec219-0197-4863-a26d-00c7e62301fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:18.300084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a47cd9-ff0c-4c33-8306-4f6e7b7b8509 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:18.310455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 145/284] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:18.316828 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a47cd9-ff0c-4c33-8306-4f6e7b7b8509 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:18.326181 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-91aec219-0197-4863-a26d-00c7e62301fd None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:18.327389 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-91aec219-0197-4863-a26d-00c7e62301fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:18.439544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a47cd9-ff0c-4c33-8306-4f6e7b7b8509 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:18.456238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 140/285] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:18:18.488088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24246745-a91f-41bd-85de-11e66d9ab099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:18.489004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24246745-a91f-41bd-85de-11e66d9ab099 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:18.489319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24246745-a91f-41bd-85de-11e66d9ab099 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:18.489626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24246745-a91f-41bd-85de-11e66d9ab099 None admin] PATH_INFO: `/v3/users/d89c4bd107594447abe698664f208572` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:18.490838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24246745-a91f-41bd-85de-11e66d9ab099 None admin] RBAC: Authorizing `identity:get_user(user_id=d89c4bd107594447abe698664f208572)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:18.492408 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24246745-a91f-41bd-85de-11e66d9ab099 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:18.498528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 146/286] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:18 2022] GET /identity/v3/users/d89c4bd107594447abe698664f208572 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:18.499938 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec219-0197-4863-a26d-00c7e62301fd None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:18.518274 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24246745-a91f-41bd-85de-11e66d9ab099 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:18.625406 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:18.663947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:18.686519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec219-0197-4863-a26d-00c7e62301fd None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:18.706584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24246745-a91f-41bd-85de-11e66d9ab099 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:18.764838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3cc53-fa73-4ab2-8e71-3abd78cd79e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:18.765958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3cc53-fa73-4ab2-8e71-3abd78cd79e7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:18.766235 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3cc53-fa73-4ab2-8e71-3abd78cd79e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:18.766504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3cc53-fa73-4ab2-8e71-3abd78cd79e7 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:18.770049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3cc53-fa73-4ab2-8e71-3abd78cd79e7 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:18.772987 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3cc53-fa73-4ab2-8e71-3abd78cd79e7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:18.775177 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 141/287] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:18 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:18.777228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56346a7-ea1a-40cd-ad1c-c09bd3a63f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:18.778019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56346a7-ea1a-40cd-ad1c-c09bd3a63f0c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:18.778300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56346a7-ea1a-40cd-ad1c-c09bd3a63f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:18.778574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56346a7-ea1a-40cd-ad1c-c09bd3a63f0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:18.782929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3cc53-fa73-4ab2-8e71-3abd78cd79e7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:18.802752 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56346a7-ea1a-40cd-ad1c-c09bd3a63f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e56346a7-ea1a-40cd-ad1c-c09bd3a63f0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:18.814501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:18.815363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:18.816587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:18.816587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:18.816587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:18.816587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:18.816587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:18.816587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:18.816587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:18.816587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:18.816587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:18.816587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:18.816587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:18.816587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:18.816587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 147/288] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:18.822804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56346a7-ea1a-40cd-ad1c-c09bd3a63f0c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:18.944026 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56346a7-ea1a-40cd-ad1c-c09bd3a63f0c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:18.962183 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:18.983048 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe8616-a6e8-4e92-be4d-42206b0df134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:18.983959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe8616-a6e8-4e92-be4d-42206b0df134 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:18.984382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe8616-a6e8-4e92-be4d-42206b0df134 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:18.984824 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe8616-a6e8-4e92-be4d-42206b0df134 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:18.985844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe8616-a6e8-4e92-be4d-42206b0df134 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:18.986293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe8616-a6e8-4e92-be4d-42206b0df134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:18.987905 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe8616-a6e8-4e92-be4d-42206b0df134 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:18.995099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3cc53-fa73-4ab2-8e71-3abd78cd79e7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:18.998819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 148/289] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:19.004260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe8616-a6e8-4e92-be4d-42206b0df134 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:19.066068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7977bc-be86-4a8c-b0d5-316c75d2d787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:19.066960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7977bc-be86-4a8c-b0d5-316c75d2d787 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:19.067242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7977bc-be86-4a8c-b0d5-316c75d2d787 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:19.067735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7977bc-be86-4a8c-b0d5-316c75d2d787 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8/users/d89c4bd107594447abe698664f208572/roles/d85cfbcde27e45afbe2c7ec009e1c0c7` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:19.074128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7977bc-be86-4a8c-b0d5-316c75d2d787 None admin] RBAC: Authorizing `identity:create_grant(project_id=6252742811f240f8936cf0519e7401b8, user_id=d89c4bd107594447abe698664f208572, role_id=d85cfbcde27e45afbe2c7ec009e1c0c7)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:19.075675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7977bc-be86-4a8c-b0d5-316c75d2d787 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:19.113382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 142/290] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:18:18 2022] PUT /identity/v3/projects/6252742811f240f8936cf0519e7401b8/users/d89c4bd107594447abe698664f208572/roles/d85cfbcde27e45afbe2c7ec009e1c0c7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:18:19.120365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe8616-a6e8-4e92-be4d-42206b0df134 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:19.161982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791469b9-783e-44a8-b08a-c48684f9a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:19.163187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791469b9-783e-44a8-b08a-c48684f9a30f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:19.163657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791469b9-783e-44a8-b08a-c48684f9a30f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:19.164070 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791469b9-783e-44a8-b08a-c48684f9a30f None admin] PATH_INFO: `/v3/users/7c6ed56d6ce147f0b040c74aee8cfc70` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:19.165491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791469b9-783e-44a8-b08a-c48684f9a30f None admin] RBAC: Authorizing `identity:get_user(user_id=7c6ed56d6ce147f0b040c74aee8cfc70)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:19.167173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791469b9-783e-44a8-b08a-c48684f9a30f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:19.169177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 149/291] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:19 2022] GET /identity/v3/users/7c6ed56d6ce147f0b040c74aee8cfc70 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:19.186516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7977bc-be86-4a8c-b0d5-316c75d2d787 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:19.220519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:19.339985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7977bc-be86-4a8c-b0d5-316c75d2d787 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:19.393095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d671951-5a27-464c-bd4a-d3324fd5f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:19.393748 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d671951-5a27-464c-bd4a-d3324fd5f238 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:19.394028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d671951-5a27-464c-bd4a-d3324fd5f238 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:19.394303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d671951-5a27-464c-bd4a-d3324fd5f238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:19.472424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d671951-5a27-464c-bd4a-d3324fd5f238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:19.474510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d671951-5a27-464c-bd4a-d3324fd5f238 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:19.491066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:19.587515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 143/292] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:19.592618 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791469b9-783e-44a8-b08a-c48684f9a30f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:19.666007 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:19.740469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791469b9-783e-44a8-b08a-c48684f9a30f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:19.792152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39539058-394a-4022-9248-da48a1c76105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:19.793050 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39539058-394a-4022-9248-da48a1c76105 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:19.793334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39539058-394a-4022-9248-da48a1c76105 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:19.793608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39539058-394a-4022-9248-da48a1c76105 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:19.797410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39539058-394a-4022-9248-da48a1c76105 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:19.798876 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39539058-394a-4022-9248-da48a1c76105 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:19.800876 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 150/293] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:19 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:19.806931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d671951-5a27-464c-bd4a-d3324fd5f238 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:19.964378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d671951-5a27-464c-bd4a-d3324fd5f238 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:19.982402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:20.002634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ddbf4-8d97-4d50-a92d-cf1d37bad8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:20.003211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ddbf4-8d97-4d50-a92d-cf1d37bad8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:20.003494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ddbf4-8d97-4d50-a92d-cf1d37bad8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:20.003771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ddbf4-8d97-4d50-a92d-cf1d37bad8d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:20.004607 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ddbf4-8d97-4d50-a92d-cf1d37bad8d8 None admin] RBAC: Adding query filter params (role.id=c860ed9e0b784b18a457abd0ddb5f508, scope.project.id=6252742811f240f8936cf0519e7401b8, user.id=7c6ed56d6ce147f0b040c74aee8cfc70) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:20.005460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ddbf4-8d97-4d50-a92d-cf1d37bad8d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:20.007075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ddbf4-8d97-4d50-a92d-cf1d37bad8d8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:20.013330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 144/294] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:19 2022] GET /identity/v3/role_assignments?user.id=7c6ed56d6ce147f0b040c74aee8cfc70&scope.project.id=6252742811f240f8936cf0519e7401b8&role.id=c860ed9e0b784b18a457abd0ddb5f508 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:20.288217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaba322-4528-43e2-a857-d738853ae662 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:20.288733 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaba322-4528-43e2-a857-d738853ae662 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:20.289181 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaba322-4528-43e2-a857-d738853ae662 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:20.290987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 151/295] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:20.297143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59793cdc-c254-48a5-9408-ee512e60025d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:20.297440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59793cdc-c254-48a5-9408-ee512e60025d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:20.297707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59793cdc-c254-48a5-9408-ee512e60025d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:20.322780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-59793cdc-c254-48a5-9408-ee512e60025d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:20.324018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-59793cdc-c254-48a5-9408-ee512e60025d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:20.410295 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 145/296] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:20.437214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaba322-4528-43e2-a857-d738853ae662 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:20.572631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaba322-4528-43e2-a857-d738853ae662 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:20.590990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:20.623175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48d7c8-e545-49d0-8464-1e44dabf7b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:20.624359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48d7c8-e545-49d0-8464-1e44dabf7b99 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:20.624868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48d7c8-e545-49d0-8464-1e44dabf7b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:20.625342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48d7c8-e545-49d0-8464-1e44dabf7b99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:20.641129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48d7c8-e545-49d0-8464-1e44dabf7b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-eb48d7c8-e545-49d0-8464-1e44dabf7b99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:20.650325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:20.651310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:20.652121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:20.652121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:20.652121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:20.652121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:20.652121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:20.652121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:20.652121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:20.652121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:20.652121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:20.652121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:20.652121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:20.652121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:20.654767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 152/297] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:20.663176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59793cdc-c254-48a5-9408-ee512e60025d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:20.785247 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59793cdc-c254-48a5-9408-ee512e60025d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:20.796268 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:20.823554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a4104-e712-40d3-859b-3631cdc3cfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:20.824148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a4104-e712-40d3-859b-3631cdc3cfbc None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:20.824429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a4104-e712-40d3-859b-3631cdc3cfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:20.824704 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a4104-e712-40d3-859b-3631cdc3cfbc None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:20.825483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a4104-e712-40d3-859b-3631cdc3cfbc None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:20.825789 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a4104-e712-40d3-859b-3631cdc3cfbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:20.827165 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a4104-e712-40d3-859b-3631cdc3cfbc None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:20.835979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 146/298] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:20.842620 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd9f0e-9d00-4f53-9e98-eca4507a407f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:20.843093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a4104-e712-40d3-859b-3631cdc3cfbc None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:20.843673 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd9f0e-9d00-4f53-9e98-eca4507a407f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:20.844155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd9f0e-9d00-4f53-9e98-eca4507a407f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:20.846031 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 153/299] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:20.856700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3324-9b29-4fe2-893c-8aefcee48b97 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:20.857747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3324-9b29-4fe2-893c-8aefcee48b97 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:20.858533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a3324-9b29-4fe2-893c-8aefcee48b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:20.907606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-500a3324-9b29-4fe2-893c-8aefcee48b97 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:20.909081 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-500a3324-9b29-4fe2-893c-8aefcee48b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:20.984218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 154/300] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:18:20.991017 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891df526-77e3-4b37-8589-2e7d7c6a8f3b None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:20.991017 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891df526-77e3-4b37-8589-2e7d7c6a8f3b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:20.991017 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891df526-77e3-4b37-8589-2e7d7c6a8f3b None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:20.992486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 155/301] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:20.994161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066c36e-e525-445a-b283-c27d075c33f8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:20.994448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066c36e-e525-445a-b283-c27d075c33f8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:20.994728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066c36e-e525-445a-b283-c27d075c33f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:20.996425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a4104-e712-40d3-859b-3631cdc3cfbc None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:21.011896 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c066c36e-e525-445a-b283-c27d075c33f8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:21.013235 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c066c36e-e525-445a-b283-c27d075c33f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:21.035161 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a0e73-6e86-485f-9b15-849d84b85e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:21.036546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a0e73-6e86-485f-9b15-849d84b85e0d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:21.037000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a0e73-6e86-485f-9b15-849d84b85e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:21.037282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a0e73-6e86-485f-9b15-849d84b85e0d None admin] PATH_INFO: `/v3/users/2219c34a7fe04d1b8863e006f2c9e73b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:21.038505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a0e73-6e86-485f-9b15-849d84b85e0d None admin] RBAC: Authorizing `identity:get_user(user_id=2219c34a7fe04d1b8863e006f2c9e73b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:21.039965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a0e73-6e86-485f-9b15-849d84b85e0d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:21.041780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 147/302] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:20 2022] GET /identity/v3/users/2219c34a7fe04d1b8863e006f2c9e73b => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:21.046811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a0e73-6e86-485f-9b15-849d84b85e0d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:21.097941 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 156/303] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:21.099683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066c36e-e525-445a-b283-c27d075c33f8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:21.108290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:21.135351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:21.180647 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a0e73-6e86-485f-9b15-849d84b85e0d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:21.213986 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066c36e-e525-445a-b283-c27d075c33f8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:21.216738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3437ffa-998c-4181-9d18-f9b5d3fe0632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:21.217674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3437ffa-998c-4181-9d18-f9b5d3fe0632 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:21.218015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3437ffa-998c-4181-9d18-f9b5d3fe0632 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:21.218302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3437ffa-998c-4181-9d18-f9b5d3fe0632 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:21.219491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3437ffa-998c-4181-9d18-f9b5d3fe0632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:21.220961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3437ffa-998c-4181-9d18-f9b5d3fe0632 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:21.222749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 148/304] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:21.223482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3437ffa-998c-4181-9d18-f9b5d3fe0632 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:21.259700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d18ff-3d87-4378-ba6d-285e7ad5d592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:21.260743 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d18ff-3d87-4378-ba6d-285e7ad5d592 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:21.261821 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d18ff-3d87-4378-ba6d-285e7ad5d592 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:21.262146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d18ff-3d87-4378-ba6d-285e7ad5d592 None admin] PATH_INFO: `/v3/system/users/2219c34a7fe04d1b8863e006f2c9e73b/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:21.263640 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d18ff-3d87-4378-ba6d-285e7ad5d592 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2219c34a7fe04d1b8863e006f2c9e73b, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:21.265073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d18ff-3d87-4378-ba6d-285e7ad5d592 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:21.284747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 157/305] 10.222.0.39 () {58 vars in 1334 bytes} [Thu May 26 12:18:21 2022] PUT /identity/v3/system/users/2219c34a7fe04d1b8863e006f2c9e73b/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:18:21.284747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d18ff-3d87-4378-ba6d-285e7ad5d592 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:21.345945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3437ffa-998c-4181-9d18-f9b5d3fe0632 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:21.358681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:21.396966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a5c39-65af-423c-b832-d8f6e538e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:21.397822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a5c39-65af-423c-b832-d8f6e538e193 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:21.398156 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a5c39-65af-423c-b832-d8f6e538e193 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:21.398433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a5c39-65af-423c-b832-d8f6e538e193 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:21.411312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a5c39-65af-423c-b832-d8f6e538e193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-386a5c39-65af-423c-b832-d8f6e538e193 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:21.420254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:21.421234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:21.422097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:21.422097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:21.422097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:21.422097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:21.422097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:21.422097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:21.422097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:21.422097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:21.422097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:21.422097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:21.422097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:21.422097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:21.422097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 149/306] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:21.427631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:21.429607 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a5c39-65af-423c-b832-d8f6e538e193 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:21.431558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d18ff-3d87-4378-ba6d-285e7ad5d592 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:21.484172 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591f5aa-613c-4651-b822-5f4d19d2449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:21.484884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591f5aa-613c-4651-b822-5f4d19d2449c None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:21.485170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591f5aa-613c-4651-b822-5f4d19d2449c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:21.485447 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591f5aa-613c-4651-b822-5f4d19d2449c None admin] PATH_INFO: `/v3/groups` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:21.486144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591f5aa-613c-4651-b822-5f4d19d2449c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:21.487609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591f5aa-613c-4651-b822-5f4d19d2449c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:21.508435 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 158/307] 10.222.0.39 () {60 vars in 1134 bytes} [Thu May 26 12:18:21 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:18:21.566218 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a5c39-65af-423c-b832-d8f6e538e193 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:21.611506 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285bc313-0cb0-43d0-bef2-d99c994cb1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:21.612112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bc313-0cb0-43d0-bef2-d99c994cb1bb None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:21.612397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bc313-0cb0-43d0-bef2-d99c994cb1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:21.612678 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285bc313-0cb0-43d0-bef2-d99c994cb1bb None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:21.613496 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bc313-0cb0-43d0-bef2-d99c994cb1bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:21.613807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bc313-0cb0-43d0-bef2-d99c994cb1bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:21.615696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285bc313-0cb0-43d0-bef2-d99c994cb1bb None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:21.626486 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 150/308] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:21.632832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591f5aa-613c-4651-b822-5f4d19d2449c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:21.747099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591f5aa-613c-4651-b822-5f4d19d2449c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:21.776634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bd657-c9fd-41dc-aca4-6cf7d4897af8 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:21.778230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bd657-c9fd-41dc-aca4-6cf7d4897af8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:21.778660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bd657-c9fd-41dc-aca4-6cf7d4897af8 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:21.780173 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 151/309] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:18:21.789260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03ac03-68b4-4331-bb4e-5e0c6b5560f7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:21.790001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03ac03-68b4-4331-bb4e-5e0c6b5560f7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:21.790603 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03ac03-68b4-4331-bb4e-5e0c6b5560f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:21.791122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8fb04-647d-4a93-8d1a-b5b448ae7695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:21.792005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8fb04-647d-4a93-8d1a-b5b448ae7695 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:21.792287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8fb04-647d-4a93-8d1a-b5b448ae7695 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:21.792558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8fb04-647d-4a93-8d1a-b5b448ae7695 None admin] PATH_INFO: `/v3/users/9020f553898842f4920d2653ab0624d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:21.807193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8fb04-647d-4a93-8d1a-b5b448ae7695 None admin] RBAC: Authorizing `identity:get_user(user_id=9020f553898842f4920d2653ab0624d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:21.808668 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8fb04-647d-4a93-8d1a-b5b448ae7695 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:21.810565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 159/310] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:21 2022] GET /identity/v3/users/9020f553898842f4920d2653ab0624d4 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:21.816300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ff03ac03-68b4-4331-bb4e-5e0c6b5560f7 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:21.816459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8fb04-647d-4a93-8d1a-b5b448ae7695 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:21.818670 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ff03ac03-68b4-4331-bb4e-5e0c6b5560f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:21.836988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:21.859060 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:21.920850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 152/311] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:21.936902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03ac03-68b4-4331-bb4e-5e0c6b5560f7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:21.953887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8fb04-647d-4a93-8d1a-b5b448ae7695 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:21.999335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46660046-adde-4908-8553-a8af8adafacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:22.000482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46660046-adde-4908-8553-a8af8adafacb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:22.000936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46660046-adde-4908-8553-a8af8adafacb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:22.001597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46660046-adde-4908-8553-a8af8adafacb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:22.003041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46660046-adde-4908-8553-a8af8adafacb None admin] RBAC: Adding query filter params (role.id=d85cfbcde27e45afbe2c7ec009e1c0c7, user.id=9020f553898842f4920d2653ab0624d4, scope.system=all) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:22.003606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46660046-adde-4908-8553-a8af8adafacb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:22.005795 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46660046-adde-4908-8553-a8af8adafacb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:22.013346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 160/312] 10.222.0.39 () {56 vars in 1308 bytes} [Thu May 26 12:18:21 2022] GET /identity/v3/role_assignments?user.id=9020f553898842f4920d2653ab0624d4&scope.system=all&role.id=d85cfbcde27e45afbe2c7ec009e1c0c7 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:22.055151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03ac03-68b4-4331-bb4e-5e0c6b5560f7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:22.095563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f1bc2-bc39-4385-91e6-3d3b199555cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:22.096647 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1bc2-bc39-4385-91e6-3d3b199555cc None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:22.097209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1bc2-bc39-4385-91e6-3d3b199555cc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:22.097629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f1bc2-bc39-4385-91e6-3d3b199555cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:22.110366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f1bc2-bc39-4385-91e6-3d3b199555cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-227f1bc2-bc39-4385-91e6-3d3b199555cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:22.119259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:22.120418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:22.121439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:22.121439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:22.121439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:22.121439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:22.121439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:22.121439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:22.121439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:22.121439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:22.121439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:22.121439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:22.121439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:22.121439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:22.123918 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 153/313] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:22.129868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46660046-adde-4908-8553-a8af8adafacb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:22.221935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:22.244180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46660046-adde-4908-8553-a8af8adafacb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:22.280541 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d28842-c3c8-4fec-88d3-345fdc120fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:22.281614 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d28842-c3c8-4fec-88d3-345fdc120fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:22.282100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d28842-c3c8-4fec-88d3-345fdc120fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:22.282574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d28842-c3c8-4fec-88d3-345fdc120fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:22.283544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d28842-c3c8-4fec-88d3-345fdc120fb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:22.284053 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d28842-c3c8-4fec-88d3-345fdc120fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:22.285672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d28842-c3c8-4fec-88d3-345fdc120fb7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:22.295437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 161/314] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:22.301151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f1bc2-bc39-4385-91e6-3d3b199555cc None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:22.322924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:22.409293 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f1bc2-bc39-4385-91e6-3d3b199555cc None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:22.445175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb2a6f-e78c-478c-8bc9-1f3f73363343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:22.446389 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb2a6f-e78c-478c-8bc9-1f3f73363343 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:22.446875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb2a6f-e78c-478c-8bc9-1f3f73363343 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:22.447380 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb2a6f-e78c-478c-8bc9-1f3f73363343 None admin] PATH_INFO: `/v3/users/d89c4bd107594447abe698664f208572` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:22.448823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb2a6f-e78c-478c-8bc9-1f3f73363343 None admin] RBAC: Authorizing `identity:get_user(user_id=d89c4bd107594447abe698664f208572)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:22.450491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb2a6f-e78c-478c-8bc9-1f3f73363343 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:22.452344 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 154/315] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:22 2022] GET /identity/v3/users/d89c4bd107594447abe698664f208572 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:22.458333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d28842-c3c8-4fec-88d3-345fdc120fb7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:22.569875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d28842-c3c8-4fec-88d3-345fdc120fb7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:22.606175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30be77-85c6-41c8-8b44-6d85eeeb0b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:22.607197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30be77-85c6-41c8-8b44-6d85eeeb0b92 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:22.607683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30be77-85c6-41c8-8b44-6d85eeeb0b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:22.608161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30be77-85c6-41c8-8b44-6d85eeeb0b92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:22.625086 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:22.684670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30be77-85c6-41c8-8b44-6d85eeeb0b92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:22.686191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30be77-85c6-41c8-8b44-6d85eeeb0b92 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:22.791725 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 162/316] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:22.797244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb2a6f-e78c-478c-8bc9-1f3f73363343 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:22.890918 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:22.908291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb2a6f-e78c-478c-8bc9-1f3f73363343 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:22.945012 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e025126-23a6-4094-bdc6-702471176eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:22.945889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e025126-23a6-4094-bdc6-702471176eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:22.946175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e025126-23a6-4094-bdc6-702471176eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:22.946452 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e025126-23a6-4094-bdc6-702471176eb8 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:22.947656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e025126-23a6-4094-bdc6-702471176eb8 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:22.949117 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e025126-23a6-4094-bdc6-702471176eb8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:22.951129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 155/317] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:22 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:22.956618 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30be77-85c6-41c8-8b44-6d85eeeb0b92 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:23.001888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:23.060267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30be77-85c6-41c8-8b44-6d85eeeb0b92 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:23.095482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2b275-8fea-4780-a251-5adca9bad50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:23.096140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2b275-8fea-4780-a251-5adca9bad50a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:23.096423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2b275-8fea-4780-a251-5adca9bad50a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:23.096700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2b275-8fea-4780-a251-5adca9bad50a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:23.097555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2b275-8fea-4780-a251-5adca9bad50a None admin] RBAC: Adding query filter params (role.id=d85cfbcde27e45afbe2c7ec009e1c0c7, scope.project.id=6252742811f240f8936cf0519e7401b8, user.id=d89c4bd107594447abe698664f208572) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:23.097866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2b275-8fea-4780-a251-5adca9bad50a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:23.100204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2b275-8fea-4780-a251-5adca9bad50a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:23.106733 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 163/318] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:22 2022] GET /identity/v3/role_assignments?user.id=d89c4bd107594447abe698664f208572&scope.project.id=6252742811f240f8936cf0519e7401b8&role.id=d85cfbcde27e45afbe2c7ec009e1c0c7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:23.656977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da430aac-9013-4945-b4a4-bd50b378fde8 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:23.657530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da430aac-9013-4945-b4a4-bd50b378fde8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:23.657637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da430aac-9013-4945-b4a4-bd50b378fde8 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:23.659222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 156/319] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:23.664901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd43333-ff01-46d4-8490-1289d2697a4a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:23.665197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd43333-ff01-46d4-8490-1289d2697a4a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:23.665476 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd43333-ff01-46d4-8490-1289d2697a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:23.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fbd43333-ff01-46d4-8490-1289d2697a4a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:23.685323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fbd43333-ff01-46d4-8490-1289d2697a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:23.753828 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 164/320] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:23.778188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da430aac-9013-4945-b4a4-bd50b378fde8 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:23.848658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9be79f-9861-454b-bcd4-8626c3144471 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:23.848982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9be79f-9861-454b-bcd4-8626c3144471 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:23.849338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9be79f-9861-454b-bcd4-8626c3144471 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:23.850863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 165/321] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:23.855524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a983ea-97c9-44d7-b310-eeb341c54789 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:23.855809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a983ea-97c9-44d7-b310-eeb341c54789 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:23.856083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a983ea-97c9-44d7-b310-eeb341c54789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:23.873231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e3a983ea-97c9-44d7-b310-eeb341c54789 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:23.874407 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e3a983ea-97c9-44d7-b310-eeb341c54789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:23.895389 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da430aac-9013-4945-b4a4-bd50b378fde8 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:23.908670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:23.935243 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a218ab8-fe0f-41cb-a280-d01480b6e105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:23.936043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a218ab8-fe0f-41cb-a280-d01480b6e105 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:23.936328 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a218ab8-fe0f-41cb-a280-d01480b6e105 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:23.936610 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a218ab8-fe0f-41cb-a280-d01480b6e105 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:23.948106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a218ab8-fe0f-41cb-a280-d01480b6e105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-4a218ab8-fe0f-41cb-a280-d01480b6e105 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:23.955948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:23.956936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:23.961684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:23.961684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:23.961684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:23.961684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:23.961684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:23.961684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:23.961684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:23.961684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:23.961684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:23.961684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:23.961684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:23.961684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:23.962363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 166/322] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:18:23.962769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 157/323] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:23.964191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a983ea-97c9-44d7-b310-eeb341c54789 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:23.981017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a218ab8-fe0f-41cb-a280-d01480b6e105 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:23.998431 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:24.070948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a983ea-97c9-44d7-b310-eeb341c54789 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:24.093136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a218ab8-fe0f-41cb-a280-d01480b6e105 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:24.108101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8cd78a-aee4-4320-a442-21585fb63bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:24.108833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cd78a-aee4-4320-a442-21585fb63bac None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:24.109123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cd78a-aee4-4320-a442-21585fb63bac None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:24.109403 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8cd78a-aee4-4320-a442-21585fb63bac None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:24.110167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8cd78a-aee4-4320-a442-21585fb63bac None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:24.110482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8cd78a-aee4-4320-a442-21585fb63bac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:24.111877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8cd78a-aee4-4320-a442-21585fb63bac None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:24.120542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 167/324] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:24.125974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8cd78a-aee4-4320-a442-21585fb63bac None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:24.134616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4232d6-b605-4fe5-9e77-7db6324cd292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:24.135408 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4232d6-b605-4fe5-9e77-7db6324cd292 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:24.135690 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4232d6-b605-4fe5-9e77-7db6324cd292 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:24.135960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4232d6-b605-4fe5-9e77-7db6324cd292 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:24.137149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4232d6-b605-4fe5-9e77-7db6324cd292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:24.138582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4232d6-b605-4fe5-9e77-7db6324cd292 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:24.140177 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 158/325] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:24.146769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4232d6-b605-4fe5-9e77-7db6324cd292 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:24.157591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:24.237456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8cd78a-aee4-4320-a442-21585fb63bac None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:24.245945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:24.267589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4232d6-b605-4fe5-9e77-7db6324cd292 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:24.275191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81afd61-54d7-4c68-a5b6-4bc67ee87d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:24.276073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81afd61-54d7-4c68-a5b6-4bc67ee87d3c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:24.276357 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81afd61-54d7-4c68-a5b6-4bc67ee87d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:24.276628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81afd61-54d7-4c68-a5b6-4bc67ee87d3c None admin] PATH_INFO: `/v3/users/2219c34a7fe04d1b8863e006f2c9e73b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:24.277866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81afd61-54d7-4c68-a5b6-4bc67ee87d3c None admin] RBAC: Authorizing `identity:get_user(user_id=2219c34a7fe04d1b8863e006f2c9e73b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:24.279329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81afd61-54d7-4c68-a5b6-4bc67ee87d3c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:24.281338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 168/326] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:24 2022] GET /identity/v3/users/2219c34a7fe04d1b8863e006f2c9e73b => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:24.288645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81afd61-54d7-4c68-a5b6-4bc67ee87d3c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:24.308156 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c3e40-13fc-4f98-82f3-aaf94eda6d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:24.308864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c3e40-13fc-4f98-82f3-aaf94eda6d0c None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:24.309142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c3e40-13fc-4f98-82f3-aaf94eda6d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:24.309425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c3e40-13fc-4f98-82f3-aaf94eda6d0c None admin] PATH_INFO: `/v3/groups` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:24.310155 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c3e40-13fc-4f98-82f3-aaf94eda6d0c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:24.311585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c3e40-13fc-4f98-82f3-aaf94eda6d0c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:24.327513 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 159/327] 10.222.0.39 () {60 vars in 1134 bytes} [Thu May 26 12:18:24 2022] POST /identity/v3/groups => generated 226 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:18:24.365030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360531-6bf5-444d-9446-7e83aa705bee None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:24.365320 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360531-6bf5-444d-9446-7e83aa705bee None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:24.365602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360531-6bf5-444d-9446-7e83aa705bee None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:24.367021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 160/328] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:18:24.372971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c5dff-545d-4d05-bf84-cf9670eae177 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:24.373296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c5dff-545d-4d05-bf84-cf9670eae177 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:24.373555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c5dff-545d-4d05-bf84-cf9670eae177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:24.392322 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a79c5dff-545d-4d05-bf84-cf9670eae177 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:24.393779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a79c5dff-545d-4d05-bf84-cf9670eae177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:24.399785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:24.407770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81afd61-54d7-4c68-a5b6-4bc67ee87d3c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:24.447216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3f13b-d937-49cf-b153-00f756aa9139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:24.448369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3f13b-d937-49cf-b153-00f756aa9139 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:24.448926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3f13b-d937-49cf-b153-00f756aa9139 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:24.449550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3f13b-d937-49cf-b153-00f756aa9139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:24.450591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3f13b-d937-49cf-b153-00f756aa9139 None admin] RBAC: Adding query filter params (role.id=c860ed9e0b784b18a457abd0ddb5f508, user.id=2219c34a7fe04d1b8863e006f2c9e73b, scope.system=all) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:24.451133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3f13b-d937-49cf-b153-00f756aa9139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:24.452959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3f13b-d937-49cf-b153-00f756aa9139 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:24.476769 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 169/329] 10.222.0.39 () {56 vars in 1308 bytes} [Thu May 26 12:18:24 2022] GET /identity/v3/role_assignments?user.id=2219c34a7fe04d1b8863e006f2c9e73b&scope.system=all&role.id=c860ed9e0b784b18a457abd0ddb5f508 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:24.482524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 161/330] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:24.506703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3f13b-d937-49cf-b153-00f756aa9139 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:24.630522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3f13b-d937-49cf-b153-00f756aa9139 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:24.668555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8da4de-5f8b-470f-8bd0-cb16dede7777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:24.669394 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8da4de-5f8b-470f-8bd0-cb16dede7777 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:24.669678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8da4de-5f8b-470f-8bd0-cb16dede7777 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:24.669955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8da4de-5f8b-470f-8bd0-cb16dede7777 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:24.681827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8da4de-5f8b-470f-8bd0-cb16dede7777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-7a8da4de-5f8b-470f-8bd0-cb16dede7777 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:24.689587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:24.690488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:24.691270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:24.691270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:24.691270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:24.691270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:24.691270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:24.691270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:24.691270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:24.691270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:24.691270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:24.691270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:24.691270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:24.691270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:24.691270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 170/331] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:24.698597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c5dff-545d-4d05-bf84-cf9670eae177 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:24.782448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:24.815681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c5dff-545d-4d05-bf84-cf9670eae177 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:24.854324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa9454-0f5f-40e0-850d-79256686f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:24.855006 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa9454-0f5f-40e0-850d-79256686f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:24.855286 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa9454-0f5f-40e0-850d-79256686f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:24.855559 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa9454-0f5f-40e0-850d-79256686f8a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:24.856316 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa9454-0f5f-40e0-850d-79256686f8a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:24.856625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa9454-0f5f-40e0-850d-79256686f8a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:24.858041 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa9454-0f5f-40e0-850d-79256686f8a5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:24.869001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 162/332] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:24.874354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8da4de-5f8b-470f-8bd0-cb16dede7777 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:24.896921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:24.987646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8da4de-5f8b-470f-8bd0-cb16dede7777 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:25.024198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fb9b4-0510-4f73-9fe1-7189a603495e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:25.025111 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fb9b4-0510-4f73-9fe1-7189a603495e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:25.025395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fb9b4-0510-4f73-9fe1-7189a603495e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:25.025729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fb9b4-0510-4f73-9fe1-7189a603495e None admin] PATH_INFO: `/v3/users/9020f553898842f4920d2653ab0624d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:25.026989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fb9b4-0510-4f73-9fe1-7189a603495e None admin] RBAC: Authorizing `identity:get_user(user_id=9020f553898842f4920d2653ab0624d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:25.028466 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904fb9b4-0510-4f73-9fe1-7189a603495e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:25.030309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 171/333] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:24 2022] GET /identity/v3/users/9020f553898842f4920d2653ab0624d4 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:25.035689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa9454-0f5f-40e0-850d-79256686f8a5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:25.155282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa9454-0f5f-40e0-850d-79256686f8a5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:25.192356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549ae3b-4b33-419d-81b4-5c0bd7584a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:25.193305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ae3b-4b33-419d-81b4-5c0bd7584a55 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:25.193638 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ae3b-4b33-419d-81b4-5c0bd7584a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:25.193924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ae3b-4b33-419d-81b4-5c0bd7584a55 None admin] PATH_INFO: `/v3/system/users/9020f553898842f4920d2653ab0624d4/roles/d85cfbcde27e45afbe2c7ec009e1c0c7` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:25.195437 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549ae3b-4b33-419d-81b4-5c0bd7584a55 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9020f553898842f4920d2653ab0624d4, role_id=d85cfbcde27e45afbe2c7ec009e1c0c7)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:25.196868 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549ae3b-4b33-419d-81b4-5c0bd7584a55 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:25.198473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:25.212729 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 163/334] 10.222.0.39 () {58 vars in 1334 bytes} [Thu May 26 12:18:25 2022] PUT /identity/v3/system/users/9020f553898842f4920d2653ab0624d4/roles/d85cfbcde27e45afbe2c7ec009e1c0c7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:18:26.860645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e03b7-a436-478e-a168-43dca1c6fd93 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:26.861628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e03b7-a436-478e-a168-43dca1c6fd93 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:26.862135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e03b7-a436-478e-a168-43dca1c6fd93 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:26.863711 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 172/335] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:26.870255 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c66317-1036-44c3-9bfc-0cbc52a525cf None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:26.871134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c66317-1036-44c3-9bfc-0cbc52a525cf None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:26.871608 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c66317-1036-44c3-9bfc-0cbc52a525cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:26.902117 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-53c66317-1036-44c3-9bfc-0cbc52a525cf None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:26.903313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-53c66317-1036-44c3-9bfc-0cbc52a525cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:26.989826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 164/336] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:27.030711 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e03b7-a436-478e-a168-43dca1c6fd93 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:27.139885 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:27.173960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e03b7-a436-478e-a168-43dca1c6fd93 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:27.220226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6150ff-db95-4b7b-8f2c-a870801ed37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:27.221470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6150ff-db95-4b7b-8f2c-a870801ed37b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:27.221959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6150ff-db95-4b7b-8f2c-a870801ed37b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:27.222447 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6150ff-db95-4b7b-8f2c-a870801ed37b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:27.246002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6150ff-db95-4b7b-8f2c-a870801ed37b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-4d6150ff-db95-4b7b-8f2c-a870801ed37b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:27.254343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:27.255256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:27.256055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:27.256055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:27.256055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:27.256055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:27.256055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:27.256055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:27.256055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:27.256055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:27.256055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:27.256055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:27.256055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:27.256055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:27.262848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 173/337] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:27.273851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c66317-1036-44c3-9bfc-0cbc52a525cf None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:27.409672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c66317-1036-44c3-9bfc-0cbc52a525cf None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:27.443142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:27.452861 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba81f9-e183-4c92-9d44-7158cd1e93cb None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:27.453359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba81f9-e183-4c92-9d44-7158cd1e93cb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:27.453960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba81f9-e183-4c92-9d44-7158cd1e93cb None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:27.455770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 174/338] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:18:27.458635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75eb2f-2e15-4c71-a520-4ac00d2bc3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:27.459875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75eb2f-2e15-4c71-a520-4ac00d2bc3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:27.463175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab55f3-aecd-4253-ae58-dd20f26e488f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:27.463815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab55f3-aecd-4253-ae58-dd20f26e488f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:27.464295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab55f3-aecd-4253-ae58-dd20f26e488f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:27.465239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75eb2f-2e15-4c71-a520-4ac00d2bc3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:27.465534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75eb2f-2e15-4c71-a520-4ac00d2bc3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:27.466383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75eb2f-2e15-4c71-a520-4ac00d2bc3c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:27.466707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75eb2f-2e15-4c71-a520-4ac00d2bc3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:27.468755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75eb2f-2e15-4c71-a520-4ac00d2bc3c2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:27.479315 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 165/339] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:27.494270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75eb2f-2e15-4c71-a520-4ac00d2bc3c2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:27.501720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-65ab55f3-aecd-4253-ae58-dd20f26e488f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:27.503150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-65ab55f3-aecd-4253-ae58-dd20f26e488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:27.657800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 175/340] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:18:27.687587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75eb2f-2e15-4c71-a520-4ac00d2bc3c2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:27.722596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab55f3-aecd-4253-ae58-dd20f26e488f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:27.732739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d2460-7797-4f7e-aa86-a26a1a4a68fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:27.732739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2460-7797-4f7e-aa86-a26a1a4a68fa None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:27.732739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2460-7797-4f7e-aa86-a26a1a4a68fa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:27.732739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d2460-7797-4f7e-aa86-a26a1a4a68fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:27.800658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:27.815000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d2460-7797-4f7e-aa86-a26a1a4a68fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:27.816683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d2460-7797-4f7e-aa86-a26a1a4a68fa None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:27.907751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:27.948053 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 166/341] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:27.950286 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81563f-392c-47fb-84fb-70aeb4c8230f None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:27.950759 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81563f-392c-47fb-84fb-70aeb4c8230f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:27.951486 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81563f-392c-47fb-84fb-70aeb4c8230f None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:27.953697 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 167/342] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:27.957618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81563f-392c-47fb-84fb-70aeb4c8230f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:27.994930 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab55f3-aecd-4253-ae58-dd20f26e488f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:28.074006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c904f2-951e-47ae-8542-3ec5f3aede5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:28.074938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c904f2-951e-47ae-8542-3ec5f3aede5f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:28.075287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c904f2-951e-47ae-8542-3ec5f3aede5f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:28.075642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c904f2-951e-47ae-8542-3ec5f3aede5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:28.076853 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:28.081699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81563f-392c-47fb-84fb-70aeb4c8230f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:28.101450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c904f2-951e-47ae-8542-3ec5f3aede5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-52c904f2-951e-47ae-8542-3ec5f3aede5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:28.115511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:28.116431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:28.117282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:28.117282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:28.117282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:28.117282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:28.117282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:28.117282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:28.117282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:28.117282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:28.117282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:28.117282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:28.117282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:28.117282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:28.121631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 176/343] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:18:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:28.123803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47a43b-af08-4d05-9fe4-a88a2000240e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:28.126984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47a43b-af08-4d05-9fe4-a88a2000240e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:28.127417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47a43b-af08-4d05-9fe4-a88a2000240e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:28.161598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c9031-14a9-4ea5-9d30-2a9b382decaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:28.162804 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c9031-14a9-4ea5-9d30-2a9b382decaf None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:28.163230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c9031-14a9-4ea5-9d30-2a9b382decaf None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:28.164063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c9031-14a9-4ea5-9d30-2a9b382decaf None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:28.166547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c9031-14a9-4ea5-9d30-2a9b382decaf None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:28.168959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c9031-14a9-4ea5-9d30-2a9b382decaf None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:28.169485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-eb47a43b-af08-4d05-9fe4-a88a2000240e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:28.170862 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-eb47a43b-af08-4d05-9fe4-a88a2000240e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:28.172813 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 168/344] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:27 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:28.175772 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c9031-14a9-4ea5-9d30-2a9b382decaf None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:28.308972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 177/345] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:28.312699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47a43b-af08-4d05-9fe4-a88a2000240e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:28.401585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c9031-14a9-4ea5-9d30-2a9b382decaf None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:28.465161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:28.490216 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa07e85-a485-4789-b9a8-300c0301fb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:28.491143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa07e85-a485-4789-b9a8-300c0301fb68 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:28.491571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa07e85-a485-4789-b9a8-300c0301fb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:28.492023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa07e85-a485-4789-b9a8-300c0301fb68 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:28.493074 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa07e85-a485-4789-b9a8-300c0301fb68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:28.493530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa07e85-a485-4789-b9a8-300c0301fb68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:28.495677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa07e85-a485-4789-b9a8-300c0301fb68 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:28.506512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 169/346] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:28.507577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa07e85-a485-4789-b9a8-300c0301fb68 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:28.541976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:28.547670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47a43b-af08-4d05-9fe4-a88a2000240e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:28.624263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb509e8-37bb-4fb4-bdbf-b3d51a2175b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:28.625100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb509e8-37bb-4fb4-bdbf-b3d51a2175b7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:28.625388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb509e8-37bb-4fb4-bdbf-b3d51a2175b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:28.625671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb509e8-37bb-4fb4-bdbf-b3d51a2175b7 None admin] PATH_INFO: `/v3/groups/48bd262a9f53459dac117dc8de9dce6b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:28.637317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb509e8-37bb-4fb4-bdbf-b3d51a2175b7 None admin] RBAC: Authorizing `identity:get_group(group_id=48bd262a9f53459dac117dc8de9dce6b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:28.638807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb509e8-37bb-4fb4-bdbf-b3d51a2175b7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:28.644872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 178/347] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:28 2022] GET /identity/v3/groups/48bd262a9f53459dac117dc8de9dce6b => generated 226 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:28.647333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb509e8-37bb-4fb4-bdbf-b3d51a2175b7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:28.651971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa07e85-a485-4789-b9a8-300c0301fb68 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:28.730581 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf8185-80ed-4a86-96f9-1a7052ff4af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:28.737520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf8185-80ed-4a86-96f9-1a7052ff4af9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:28.738043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf8185-80ed-4a86-96f9-1a7052ff4af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:28.738540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf8185-80ed-4a86-96f9-1a7052ff4af9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:28.763399 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf8185-80ed-4a86-96f9-1a7052ff4af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-86cf8185-80ed-4a86-96f9-1a7052ff4af9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:28.781388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:28.782624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:28.783622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:28.783622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:28.783622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:28.783622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:28.783622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:28.783622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:28.783622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:28.783622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:28.783622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:28.783622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:28.783622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:28.783622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:28.790034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 170/348] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:28.791194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf8185-80ed-4a86-96f9-1a7052ff4af9 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:28.864354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb509e8-37bb-4fb4-bdbf-b3d51a2175b7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:28.907745 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:28.922508 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbb28e-d597-4434-bf8a-fe6fddf89fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:28.923941 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb28e-d597-4434-bf8a-fe6fddf89fce None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:28.924226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb28e-d597-4434-bf8a-fe6fddf89fce None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:28.924507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb28e-d597-4434-bf8a-fe6fddf89fce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:28.956845 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:28.984740 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf8185-80ed-4a86-96f9-1a7052ff4af9 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:29.005378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbb28e-d597-4434-bf8a-fe6fddf89fce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:29.006875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbb28e-d597-4434-bf8a-fe6fddf89fce None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:29.027196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba3cdc-8723-47c7-80b4-c7542e7f789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:29.027873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3cdc-8723-47c7-80b4-c7542e7f789a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:29.028622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3cdc-8723-47c7-80b4-c7542e7f789a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:29.028622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba3cdc-8723-47c7-80b4-c7542e7f789a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:29.029302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba3cdc-8723-47c7-80b4-c7542e7f789a None admin] RBAC: Adding query filter params (group.id=48bd262a9f53459dac117dc8de9dce6b, role.id=c860ed9e0b784b18a457abd0ddb5f508, scope.project.id=7cc93986f17a48809b5e9aa58ea66925) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:29.029617 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba3cdc-8723-47c7-80b4-c7542e7f789a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:29.031575 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba3cdc-8723-47c7-80b4-c7542e7f789a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:29.037454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 171/349] 10.222.0.39 () {56 vars in 1376 bytes} [Thu May 26 12:18:28 2022] GET /identity/v3/role_assignments?group.id=48bd262a9f53459dac117dc8de9dce6b&scope.project.id=7cc93986f17a48809b5e9aa58ea66925&role.id=c860ed9e0b784b18a457abd0ddb5f508 => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:29.038279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba3cdc-8723-47c7-80b4-c7542e7f789a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:29.149756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 179/350] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:29.151368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41234bd8-064c-40f0-a498-51ba82bbb1b3 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:29.151669 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41234bd8-064c-40f0-a498-51ba82bbb1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:29.151949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41234bd8-064c-40f0-a498-51ba82bbb1b3 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:29.154701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 180/351] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:29.155832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9003bc-aea6-4fb6-b9a2-680d0087f439 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:29.156120 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9003bc-aea6-4fb6-b9a2-680d0087f439 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:29.156400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9003bc-aea6-4fb6-b9a2-680d0087f439 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:29.157995 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 181/352] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:29.158884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c190b1-6650-48dd-8330-ef2353629382 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:29.159171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c190b1-6650-48dd-8330-ef2353629382 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:29.159448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c190b1-6650-48dd-8330-ef2353629382 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:29.164891 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 182/353] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:29.166526 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c190b1-6650-48dd-8330-ef2353629382 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:29.189596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba3cdc-8723-47c7-80b4-c7542e7f789a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:29.207220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:29.229151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c741c-ec82-4c07-831d-b19f9a918c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:29.229850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c741c-ec82-4c07-831d-b19f9a918c93 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:29.230384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c741c-ec82-4c07-831d-b19f9a918c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:29.230384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c741c-ec82-4c07-831d-b19f9a918c93 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:29.231179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c741c-ec82-4c07-831d-b19f9a918c93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:29.231492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c741c-ec82-4c07-831d-b19f9a918c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:29.232924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c741c-ec82-4c07-831d-b19f9a918c93 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:29.243089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 172/354] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:29.244434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34660185-cd23-457c-b972-2dc0722acae6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:29.244740 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34660185-cd23-457c-b972-2dc0722acae6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:29.245034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34660185-cd23-457c-b972-2dc0722acae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:29.258667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:29.264362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-34660185-cd23-457c-b972-2dc0722acae6 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:29.265852 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-34660185-cd23-457c-b972-2dc0722acae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:29.298506 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c190b1-6650-48dd-8330-ef2353629382 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:29.348109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b698b-80ff-45e5-8e3c-68c9fbe024b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:29.349077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b698b-80ff-45e5-8e3c-68c9fbe024b4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:29.349452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b698b-80ff-45e5-8e3c-68c9fbe024b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:29.349740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b698b-80ff-45e5-8e3c-68c9fbe024b4 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:29.351172 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b698b-80ff-45e5-8e3c-68c9fbe024b4 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:29.352783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b698b-80ff-45e5-8e3c-68c9fbe024b4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:29.354660 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 183/355] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:29 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:29.356502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9e41-512f-4ca6-aac6-90067cf90409 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:29.356502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9e41-512f-4ca6-aac6-90067cf90409 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:29.356687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 173/356] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:29.357782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f236e-644d-41b3-9f25-6b45486729cc None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:29.358069 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f236e-644d-41b3-9f25-6b45486729cc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:29.358345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f236e-644d-41b3-9f25-6b45486729cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:29.360916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9e41-512f-4ca6-aac6-90067cf90409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:29.383545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-694f236e-644d-41b3-9f25-6b45486729cc None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:29.384462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ac8e9e41-512f-4ca6-aac6-90067cf90409 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:29.384745 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-694f236e-644d-41b3-9f25-6b45486729cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:29.386145 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ac8e9e41-512f-4ca6-aac6-90067cf90409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:29.471187 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 174/357] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:29.472233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f236e-644d-41b3-9f25-6b45486729cc None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:29.474248 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 184/358] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:29.475474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9e41-512f-4ca6-aac6-90067cf90409 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:29.501184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:29.560693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:29.603130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f236e-644d-41b3-9f25-6b45486729cc None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:29.605042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9e41-512f-4ca6-aac6-90067cf90409 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:29.653834 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254171f-732e-43fc-82d8-fee2650819b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:29.654498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254171f-732e-43fc-82d8-fee2650819b4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:29.655225 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254171f-732e-43fc-82d8-fee2650819b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:29.655225 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254171f-732e-43fc-82d8-fee2650819b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:29.656124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae1ef4-2530-43d5-8d44-5c9689f6045f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:29.657250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae1ef4-2530-43d5-8d44-5c9689f6045f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:29.657714 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae1ef4-2530-43d5-8d44-5c9689f6045f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:29.658301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae1ef4-2530-43d5-8d44-5c9689f6045f None admin] PATH_INFO: `/v3/groups/48bd262a9f53459dac117dc8de9dce6b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:29.659702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae1ef4-2530-43d5-8d44-5c9689f6045f None admin] RBAC: Authorizing `identity:get_group(group_id=48bd262a9f53459dac117dc8de9dce6b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:29.661547 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae1ef4-2530-43d5-8d44-5c9689f6045f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:29.663228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 185/359] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:29 2022] GET /identity/v3/groups/48bd262a9f53459dac117dc8de9dce6b => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:29.664010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae1ef4-2530-43d5-8d44-5c9689f6045f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:29.749121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254171f-732e-43fc-82d8-fee2650819b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:29.751004 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254171f-732e-43fc-82d8-fee2650819b4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:29.788644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:29.796199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae1ef4-2530-43d5-8d44-5c9689f6045f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:29.836364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:29.843001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57288212-590d-46a6-8b33-acf77e5fcb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:29.843811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57288212-590d-46a6-8b33-acf77e5fcb32 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:29.844106 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57288212-590d-46a6-8b33-acf77e5fcb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:29.844384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57288212-590d-46a6-8b33-acf77e5fcb32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:29.858882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57288212-590d-46a6-8b33-acf77e5fcb32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-57288212-590d-46a6-8b33-acf77e5fcb32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:29.871750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:29.872901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 186/360] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:18:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:29.873844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57288212-590d-46a6-8b33-acf77e5fcb32 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:29.898655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 175/361] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:29.899906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254171f-732e-43fc-82d8-fee2650819b4 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:30.009776 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57288212-590d-46a6-8b33-acf77e5fcb32 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:30.033732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254171f-732e-43fc-82d8-fee2650819b4 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:30.062355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eb77e-e0f2-4e66-866b-e703aad86be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:30.062571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eb77e-e0f2-4e66-866b-e703aad86be9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:30.063154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eb77e-e0f2-4e66-866b-e703aad86be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:30.063443 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48eb77e-e0f2-4e66-866b-e703aad86be9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:30.074508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d87d47-4749-45bb-9a93-990406e736eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:30.075307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d87d47-4749-45bb-9a93-990406e736eb None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:30.076198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d87d47-4749-45bb-9a93-990406e736eb None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:30.076198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d87d47-4749-45bb-9a93-990406e736eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:30.079482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48eb77e-e0f2-4e66-866b-e703aad86be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c48eb77e-e0f2-4e66-866b-e703aad86be9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:30.091329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:30.092586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 187/362] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:18:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:30.093455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eb77e-e0f2-4e66-866b-e703aad86be9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:30.098106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d87d47-4749-45bb-9a93-990406e736eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-a9d87d47-4749-45bb-9a93-990406e736eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:30.108543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:30.109497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:30.110723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:30.110723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:30.110723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:30.110723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:30.110723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:30.110723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:30.110723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:30.110723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:30.110723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:30.110723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:30.110723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:18:30.110723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:30.110723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 176/363] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:30.111564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:30.111644 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d87d47-4749-45bb-9a93-990406e736eb None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:30.149748 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:30.233268 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48eb77e-e0f2-4e66-866b-e703aad86be9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:30.254627 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d87d47-4749-45bb-9a93-990406e736eb None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:30.276268 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646adc8-e552-4c9b-ac14-883b4ea5faea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:30.279735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646adc8-e552-4c9b-ac14-883b4ea5faea None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:30.279735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646adc8-e552-4c9b-ac14-883b4ea5faea None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:30.279735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646adc8-e552-4c9b-ac14-883b4ea5faea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:30.279735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646adc8-e552-4c9b-ac14-883b4ea5faea None admin] RBAC: Adding query filter params (group.id=48bd262a9f53459dac117dc8de9dce6b, role.id=512083f4095a4f23a8dd4e8789fa20b3, scope.project.id=7cc93986f17a48809b5e9aa58ea66925) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:30.279735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646adc8-e552-4c9b-ac14-883b4ea5faea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:30.283230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646adc8-e552-4c9b-ac14-883b4ea5faea None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:30.289713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 188/364] 10.222.0.39 () {56 vars in 1376 bytes} [Thu May 26 12:18:30 2022] GET /identity/v3/role_assignments?group.id=48bd262a9f53459dac117dc8de9dce6b&scope.project.id=7cc93986f17a48809b5e9aa58ea66925&role.id=512083f4095a4f23a8dd4e8789fa20b3 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:30.290848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646adc8-e552-4c9b-ac14-883b4ea5faea None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:30.298626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6affb-d189-47aa-9186-696674df2689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:30.299321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6affb-d189-47aa-9186-696674df2689 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:30.299616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6affb-d189-47aa-9186-696674df2689 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:30.299933 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6affb-d189-47aa-9186-696674df2689 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:30.300668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6affb-d189-47aa-9186-696674df2689 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:30.301039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6affb-d189-47aa-9186-696674df2689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:30.303086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6affb-d189-47aa-9186-696674df2689 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:30.313551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 177/365] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:30.314422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6affb-d189-47aa-9186-696674df2689 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:30.400325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:30.428608 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:30.440332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646adc8-e552-4c9b-ac14-883b4ea5faea None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:30.445776 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6affb-d189-47aa-9186-696674df2689 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:30.493243 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781fd7e-8deb-4388-8341-079f46ca6868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:30.494161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781fd7e-8deb-4388-8341-079f46ca6868 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:30.494443 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781fd7e-8deb-4388-8341-079f46ca6868 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:30.494719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781fd7e-8deb-4388-8341-079f46ca6868 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:30.496084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781fd7e-8deb-4388-8341-079f46ca6868 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:30.496780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1d975-fd62-48c3-b109-71eeff919284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:30.497601 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781fd7e-8deb-4388-8341-079f46ca6868 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:30.497924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1d975-fd62-48c3-b109-71eeff919284 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:30.498409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1d975-fd62-48c3-b109-71eeff919284 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:30.498888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1d975-fd62-48c3-b109-71eeff919284 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:30.499346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 189/366] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:30 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:30.500107 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1d975-fd62-48c3-b109-71eeff919284 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:30.500212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781fd7e-8deb-4388-8341-079f46ca6868 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:30.500742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1d975-fd62-48c3-b109-71eeff919284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:30.502391 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1d975-fd62-48c3-b109-71eeff919284 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:30.519892 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 178/367] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:30.523359 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1d975-fd62-48c3-b109-71eeff919284 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:30.634523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781fd7e-8deb-4388-8341-079f46ca6868 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:30.651064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1d975-fd62-48c3-b109-71eeff919284 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:30.672536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db604c-9e47-4df4-accb-07995afe71a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:30.673609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db604c-9e47-4df4-accb-07995afe71a6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:30.674121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db604c-9e47-4df4-accb-07995afe71a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:30.674598 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db604c-9e47-4df4-accb-07995afe71a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:30.675555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db604c-9e47-4df4-accb-07995afe71a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:30.676074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db604c-9e47-4df4-accb-07995afe71a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:30.677936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db604c-9e47-4df4-accb-07995afe71a6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:30.688031 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8605791-f04f-46cc-9548-fb8b6cd27a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:30.688699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8605791-f04f-46cc-9548-fb8b6cd27a7c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:30.689018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8605791-f04f-46cc-9548-fb8b6cd27a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:30.689299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8605791-f04f-46cc-9548-fb8b6cd27a7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:30.690088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 190/368] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:30.691128 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db604c-9e47-4df4-accb-07995afe71a6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:30.705624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:30.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:30.770536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8605791-f04f-46cc-9548-fb8b6cd27a7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:30.772125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8605791-f04f-46cc-9548-fb8b6cd27a7c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:30.810519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db604c-9e47-4df4-accb-07995afe71a6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:30.849871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f4ba-490a-453f-85b6-9f93f71f8f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:30.851291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f4ba-490a-453f-85b6-9f93f71f8f47 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:30.851783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f4ba-490a-453f-85b6-9f93f71f8f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:30.852283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f4ba-490a-453f-85b6-9f93f71f8f47 None admin] PATH_INFO: `/v3/groups/48bd262a9f53459dac117dc8de9dce6b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:30.853836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64f4ba-490a-453f-85b6-9f93f71f8f47 None admin] RBAC: Authorizing `identity:get_group(group_id=48bd262a9f53459dac117dc8de9dce6b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:30.855553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64f4ba-490a-453f-85b6-9f93f71f8f47 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:30.857587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 191/369] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:30 2022] GET /identity/v3/groups/48bd262a9f53459dac117dc8de9dce6b => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:30.858643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f4ba-490a-453f-85b6-9f93f71f8f47 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:30.893207 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 179/370] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:30.894294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8605791-f04f-46cc-9548-fb8b6cd27a7c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:30.952727 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:30.954148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:30.983171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f4ba-490a-453f-85b6-9f93f71f8f47 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:31.007695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8605791-f04f-46cc-9548-fb8b6cd27a7c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:31.021026 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2ff6f-17d9-4946-a12c-18e3be2d915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:31.022465 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2ff6f-17d9-4946-a12c-18e3be2d915b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:31.022957 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2ff6f-17d9-4946-a12c-18e3be2d915b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:31.023438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2ff6f-17d9-4946-a12c-18e3be2d915b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:31.049618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30082e89-efc1-4de4-8c24-610edf5b50c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:31.050511 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30082e89-efc1-4de4-8c24-610edf5b50c5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:31.050794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30082e89-efc1-4de4-8c24-610edf5b50c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:31.051069 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30082e89-efc1-4de4-8c24-610edf5b50c5 None admin] PATH_INFO: `/v3/users/9020f553898842f4920d2653ab0624d4` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:31.052364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30082e89-efc1-4de4-8c24-610edf5b50c5 None admin] RBAC: Authorizing `identity:get_user(user_id=9020f553898842f4920d2653ab0624d4)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:31.053930 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30082e89-efc1-4de4-8c24-610edf5b50c5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:31.055663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 180/371] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:18:30 2022] GET /identity/v3/users/9020f553898842f4920d2653ab0624d4 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:31.056519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30082e89-efc1-4de4-8c24-610edf5b50c5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:31.101630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2ff6f-17d9-4946-a12c-18e3be2d915b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:31.103464 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2ff6f-17d9-4946-a12c-18e3be2d915b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:31.166377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30082e89-efc1-4de4-8c24-610edf5b50c5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:31.186284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:31.193871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:31.207936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791722b1-bbf0-4f45-9bd9-bd8d6a5b5de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:31.208806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791722b1-bbf0-4f45-9bd9-bd8d6a5b5de7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:31.209345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791722b1-bbf0-4f45-9bd9-bd8d6a5b5de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:31.209463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791722b1-bbf0-4f45-9bd9-bd8d6a5b5de7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:31.210397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791722b1-bbf0-4f45-9bd9-bd8d6a5b5de7 None admin] RBAC: Adding query filter params (group.id=48bd262a9f53459dac117dc8de9dce6b, role.id=c860ed9e0b784b18a457abd0ddb5f508, scope.project.id=6252742811f240f8936cf0519e7401b8) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:31.210658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791722b1-bbf0-4f45-9bd9-bd8d6a5b5de7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:31.212234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791722b1-bbf0-4f45-9bd9-bd8d6a5b5de7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:31.216792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 192/372] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:31.218074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2ff6f-17d9-4946-a12c-18e3be2d915b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:31.222998 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 181/373] 10.222.0.39 () {56 vars in 1376 bytes} [Thu May 26 12:18:31 2022] GET /identity/v3/role_assignments?group.id=48bd262a9f53459dac117dc8de9dce6b&scope.project.id=6252742811f240f8936cf0519e7401b8&role.id=c860ed9e0b784b18a457abd0ddb5f508 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:31.224861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791722b1-bbf0-4f45-9bd9-bd8d6a5b5de7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:31.334024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2ff6f-17d9-4946-a12c-18e3be2d915b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:31.381744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab2283-425a-4d80-bb8b-4fee261431f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:31.383091 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab2283-425a-4d80-bb8b-4fee261431f7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:31.383585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab2283-425a-4d80-bb8b-4fee261431f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:31.384076 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab2283-425a-4d80-bb8b-4fee261431f7 None admin] PATH_INFO: `/v3/projects/051f7e40d662400dae586acf29916006` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:31.385802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab2283-425a-4d80-bb8b-4fee261431f7 None admin] RBAC: Authorizing `identity:get_project(project_id=051f7e40d662400dae586acf29916006)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:31.387591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab2283-425a-4d80-bb8b-4fee261431f7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:31.390101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 193/374] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:31 2022] GET /identity/v3/projects/051f7e40d662400dae586acf29916006 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:31.391431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab2283-425a-4d80-bb8b-4fee261431f7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:31.395084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791722b1-bbf0-4f45-9bd9-bd8d6a5b5de7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:31.445205 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:31.507112 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab2283-425a-4d80-bb8b-4fee261431f7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:31.525767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf19e1-9182-432d-9e9f-d023317740b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:31.526757 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf19e1-9182-432d-9e9f-d023317740b3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:31.527195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf19e1-9182-432d-9e9f-d023317740b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:31.527622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf19e1-9182-432d-9e9f-d023317740b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:31.529027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf19e1-9182-432d-9e9f-d023317740b3 None admin] RBAC: Adding query filter params (role.id=d85cfbcde27e45afbe2c7ec009e1c0c7, user.id=9020f553898842f4920d2653ab0624d4, scope.system=all) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:31.529530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf19e1-9182-432d-9e9f-d023317740b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:31.531830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf19e1-9182-432d-9e9f-d023317740b3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:31.547972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b3199-1f38-469c-b470-5c8dcc7581a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:31.549232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b3199-1f38-469c-b470-5c8dcc7581a1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:31.549726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b3199-1f38-469c-b470-5c8dcc7581a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:31.550226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b3199-1f38-469c-b470-5c8dcc7581a1 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:31.553354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b3199-1f38-469c-b470-5c8dcc7581a1 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:31.556208 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b3199-1f38-469c-b470-5c8dcc7581a1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:31.558550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 194/375] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:31 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:31.559532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b3199-1f38-469c-b470-5c8dcc7581a1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:31.576250 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 182/376] 10.222.0.39 () {56 vars in 1308 bytes} [Thu May 26 12:18:31 2022] GET /identity/v3/role_assignments?user.id=9020f553898842f4920d2653ab0624d4&scope.system=all&role.id=d85cfbcde27e45afbe2c7ec009e1c0c7 => generated 510 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:31.577413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf19e1-9182-432d-9e9f-d023317740b3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:31.671114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b3199-1f38-469c-b470-5c8dcc7581a1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:31.701159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:31.710980 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5a856-4801-4793-955b-27878e3d33a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:31.712213 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5a856-4801-4793-955b-27878e3d33a1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:31.712702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5a856-4801-4793-955b-27878e3d33a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:31.713240 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5a856-4801-4793-955b-27878e3d33a1 None admin] PATH_INFO: `/v3/groups/bd8d2e2be70a4fafb24ddf53fd8fbe0b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:31.719558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5a856-4801-4793-955b-27878e3d33a1 None admin] RBAC: Authorizing `identity:get_group(group_id=bd8d2e2be70a4fafb24ddf53fd8fbe0b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:31.721457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5a856-4801-4793-955b-27878e3d33a1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:31.724116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 195/377] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:31 2022] GET /identity/v3/groups/bd8d2e2be70a4fafb24ddf53fd8fbe0b => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:31.730813 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:31.731842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5a856-4801-4793-955b-27878e3d33a1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:31.851691 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf19e1-9182-432d-9e9f-d023317740b3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:31.870868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5a856-4801-4793-955b-27878e3d33a1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:31.920857 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b59f3-afb4-411a-b76c-6f84febc129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:31.921905 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b59f3-afb4-411a-b76c-6f84febc129a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:31.922394 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b59f3-afb4-411a-b76c-6f84febc129a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:31.922877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b59f3-afb4-411a-b76c-6f84febc129a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:31.923991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b59f3-afb4-411a-b76c-6f84febc129a None admin] RBAC: Adding query filter params (group.id=bd8d2e2be70a4fafb24ddf53fd8fbe0b, role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=051f7e40d662400dae586acf29916006) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:31.924540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b59f3-afb4-411a-b76c-6f84febc129a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:31.926287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b59f3-afb4-411a-b76c-6f84febc129a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:31.933544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 196/378] 10.222.0.39 () {56 vars in 1376 bytes} [Thu May 26 12:18:31 2022] GET /identity/v3/role_assignments?group.id=bd8d2e2be70a4fafb24ddf53fd8fbe0b&scope.project.id=051f7e40d662400dae586acf29916006&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:31.935209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd8fb3-6e4f-44f4-b836-c5c36bcd5298 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:31.935721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd8fb3-6e4f-44f4-b836-c5c36bcd5298 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:31.936221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd8fb3-6e4f-44f4-b836-c5c36bcd5298 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:31.937835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 197/379] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:31.945343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178acd4-e1c1-4981-9d30-d3d4a7f43847 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:31.945932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178acd4-e1c1-4981-9d30-d3d4a7f43847 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:31.946414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178acd4-e1c1-4981-9d30-d3d4a7f43847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:31.969531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7178acd4-e1c1-4981-9d30-d3d4a7f43847 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:31.970786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7178acd4-e1c1-4981-9d30-d3d4a7f43847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:31.978134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d33a42-445b-47b9-a172-87bafcc0baec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:31.979033 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d33a42-445b-47b9-a172-87bafcc0baec None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:31.979321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d33a42-445b-47b9-a172-87bafcc0baec None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:31.979599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d33a42-445b-47b9-a172-87bafcc0baec None admin] PATH_INFO: `/v3/groups/48bd262a9f53459dac117dc8de9dce6b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:31.985663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d33a42-445b-47b9-a172-87bafcc0baec None admin] RBAC: Authorizing `identity:get_group(group_id=48bd262a9f53459dac117dc8de9dce6b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:31.987172 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d33a42-445b-47b9-a172-87bafcc0baec None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:31.989034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 183/380] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:31 2022] GET /identity/v3/groups/48bd262a9f53459dac117dc8de9dce6b => generated 226 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:32.001792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d33a42-445b-47b9-a172-87bafcc0baec None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:32.014274 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:32.062740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 198/381] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:18:32.105083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178acd4-e1c1-4981-9d30-d3d4a7f43847 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:32.233583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d33a42-445b-47b9-a172-87bafcc0baec None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:32.249098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:32.263754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178acd4-e1c1-4981-9d30-d3d4a7f43847 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:32.301626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c0a34-ddf9-4048-9659-26886d0d41f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:32.303176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c0a34-ddf9-4048-9659-26886d0d41f4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:32.303772 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c0a34-ddf9-4048-9659-26886d0d41f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:32.305348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c0a34-ddf9-4048-9659-26886d0d41f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:32.306936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c0a34-ddf9-4048-9659-26886d0d41f4 None admin] RBAC: Adding query filter params (group.id=48bd262a9f53459dac117dc8de9dce6b, role.id=512083f4095a4f23a8dd4e8789fa20b3, scope.project.id=6252742811f240f8936cf0519e7401b8) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:32.307652 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c0a34-ddf9-4048-9659-26886d0d41f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:32.310086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c0a34-ddf9-4048-9659-26886d0d41f4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:32.319632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 184/382] 10.222.0.39 () {56 vars in 1376 bytes} [Thu May 26 12:18:32 2022] GET /identity/v3/role_assignments?group.id=48bd262a9f53459dac117dc8de9dce6b&scope.project.id=6252742811f240f8936cf0519e7401b8&role.id=512083f4095a4f23a8dd4e8789fa20b3 => generated 260 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:32.323249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37739f-d977-4a9e-8f86-d2a0a38b3b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:32.324284 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37739f-d977-4a9e-8f86-d2a0a38b3b2e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:32.324741 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37739f-d977-4a9e-8f86-d2a0a38b3b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:32.325222 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37739f-d977-4a9e-8f86-d2a0a38b3b2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:32.342505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37739f-d977-4a9e-8f86-d2a0a38b3b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-2c37739f-d977-4a9e-8f86-d2a0a38b3b2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:32.351020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:32.352179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:32.353188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:32.353188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:32.353188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:32.353188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:32.353188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:32.353188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:32.353188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:32.353188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:32.353188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:32.353188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:32.353188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:32.353188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:32.355701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 199/383] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:32.361742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c0a34-ddf9-4048-9659-26886d0d41f4 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:32.507871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c0a34-ddf9-4048-9659-26886d0d41f4 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:32.549422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be900f83-7932-4670-8bce-01a1b2d3c164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:32.550195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be900f83-7932-4670-8bce-01a1b2d3c164 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:32.550483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be900f83-7932-4670-8bce-01a1b2d3c164 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:32.550761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be900f83-7932-4670-8bce-01a1b2d3c164 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:32.552147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be900f83-7932-4670-8bce-01a1b2d3c164 None admin] RBAC: Adding query filter params (name=member) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:32.552554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be900f83-7932-4670-8bce-01a1b2d3c164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:32.554226 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be900f83-7932-4670-8bce-01a1b2d3c164 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:32.569829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 185/384] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:32.575275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37739f-d977-4a9e-8f86-d2a0a38b3b2e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:32.614710 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:32.726976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37739f-d977-4a9e-8f86-d2a0a38b3b2e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:32.768850 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436d02d-3120-44d9-b8c6-c2157f4a7634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:32.769633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436d02d-3120-44d9-b8c6-c2157f4a7634 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:32.769921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436d02d-3120-44d9-b8c6-c2157f4a7634 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:32.770254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436d02d-3120-44d9-b8c6-c2157f4a7634 None admin] PATH_INFO: `/v3/groups/48bd262a9f53459dac117dc8de9dce6b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:32.772749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436d02d-3120-44d9-b8c6-c2157f4a7634 None admin] RBAC: Authorizing `identity:get_group(group_id=48bd262a9f53459dac117dc8de9dce6b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:32.774224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436d02d-3120-44d9-b8c6-c2157f4a7634 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:32.776185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 200/385] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:32 2022] GET /identity/v3/groups/48bd262a9f53459dac117dc8de9dce6b => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:32.781683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be900f83-7932-4670-8bce-01a1b2d3c164 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:32.820301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:32.927726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be900f83-7932-4670-8bce-01a1b2d3c164 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:32.976838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abf906-c808-40fe-9426-609e57af3616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:32.977651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abf906-c808-40fe-9426-609e57af3616 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:32.977937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abf906-c808-40fe-9426-609e57af3616 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:32.978213 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abf906-c808-40fe-9426-609e57af3616 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:32.981057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abf906-c808-40fe-9426-609e57af3616 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:32.982517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abf906-c808-40fe-9426-609e57af3616 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:32.984532 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 186/386] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:32 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:32.990624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436d02d-3120-44d9-b8c6-c2157f4a7634 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:33.130548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:33.136606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436d02d-3120-44d9-b8c6-c2157f4a7634 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:33.178202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a41fbe-55d7-4894-bead-a58e63926fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:33.179099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a41fbe-55d7-4894-bead-a58e63926fb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:33.179384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a41fbe-55d7-4894-bead-a58e63926fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:33.179663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a41fbe-55d7-4894-bead-a58e63926fb5 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925/groups/48bd262a9f53459dac117dc8de9dce6b/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:33.182420 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a41fbe-55d7-4894-bead-a58e63926fb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc93986f17a48809b5e9aa58ea66925, group_id=48bd262a9f53459dac117dc8de9dce6b, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:33.184089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a41fbe-55d7-4894-bead-a58e63926fb5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:33.205940 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 201/387] 10.222.0.39 () {58 vars in 1442 bytes} [Thu May 26 12:18:32 2022] PUT /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925/groups/48bd262a9f53459dac117dc8de9dce6b/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:18:33.542054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b623817-05da-479a-ae04-fd77e95b9114 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:33.542572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b623817-05da-479a-ae04-fd77e95b9114 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:33.542645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b623817-05da-479a-ae04-fd77e95b9114 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:33.544134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 187/388] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:33.549804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e3d44-3ff7-4257-8e79-933e75f880a0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:33.550373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e3d44-3ff7-4257-8e79-933e75f880a0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:33.550841 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e3d44-3ff7-4257-8e79-933e75f880a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:33.569956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fb9e3d44-3ff7-4257-8e79-933e75f880a0 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:33.571451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fb9e3d44-3ff7-4257-8e79-933e75f880a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:33.680603 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 202/389] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:33.715650 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b623817-05da-479a-ae04-fd77e95b9114 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:33.873505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b623817-05da-479a-ae04-fd77e95b9114 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:33.875092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:33.927988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be9b0f-2e3a-410e-a7df-b43cfd01ec1f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:33.928294 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be9b0f-2e3a-410e-a7df-b43cfd01ec1f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:33.928553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be9b0f-2e3a-410e-a7df-b43cfd01ec1f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:33.928733 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40642a35-e14f-481f-b8bf-2ec18bba3f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:33.929546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40642a35-e14f-481f-b8bf-2ec18bba3f58 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:33.929831 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40642a35-e14f-481f-b8bf-2ec18bba3f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:33.930108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40642a35-e14f-481f-b8bf-2ec18bba3f58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:33.930203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 203/390] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:18:33.935377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70c927-27cb-47e7-bd46-39817ea6c01d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:33.935667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70c927-27cb-47e7-bd46-39817ea6c01d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:33.935945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70c927-27cb-47e7-bd46-39817ea6c01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:33.941760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40642a35-e14f-481f-b8bf-2ec18bba3f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-40642a35-e14f-481f-b8bf-2ec18bba3f58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:33.950659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:33.951519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:33.952434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:33.952434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:33.952434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:33.952434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:33.952434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:33.952434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:33.952434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:33.952434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:33.952434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:33.952434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:33.952434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:33.952434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:33.952434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 188/391] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:18:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:33.957662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40642a35-e14f-481f-b8bf-2ec18bba3f58 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:33.977893 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3c70c927-27cb-47e7-bd46-39817ea6c01d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:33.979096 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3c70c927-27cb-47e7-bd46-39817ea6c01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:34.066343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 204/392] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:34.133668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40642a35-e14f-481f-b8bf-2ec18bba3f58 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:34.166121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70c927-27cb-47e7-bd46-39817ea6c01d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:34.192508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d3645-5b39-4184-bc2d-22dac5def154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:34.193290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:34.193413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d3645-5b39-4184-bc2d-22dac5def154 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:34.193591 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d3645-5b39-4184-bc2d-22dac5def154 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:34.193869 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d3645-5b39-4184-bc2d-22dac5def154 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:34.194626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d3645-5b39-4184-bc2d-22dac5def154 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:34.194932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d3645-5b39-4184-bc2d-22dac5def154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:34.196318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d3645-5b39-4184-bc2d-22dac5def154 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:34.220337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 189/393] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:34.230246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d3645-5b39-4184-bc2d-22dac5def154 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:34.275847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:34.326012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70c927-27cb-47e7-bd46-39817ea6c01d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:34.375811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbebc52-524c-44f0-8948-9a78a91beea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:34.376624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbebc52-524c-44f0-8948-9a78a91beea4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:34.376926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbebc52-524c-44f0-8948-9a78a91beea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:34.377202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbebc52-524c-44f0-8948-9a78a91beea4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:34.397416 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbebc52-524c-44f0-8948-9a78a91beea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-7cbebc52-524c-44f0-8948-9a78a91beea4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:34.405126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:34.405988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:34.406778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:34.406778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:34.406778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:34.406778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:34.406778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:34.406778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:34.406778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:34.406778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:34.406778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:34.406778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:34.406778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:34.406778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:34.411856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 205/394] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:34.413202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbebc52-524c-44f0-8948-9a78a91beea4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:34.436794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d3645-5b39-4184-bc2d-22dac5def154 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:34.479196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5162c-a68c-4e9e-a93e-620dfaeed219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:34.480066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5162c-a68c-4e9e-a93e-620dfaeed219 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:34.480349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5162c-a68c-4e9e-a93e-620dfaeed219 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:34.480626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5162c-a68c-4e9e-a93e-620dfaeed219 None admin] PATH_INFO: `/v3/groups/48bd262a9f53459dac117dc8de9dce6b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:34.485413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5162c-a68c-4e9e-a93e-620dfaeed219 None admin] RBAC: Authorizing `identity:get_group(group_id=48bd262a9f53459dac117dc8de9dce6b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:34.486857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5162c-a68c-4e9e-a93e-620dfaeed219 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:34.488488 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 190/395] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:34 2022] GET /identity/v3/groups/48bd262a9f53459dac117dc8de9dce6b => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:34.496270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5162c-a68c-4e9e-a93e-620dfaeed219 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:34.576963 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:34.615794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:34.621114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbebc52-524c-44f0-8948-9a78a91beea4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:34.637774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5162c-a68c-4e9e-a93e-620dfaeed219 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:34.680294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310503d-f455-45f3-8422-eeffcc72ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:34.681347 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310503d-f455-45f3-8422-eeffcc72ad19 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:34.682101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310503d-f455-45f3-8422-eeffcc72ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:34.682384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310503d-f455-45f3-8422-eeffcc72ad19 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:34.683737 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310503d-f455-45f3-8422-eeffcc72ad19 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:34.685600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310503d-f455-45f3-8422-eeffcc72ad19 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:34.688040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 191/396] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:34 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:34.694264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310503d-f455-45f3-8422-eeffcc72ad19 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:34.705997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c579770-5d86-46a8-be74-058c9c5c4e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:34.706956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c579770-5d86-46a8-be74-058c9c5c4e85 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:34.707432 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c579770-5d86-46a8-be74-058c9c5c4e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:34.708655 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c579770-5d86-46a8-be74-058c9c5c4e85 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:34.710094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c579770-5d86-46a8-be74-058c9c5c4e85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:34.710620 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c579770-5d86-46a8-be74-058c9c5c4e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:34.712194 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c579770-5d86-46a8-be74-058c9c5c4e85 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:34.729453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 206/397] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:34.735591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c579770-5d86-46a8-be74-058c9c5c4e85 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:34.845670 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310503d-f455-45f3-8422-eeffcc72ad19 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:34.851263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c579770-5d86-46a8-be74-058c9c5c4e85 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:34.892674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a913f-b19b-4f6d-802f-3f9472895ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:34.893824 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a913f-b19b-4f6d-802f-3f9472895ddd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:34.893929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f4829-c604-428b-9f89-6fc47a411b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:34.894445 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a913f-b19b-4f6d-802f-3f9472895ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:34.894833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4829-c604-428b-9f89-6fc47a411b0e None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:34.895715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4829-c604-428b-9f89-6fc47a411b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:34.895962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f4829-c604-428b-9f89-6fc47a411b0e None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925/groups/48bd262a9f53459dac117dc8de9dce6b/roles/512083f4095a4f23a8dd4e8789fa20b3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:34.896222 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a913f-b19b-4f6d-802f-3f9472895ddd None admin] PATH_INFO: `/v3/groups/48bd262a9f53459dac117dc8de9dce6b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:34.897701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a913f-b19b-4f6d-802f-3f9472895ddd None admin] RBAC: Authorizing `identity:get_group(group_id=48bd262a9f53459dac117dc8de9dce6b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:34.898414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f4829-c604-428b-9f89-6fc47a411b0e None admin] RBAC: Authorizing `identity:create_grant(project_id=7cc93986f17a48809b5e9aa58ea66925, group_id=48bd262a9f53459dac117dc8de9dce6b, role_id=512083f4095a4f23a8dd4e8789fa20b3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:34.899808 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a913f-b19b-4f6d-802f-3f9472895ddd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:34.899912 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f4829-c604-428b-9f89-6fc47a411b0e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:34.902171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 207/398] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:34 2022] GET /identity/v3/groups/48bd262a9f53459dac117dc8de9dce6b => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:34.903600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7e9f3-3336-4793-b832-7e4b98f3f539 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:34.904168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7e9f3-3336-4793-b832-7e4b98f3f539 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:34.904634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7e9f3-3336-4793-b832-7e4b98f3f539 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:34.906318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 208/399] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:34.909182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7e9f3-3336-4793-b832-7e4b98f3f539 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:34.920056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 192/400] 10.222.0.39 () {58 vars in 1442 bytes} [Thu May 26 12:18:34 2022] PUT /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925/groups/48bd262a9f53459dac117dc8de9dce6b/roles/512083f4095a4f23a8dd4e8789fa20b3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:18:34.921438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ba0a3-fcb0-4ae8-b6b1-a812f1fe120d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:34.921731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ba0a3-fcb0-4ae8-b6b1-a812f1fe120d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:34.922012 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ba0a3-fcb0-4ae8-b6b1-a812f1fe120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:34.941163 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-618ba0a3-fcb0-4ae8-b6b1-a812f1fe120d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:34.942358 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-618ba0a3-fcb0-4ae8-b6b1-a812f1fe120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:34.944467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:34.982070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:35.050692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 193/401] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:35.052747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6d00-904c-4db7-8921-f84f75ab237c None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:35.053145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6d00-904c-4db7-8921-f84f75ab237c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:35.053430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6d00-904c-4db7-8921-f84f75ab237c None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:35.056797 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 194/402] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:35.061997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411eb42-d747-41a3-9bb4-742fd4d6441f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:35.062287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411eb42-d747-41a3-9bb4-742fd4d6441f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:35.062563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411eb42-d747-41a3-9bb4-742fd4d6441f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:35.082807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0411eb42-d747-41a3-9bb4-742fd4d6441f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:35.083030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0411eb42-d747-41a3-9bb4-742fd4d6441f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:35.084974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7e9f3-3336-4793-b832-7e4b98f3f539 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:35.122751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459aca52-c0d5-4d10-9e20-216c60843ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:35.124007 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aca52-c0d5-4d10-9e20-216c60843ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:35.124512 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aca52-c0d5-4d10-9e20-216c60843ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:35.125006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459aca52-c0d5-4d10-9e20-216c60843ea5 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:35.126453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459aca52-c0d5-4d10-9e20-216c60843ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:35.128133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459aca52-c0d5-4d10-9e20-216c60843ea5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:35.135744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 209/403] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:34 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:35.137080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459aca52-c0d5-4d10-9e20-216c60843ea5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:35.163866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 195/404] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:35.164678 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411eb42-d747-41a3-9bb4-742fd4d6441f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:35.224768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:35.255511 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:35.259911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459aca52-c0d5-4d10-9e20-216c60843ea5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:35.283174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411eb42-d747-41a3-9bb4-742fd4d6441f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:35.303762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf137552-b21c-4c64-864d-6eced3647153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:35.305121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf137552-b21c-4c64-864d-6eced3647153 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:35.305550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf137552-b21c-4c64-864d-6eced3647153 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:35.306141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf137552-b21c-4c64-864d-6eced3647153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:35.319638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf137552-b21c-4c64-864d-6eced3647153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:35.325747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc605043-3181-4c7d-a28c-a9326f3a0d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:35.326640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc605043-3181-4c7d-a28c-a9326f3a0d79 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:35.326920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc605043-3181-4c7d-a28c-a9326f3a0d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:35.327195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc605043-3181-4c7d-a28c-a9326f3a0d79 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8/groups/48bd262a9f53459dac117dc8de9dce6b/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-bf137552-b21c-4c64-864d-6eced3647153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:35.328859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:35.329897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:35.330950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:35.330950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:35.330950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:35.330950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:35.330950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:35.330950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:35.330950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:35.330950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:35.330950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:35.330950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:35.330950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:35.330950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:35.331552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc605043-3181-4c7d-a28c-a9326f3a0d79 None admin] RBAC: Authorizing `identity:create_grant(project_id=6252742811f240f8936cf0519e7401b8, group_id=48bd262a9f53459dac117dc8de9dce6b, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:35.331552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc605043-3181-4c7d-a28c-a9326f3a0d79 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:35.333990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 210/405] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:18:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:35.335603 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf137552-b21c-4c64-864d-6eced3647153 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:35.351965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 196/406] 10.222.0.39 () {58 vars in 1442 bytes} [Thu May 26 12:18:35 2022] PUT /identity/v3/projects/6252742811f240f8936cf0519e7401b8/groups/48bd262a9f53459dac117dc8de9dce6b/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:18:35.356819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc605043-3181-4c7d-a28c-a9326f3a0d79 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:35.530998 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc605043-3181-4c7d-a28c-a9326f3a0d79 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:35.534777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf137552-b21c-4c64-864d-6eced3647153 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:35.580309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3cc8e-5396-400e-8be3-6183e9865f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:35.581762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3cc8e-5396-400e-8be3-6183e9865f30 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:35.582041 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3cc8e-5396-400e-8be3-6183e9865f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:35.582319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3cc8e-5396-400e-8be3-6183e9865f30 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:35.583747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3cc8e-5396-400e-8be3-6183e9865f30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:35.584060 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3cc8e-5396-400e-8be3-6183e9865f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:35.585477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3cc8e-5396-400e-8be3-6183e9865f30 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:35.598991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 197/407] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:35.604989 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3cc8e-5396-400e-8be3-6183e9865f30 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:35.607045 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf689b-595b-4b8d-bf31-472221c62a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:35.607989 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:35.608587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf689b-595b-4b8d-bf31-472221c62a85 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:35.608939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf689b-595b-4b8d-bf31-472221c62a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:35.609259 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf689b-595b-4b8d-bf31-472221c62a85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:35.611751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:35.630284 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf689b-595b-4b8d-bf31-472221c62a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-eadf689b-595b-4b8d-bf31-472221c62a85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:35.647628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:35.648585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:35.649423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:35.649423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:35.649423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:35.649423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:35.649423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:35.649423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:35.649423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:35.649423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:35.649423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:35.649423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:35.649423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:35.649423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:35.659939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 211/408] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:18:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:35.662335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf689b-595b-4b8d-bf31-472221c62a85 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:35.816638 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3cc8e-5396-400e-8be3-6183e9865f30 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:35.928738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9eaca-3387-4183-a145-f24ff5e671ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:35.928738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9eaca-3387-4183-a145-f24ff5e671ca None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:35.928738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9eaca-3387-4183-a145-f24ff5e671ca None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:35.928738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9eaca-3387-4183-a145-f24ff5e671ca None admin] PATH_INFO: `/v3/groups/bd8d2e2be70a4fafb24ddf53fd8fbe0b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:35.929147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9eaca-3387-4183-a145-f24ff5e671ca None admin] RBAC: Authorizing `identity:get_group(group_id=bd8d2e2be70a4fafb24ddf53fd8fbe0b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:35.929976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9eaca-3387-4183-a145-f24ff5e671ca None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:35.942534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 198/409] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:35 2022] GET /identity/v3/groups/bd8d2e2be70a4fafb24ddf53fd8fbe0b => generated 229 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:35.945580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9eaca-3387-4183-a145-f24ff5e671ca None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:35.974215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf689b-595b-4b8d-bf31-472221c62a85 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:36.072453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed80ac-4a4c-4e1b-85de-8ea0b385dc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:36.073107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed80ac-4a4c-4e1b-85de-8ea0b385dc8a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:36.073398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed80ac-4a4c-4e1b-85de-8ea0b385dc8a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:36.073680 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed80ac-4a4c-4e1b-85de-8ea0b385dc8a None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:36.074450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed80ac-4a4c-4e1b-85de-8ea0b385dc8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:36.074765 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed80ac-4a4c-4e1b-85de-8ea0b385dc8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:36.076361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed80ac-4a4c-4e1b-85de-8ea0b385dc8a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:36.088102 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 212/410] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:36.089475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a35bc2-65f6-4475-b0ae-e7fe8131969d None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:36.092743 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a35bc2-65f6-4475-b0ae-e7fe8131969d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:36.092743 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a35bc2-65f6-4475-b0ae-e7fe8131969d None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:36.096825 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 213/411] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:36.100742 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a35bc2-65f6-4475-b0ae-e7fe8131969d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:36.132739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:36.177139 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9eaca-3387-4183-a145-f24ff5e671ca None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:36.190462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:36.212247 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93611c6b-358b-441e-9f64-460e8f66fb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:36.213144 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611c6b-358b-441e-9f64-460e8f66fb64 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:36.213428 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611c6b-358b-441e-9f64-460e8f66fb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:36.213706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611c6b-358b-441e-9f64-460e8f66fb64 None admin] PATH_INFO: `/v3/projects/051f7e40d662400dae586acf29916006` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:36.214930 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93611c6b-358b-441e-9f64-460e8f66fb64 None admin] RBAC: Authorizing `identity:get_project(project_id=051f7e40d662400dae586acf29916006)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:36.216357 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93611c6b-358b-441e-9f64-460e8f66fb64 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:36.218094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 199/412] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:35 2022] GET /identity/v3/projects/051f7e40d662400dae586acf29916006 => generated 344 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:36.219223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b277bed-a2e1-4fa1-a6d5-0a821fa2506e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:36.219508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b277bed-a2e1-4fa1-a6d5-0a821fa2506e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:36.219787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b277bed-a2e1-4fa1-a6d5-0a821fa2506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:36.237962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5b277bed-a2e1-4fa1-a6d5-0a821fa2506e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:36.239877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5b277bed-a2e1-4fa1-a6d5-0a821fa2506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:36.246907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a35bc2-65f6-4475-b0ae-e7fe8131969d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:36.291852 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69041e5-5d18-4051-aca1-0b7dfd3dafd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:36.292739 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69041e5-5d18-4051-aca1-0b7dfd3dafd3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:36.293029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69041e5-5d18-4051-aca1-0b7dfd3dafd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:36.293307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69041e5-5d18-4051-aca1-0b7dfd3dafd3 None admin] PATH_INFO: `/v3/groups/48bd262a9f53459dac117dc8de9dce6b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:36.294710 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69041e5-5d18-4051-aca1-0b7dfd3dafd3 None admin] RBAC: Authorizing `identity:get_group(group_id=48bd262a9f53459dac117dc8de9dce6b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:36.296187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69041e5-5d18-4051-aca1-0b7dfd3dafd3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:36.298314 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 214/413] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:36 2022] GET /identity/v3/groups/48bd262a9f53459dac117dc8de9dce6b => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:36.299294 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69041e5-5d18-4051-aca1-0b7dfd3dafd3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:36.318119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 200/414] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:36.318976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b277bed-a2e1-4fa1-a6d5-0a821fa2506e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:36.403394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:36.413365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69041e5-5d18-4051-aca1-0b7dfd3dafd3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:36.438612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b277bed-a2e1-4fa1-a6d5-0a821fa2506e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:36.440448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:36.453542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6f869-284b-4aaf-a9ce-f4f1ce52cbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:36.454537 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6f869-284b-4aaf-a9ce-f4f1ce52cbea None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:36.454820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6f869-284b-4aaf-a9ce-f4f1ce52cbea None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:36.455094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6f869-284b-4aaf-a9ce-f4f1ce52cbea None admin] PATH_INFO: `/v3/projects/051f7e40d662400dae586acf29916006/groups/bd8d2e2be70a4fafb24ddf53fd8fbe0b/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:36.457308 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6f869-284b-4aaf-a9ce-f4f1ce52cbea None admin] RBAC: Authorizing `identity:create_grant(project_id=051f7e40d662400dae586acf29916006, group_id=bd8d2e2be70a4fafb24ddf53fd8fbe0b, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:36.459037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6f869-284b-4aaf-a9ce-f4f1ce52cbea None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:36.475759 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 215/415] 10.222.0.39 () {58 vars in 1442 bytes} [Thu May 26 12:18:36 2022] PUT /identity/v3/projects/051f7e40d662400dae586acf29916006/groups/bd8d2e2be70a4fafb24ddf53fd8fbe0b/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:18:36.476449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30367fb-866a-4239-bc70-cd3342a36247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:36.477473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30367fb-866a-4239-bc70-cd3342a36247 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:36.477804 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30367fb-866a-4239-bc70-cd3342a36247 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:36.478157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30367fb-866a-4239-bc70-cd3342a36247 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:36.481694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6f869-284b-4aaf-a9ce-f4f1ce52cbea None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:36.482911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30367fb-866a-4239-bc70-cd3342a36247 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:36.485308 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30367fb-866a-4239-bc70-cd3342a36247 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:36.491771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 201/416] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:36 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:36.497607 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30367fb-866a-4239-bc70-cd3342a36247 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:36.697150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6f869-284b-4aaf-a9ce-f4f1ce52cbea None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:36.732071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30367fb-866a-4239-bc70-cd3342a36247 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:36.738610 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54d4d8-5f38-4cb0-b4b2-84f4ecc646fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:36.740003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d4d8-5f38-4cb0-b4b2-84f4ecc646fc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:36.740381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d4d8-5f38-4cb0-b4b2-84f4ecc646fc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:36.740757 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d4d8-5f38-4cb0-b4b2-84f4ecc646fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:36.755374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54d4d8-5f38-4cb0-b4b2-84f4ecc646fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-1f54d4d8-5f38-4cb0-b4b2-84f4ecc646fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:36.765593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:36.767608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:36.768658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:36.768658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:36.768658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:36.768658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:36.768658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:36.768658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:36.768658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:36.768658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:36.768658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:36.768658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:36.768658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:36.768658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:36.768658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 216/417] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:36.775792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54d4d8-5f38-4cb0-b4b2-84f4ecc646fc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:36.776825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c32056-67d5-4722-9fb2-0d8c53f23d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:36.777729 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c32056-67d5-4722-9fb2-0d8c53f23d1b None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:36.778009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c32056-67d5-4722-9fb2-0d8c53f23d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:36.778281 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c32056-67d5-4722-9fb2-0d8c53f23d1b None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8/groups/48bd262a9f53459dac117dc8de9dce6b/roles/512083f4095a4f23a8dd4e8789fa20b3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:36.780875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c32056-67d5-4722-9fb2-0d8c53f23d1b None admin] RBAC: Authorizing `identity:create_grant(project_id=6252742811f240f8936cf0519e7401b8, group_id=48bd262a9f53459dac117dc8de9dce6b, role_id=512083f4095a4f23a8dd4e8789fa20b3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:36.782341 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c32056-67d5-4722-9fb2-0d8c53f23d1b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:36.786560 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:36.808383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 202/418] 10.222.0.39 () {58 vars in 1442 bytes} [Thu May 26 12:18:36 2022] PUT /identity/v3/projects/6252742811f240f8936cf0519e7401b8/groups/48bd262a9f53459dac117dc8de9dce6b/roles/512083f4095a4f23a8dd4e8789fa20b3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:18:36.829675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:36.897875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54d4d8-5f38-4cb0-b4b2-84f4ecc646fc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:36.934605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2c279-e753-4c00-a786-15d784d1e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:36.935300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2c279-e753-4c00-a786-15d784d1e476 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:36.935583 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2c279-e753-4c00-a786-15d784d1e476 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:36.935864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2c279-e753-4c00-a786-15d784d1e476 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:36.936637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2c279-e753-4c00-a786-15d784d1e476 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:36.936972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2c279-e753-4c00-a786-15d784d1e476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:36.938364 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2c279-e753-4c00-a786-15d784d1e476 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:36.949083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 217/419] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:36.954531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c32056-67d5-4722-9fb2-0d8c53f23d1b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:37.079695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c32056-67d5-4722-9fb2-0d8c53f23d1b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:37.116440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a701cb-5669-43fb-ba64-7018b9574dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:37.117128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a701cb-5669-43fb-ba64-7018b9574dbe None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:37.117411 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a701cb-5669-43fb-ba64-7018b9574dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:37.117688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a701cb-5669-43fb-ba64-7018b9574dbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:37.184074 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:37.194746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a701cb-5669-43fb-ba64-7018b9574dbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:37.196301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a701cb-5669-43fb-ba64-7018b9574dbe None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:37.332614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 203/420] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:37.338826 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2c279-e753-4c00-a786-15d784d1e476 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:37.466313 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2c279-e753-4c00-a786-15d784d1e476 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:37.474658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:37.502012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58049236-2c64-41a1-99bc-1a441c0429f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:37.502876 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049236-2c64-41a1-99bc-1a441c0429f3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:37.503154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049236-2c64-41a1-99bc-1a441c0429f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:37.503424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58049236-2c64-41a1-99bc-1a441c0429f3 None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:37.505165 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58049236-2c64-41a1-99bc-1a441c0429f3 None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:37.507066 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58049236-2c64-41a1-99bc-1a441c0429f3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:37.509086 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 218/421] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:37 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:37.514658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a701cb-5669-43fb-ba64-7018b9574dbe None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:37.647753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:37.654909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a701cb-5669-43fb-ba64-7018b9574dbe None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:37.692793 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9368d9e-8045-484c-8192-11489d95273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:37.693680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9368d9e-8045-484c-8192-11489d95273d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:37.693964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9368d9e-8045-484c-8192-11489d95273d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:37.694242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9368d9e-8045-484c-8192-11489d95273d None admin] PATH_INFO: `/v3/groups/48bd262a9f53459dac117dc8de9dce6b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:37.695448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9368d9e-8045-484c-8192-11489d95273d None admin] RBAC: Authorizing `identity:get_group(group_id=48bd262a9f53459dac117dc8de9dce6b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:37.696925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9368d9e-8045-484c-8192-11489d95273d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:37.698884 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 204/422] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:37 2022] GET /identity/v3/groups/48bd262a9f53459dac117dc8de9dce6b => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:37.704196 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58049236-2c64-41a1-99bc-1a441c0429f3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:37.831437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58049236-2c64-41a1-99bc-1a441c0429f3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:37.864630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eee1d-623f-4ea1-89aa-e521f99af190 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:37.865311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eee1d-623f-4ea1-89aa-e521f99af190 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:37.865792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656eee1d-623f-4ea1-89aa-e521f99af190 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:37.867669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 205/423] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:37.874597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0038f-e251-4f9e-b287-7731f1a5ab4c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:37.875145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0038f-e251-4f9e-b287-7731f1a5ab4c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:37.875249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1d63f-0ef2-426e-8ef1-eb4aeb8354eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:37.875739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0038f-e251-4f9e-b287-7731f1a5ab4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:37.875931 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1d63f-0ef2-426e-8ef1-eb4aeb8354eb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:37.876176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1d63f-0ef2-426e-8ef1-eb4aeb8354eb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:37.876516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1d63f-0ef2-426e-8ef1-eb4aeb8354eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:37.877393 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1d63f-0ef2-426e-8ef1-eb4aeb8354eb None admin] RBAC: Adding query filter params (group.id=48bd262a9f53459dac117dc8de9dce6b, role.id=c860ed9e0b784b18a457abd0ddb5f508, scope.project.id=7cc93986f17a48809b5e9aa58ea66925) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:37.878151 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1d63f-0ef2-426e-8ef1-eb4aeb8354eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:37.880595 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1d63f-0ef2-426e-8ef1-eb4aeb8354eb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:37.896911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 219/424] 10.222.0.39 () {56 vars in 1376 bytes} [Thu May 26 12:18:37 2022] GET /identity/v3/role_assignments?group.id=48bd262a9f53459dac117dc8de9dce6b&scope.project.id=7cc93986f17a48809b5e9aa58ea66925&role.id=c860ed9e0b784b18a457abd0ddb5f508 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:37.913511 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a9a0038f-e251-4f9e-b287-7731f1a5ab4c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:37.914829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a9a0038f-e251-4f9e-b287-7731f1a5ab4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:38.017477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 206/425] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:38.050342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1d63f-0ef2-426e-8ef1-eb4aeb8354eb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:38.108458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:38.131723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc9501-80b8-4224-b6f3-eb97c0d8333b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:38.132348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc9501-80b8-4224-b6f3-eb97c0d8333b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:38.132956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc9501-80b8-4224-b6f3-eb97c0d8333b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:38.134588 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 207/426] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:38.140456 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6dc24-d5c9-4e4d-8fe7-2a45fd41cebe None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:38.140755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6dc24-d5c9-4e4d-8fe7-2a45fd41cebe None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:38.141301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6dc24-d5c9-4e4d-8fe7-2a45fd41cebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:38.172645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-20a6dc24-d5c9-4e4d-8fe7-2a45fd41cebe None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:38.173808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-20a6dc24-d5c9-4e4d-8fe7-2a45fd41cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:38.189482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1d63f-0ef2-426e-8ef1-eb4aeb8354eb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:38.256181 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5603c30-d4f3-43cd-8bba-309e575a49ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:38.257323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603c30-d4f3-43cd-8bba-309e575a49ed None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:38.257756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603c30-d4f3-43cd-8bba-309e575a49ed None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:38.258211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603c30-d4f3-43cd-8bba-309e575a49ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:38.270734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5603c30-d4f3-43cd-8bba-309e575a49ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:38.277424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 208/427] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e5603c30-d4f3-43cd-8bba-309e575a49ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:38.280744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:38.281829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:38.282789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:38.282789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:38.282789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:38.282789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:38.282789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:38.282789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:38.282789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:38.282789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:38.282789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:38.282789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:38.282789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:38.282789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:38.282789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 220/428] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:18:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:38.288035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6dc24-d5c9-4e4d-8fe7-2a45fd41cebe None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:38.310989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5603c30-d4f3-43cd-8bba-309e575a49ed None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:38.317608 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:38.424363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6dc24-d5c9-4e4d-8fe7-2a45fd41cebe None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:38.446793 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:38.450922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5603c30-d4f3-43cd-8bba-309e575a49ed None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:38.472066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ae477-17e9-4b71-b598-493749f635dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:38.473033 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ae477-17e9-4b71-b598-493749f635dc None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:38.473510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ae477-17e9-4b71-b598-493749f635dc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:38.473932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ae477-17e9-4b71-b598-493749f635dc None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:38.474926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ae477-17e9-4b71-b598-493749f635dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:38.475369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ae477-17e9-4b71-b598-493749f635dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:38.479063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ae477-17e9-4b71-b598-493749f635dc None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:38.490461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 209/429] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:38.495565 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ae477-17e9-4b71-b598-493749f635dc None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:38.501075 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619d351-9a44-490c-ba5e-9199d856e419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:38.502126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619d351-9a44-490c-ba5e-9199d856e419 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:38.502625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619d351-9a44-490c-ba5e-9199d856e419 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:38.503098 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619d351-9a44-490c-ba5e-9199d856e419 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:38.515330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619d351-9a44-490c-ba5e-9199d856e419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f619d351-9a44-490c-ba5e-9199d856e419 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:38.524968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:38.525865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:38.526658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:38.526658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:38.526658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:38.526658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:38.526658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:38.526658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:38.526658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:38.526658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:38.526658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:38.526658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:38.526658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:18:38.526658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:38.535048 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 221/430] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:38.535610 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619d351-9a44-490c-ba5e-9199d856e419 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:38.612343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:38.630555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ae477-17e9-4b71-b598-493749f635dc None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:38.669581 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619d351-9a44-490c-ba5e-9199d856e419 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:38.690473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21888b27-fffa-495a-ac79-df3a976fdbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:38.691506 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21888b27-fffa-495a-ac79-df3a976fdbac None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:38.691888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21888b27-fffa-495a-ac79-df3a976fdbac None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:38.693508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21888b27-fffa-495a-ac79-df3a976fdbac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:38.713077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aaf41-a9b7-4c33-a0fb-be0ac2963ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:38.714010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aaf41-a9b7-4c33-a0fb-be0ac2963ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:38.714439 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aaf41-a9b7-4c33-a0fb-be0ac2963ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:38.714858 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aaf41-a9b7-4c33-a0fb-be0ac2963ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:38.715772 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88aaf41-a9b7-4c33-a0fb-be0ac2963ef2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:38.716236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88aaf41-a9b7-4c33-a0fb-be0ac2963ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:38.717820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88aaf41-a9b7-4c33-a0fb-be0ac2963ef2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:38.730018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 222/431] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:18:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:38.737989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aaf41-a9b7-4c33-a0fb-be0ac2963ef2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:38.768116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:38.792674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21888b27-fffa-495a-ac79-df3a976fdbac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:38.794517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21888b27-fffa-495a-ac79-df3a976fdbac None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:38.867223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aaf41-a9b7-4c33-a0fb-be0ac2963ef2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:38.901990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:38.909052 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064add3e-2c56-4e65-a256-c3ff2c237b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:38.911219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064add3e-2c56-4e65-a256-c3ff2c237b53 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:38.911733 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064add3e-2c56-4e65-a256-c3ff2c237b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:38.912373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064add3e-2c56-4e65-a256-c3ff2c237b53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:38.921197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 210/432] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:18:38.929979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21888b27-fffa-495a-ac79-df3a976fdbac None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:38.995379 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064add3e-2c56-4e65-a256-c3ff2c237b53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:38.997488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064add3e-2c56-4e65-a256-c3ff2c237b53 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:39.022160 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:39.040124 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21888b27-fffa-495a-ac79-df3a976fdbac None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:39.078322 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696a0ea-c74a-4bd0-92d6-55bd36033b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:39.079566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696a0ea-c74a-4bd0-92d6-55bd36033b4d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:39.080037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696a0ea-c74a-4bd0-92d6-55bd36033b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:39.080490 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696a0ea-c74a-4bd0-92d6-55bd36033b4d None admin] PATH_INFO: `/v3/projects/7cc93986f17a48809b5e9aa58ea66925` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:39.081974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696a0ea-c74a-4bd0-92d6-55bd36033b4d None admin] RBAC: Authorizing `identity:get_project(project_id=7cc93986f17a48809b5e9aa58ea66925)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:39.084633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696a0ea-c74a-4bd0-92d6-55bd36033b4d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:39.087678 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 211/433] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:38 2022] GET /identity/v3/projects/7cc93986f17a48809b5e9aa58ea66925 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:39.092593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696a0ea-c74a-4bd0-92d6-55bd36033b4d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:39.120398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 223/434] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:39.130593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064add3e-2c56-4e65-a256-c3ff2c237b53 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:39.157466 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:39.204492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696a0ea-c74a-4bd0-92d6-55bd36033b4d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:39.241327 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf98538-e479-4fd4-8457-701c89a89d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:39.242492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf98538-e479-4fd4-8457-701c89a89d27 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:39.242952 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf98538-e479-4fd4-8457-701c89a89d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:39.243401 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf98538-e479-4fd4-8457-701c89a89d27 None admin] PATH_INFO: `/v3/groups/48bd262a9f53459dac117dc8de9dce6b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:39.244309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064add3e-2c56-4e65-a256-c3ff2c237b53 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:39.245097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf98538-e479-4fd4-8457-701c89a89d27 None admin] RBAC: Authorizing `identity:get_group(group_id=48bd262a9f53459dac117dc8de9dce6b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:39.246780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf98538-e479-4fd4-8457-701c89a89d27 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:39.248992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 212/435] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:39 2022] GET /identity/v3/groups/48bd262a9f53459dac117dc8de9dce6b => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:39.254231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf98538-e479-4fd4-8457-701c89a89d27 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:39.273113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:39.287381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33bf53-39e8-488b-9558-76a1964b663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:39.288346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33bf53-39e8-488b-9558-76a1964b663f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:39.288636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33bf53-39e8-488b-9558-76a1964b663f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:39.288939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33bf53-39e8-488b-9558-76a1964b663f None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:39.290139 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33bf53-39e8-488b-9558-76a1964b663f None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:39.291579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33bf53-39e8-488b-9558-76a1964b663f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:39.293826 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 224/436] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:39 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:39.298698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33bf53-39e8-488b-9558-76a1964b663f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:39.364931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf98538-e479-4fd4-8457-701c89a89d27 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:39.390504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:39.406716 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16355f0-f8f2-4d95-a81f-7e44f3210b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:39.407563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16355f0-f8f2-4d95-a81f-7e44f3210b44 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:39.407848 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16355f0-f8f2-4d95-a81f-7e44f3210b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:39.408486 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16355f0-f8f2-4d95-a81f-7e44f3210b44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:39.409395 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16355f0-f8f2-4d95-a81f-7e44f3210b44 None admin] RBAC: Adding query filter params (group.id=48bd262a9f53459dac117dc8de9dce6b, role.id=512083f4095a4f23a8dd4e8789fa20b3, scope.project.id=7cc93986f17a48809b5e9aa58ea66925) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:39.409716 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16355f0-f8f2-4d95-a81f-7e44f3210b44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:39.412207 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16355f0-f8f2-4d95-a81f-7e44f3210b44 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:39.415429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33bf53-39e8-488b-9558-76a1964b663f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:39.419625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 213/437] 10.222.0.39 () {56 vars in 1376 bytes} [Thu May 26 12:18:39 2022] GET /identity/v3/role_assignments?group.id=48bd262a9f53459dac117dc8de9dce6b&scope.project.id=7cc93986f17a48809b5e9aa58ea66925&role.id=512083f4095a4f23a8dd4e8789fa20b3 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:39.420774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b6e05-0e21-4a93-aa3a-ddbaf4ea82af None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:39.421069 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b6e05-0e21-4a93-aa3a-ddbaf4ea82af None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:39.421351 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b6e05-0e21-4a93-aa3a-ddbaf4ea82af None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:39.422614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 214/438] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:39.428583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb8253-2b9b-4a93-8279-fbd02d0d3fce None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:39.428897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb8253-2b9b-4a93-8279-fbd02d0d3fce None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:39.429181 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb8253-2b9b-4a93-8279-fbd02d0d3fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:39.458514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a8eb8253-2b9b-4a93-8279-fbd02d0d3fce None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:39.460114 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a8eb8253-2b9b-4a93-8279-fbd02d0d3fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:39.476194 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad6e5d-7197-409a-8696-2c270a5d0adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:39.477103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad6e5d-7197-409a-8696-2c270a5d0adb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:39.477388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad6e5d-7197-409a-8696-2c270a5d0adb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:39.478476 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad6e5d-7197-409a-8696-2c270a5d0adb None admin] PATH_INFO: `/v3/groups/48bd262a9f53459dac117dc8de9dce6b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:39.478885 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad6e5d-7197-409a-8696-2c270a5d0adb None admin] RBAC: Authorizing `identity:get_group(group_id=48bd262a9f53459dac117dc8de9dce6b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:39.480351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad6e5d-7197-409a-8696-2c270a5d0adb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:39.486766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 225/439] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:39 2022] GET /identity/v3/groups/48bd262a9f53459dac117dc8de9dce6b => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:39.487759 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad6e5d-7197-409a-8696-2c270a5d0adb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:39.550531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 215/440] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:39.555454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705961f-d2f6-46a7-b660-b4640e54830b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:39.555742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705961f-d2f6-46a7-b660-b4640e54830b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:39.556011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705961f-d2f6-46a7-b660-b4640e54830b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:39.557756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 216/441] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:39.563441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3464b1-6ed8-4872-9315-985a9ddd58eb None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:39.563611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:39.564099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3464b1-6ed8-4872-9315-985a9ddd58eb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:39.564583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3464b1-6ed8-4872-9315-985a9ddd58eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:39.584183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ad3464b1-6ed8-4872-9315-985a9ddd58eb None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:39.585508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ad3464b1-6ed8-4872-9315-985a9ddd58eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:39.618063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad6e5d-7197-409a-8696-2c270a5d0adb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:39.663585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60061fa-3eac-431b-b92b-2ac341a48eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:39.664245 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60061fa-3eac-431b-b92b-2ac341a48eef None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:39.664526 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60061fa-3eac-431b-b92b-2ac341a48eef None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:39.664834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60061fa-3eac-431b-b92b-2ac341a48eef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:39.665665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60061fa-3eac-431b-b92b-2ac341a48eef None admin] RBAC: Adding query filter params (group.id=48bd262a9f53459dac117dc8de9dce6b, role.id=c860ed9e0b784b18a457abd0ddb5f508, scope.project.id=6252742811f240f8936cf0519e7401b8) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:39.665976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60061fa-3eac-431b-b92b-2ac341a48eef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:39.667420 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60061fa-3eac-431b-b92b-2ac341a48eef None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:39.668647 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 217/442] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:18:39.669634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3464b1-6ed8-4872-9315-985a9ddd58eb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:39.673965 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 226/443] 10.222.0.39 () {56 vars in 1376 bytes} [Thu May 26 12:18:39 2022] GET /identity/v3/role_assignments?group.id=48bd262a9f53459dac117dc8de9dce6b&scope.project.id=6252742811f240f8936cf0519e7401b8&role.id=c860ed9e0b784b18a457abd0ddb5f508 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:39.696459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60061fa-3eac-431b-b92b-2ac341a48eef None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:39.727128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:39.805598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3464b1-6ed8-4872-9315-985a9ddd58eb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:39.842585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60061fa-3eac-431b-b92b-2ac341a48eef None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:39.847715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4d09a-7b88-4c63-acff-a79ca9aed58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:39.849330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4d09a-7b88-4c63-acff-a79ca9aed58d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:39.849838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4d09a-7b88-4c63-acff-a79ca9aed58d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:39.850224 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4d09a-7b88-4c63-acff-a79ca9aed58d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:39.862376 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4d09a-7b88-4c63-acff-a79ca9aed58d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:39.867860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-a5c4d09a-7b88-4c63-acff-a79ca9aed58d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:39.875275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:39.876282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:39.877563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:39.877563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:39.877563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:39.877563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:39.877563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:39.877563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:39.877563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:39.877563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:39.877563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:39.877563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:39.877563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:18:39.877563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:39.877563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 218/444] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:18:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:39.886543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4d09a-7b88-4c63-acff-a79ca9aed58d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:39.892432 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ca8c7-c7be-485e-b9ae-eae05fd7108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:39.893373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ca8c7-c7be-485e-b9ae-eae05fd7108e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:39.893733 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ca8c7-c7be-485e-b9ae-eae05fd7108e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:39.894091 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ca8c7-c7be-485e-b9ae-eae05fd7108e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:39.913044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ca8c7-c7be-485e-b9ae-eae05fd7108e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e50ca8c7-c7be-485e-b9ae-eae05fd7108e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:39.922358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:39.923400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:39.924206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:39.924206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:39.924206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:39.924206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:39.924206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:39.924206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:39.924206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:39.924206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:39.924206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:39.924206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:39.924206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:39.924206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:39.924972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 227/445] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:18:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:39.930573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ca8c7-c7be-485e-b9ae-eae05fd7108e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:40.010157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4d09a-7b88-4c63-acff-a79ca9aed58d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:40.018827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:40.044865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ca8c7-c7be-485e-b9ae-eae05fd7108e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:40.059460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c410346-e4f9-4d94-8647-e5bfd5f2b5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:40.060073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c410346-e4f9-4d94-8647-e5bfd5f2b5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:40.060366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c410346-e4f9-4d94-8647-e5bfd5f2b5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:40.060642 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c410346-e4f9-4d94-8647-e5bfd5f2b5b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:40.061442 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c410346-e4f9-4d94-8647-e5bfd5f2b5b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:40.061758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c410346-e4f9-4d94-8647-e5bfd5f2b5b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:40.063150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c410346-e4f9-4d94-8647-e5bfd5f2b5b3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:40.076753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 219/446] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:40.078687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c410346-e4f9-4d94-8647-e5bfd5f2b5b3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:40.092606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ca985-9de0-4f7e-9037-0085a0e5f885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:40.093315 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ca985-9de0-4f7e-9037-0085a0e5f885 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:40.093744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ca985-9de0-4f7e-9037-0085a0e5f885 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:40.094164 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ca985-9de0-4f7e-9037-0085a0e5f885 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:40.094941 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ca985-9de0-4f7e-9037-0085a0e5f885 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:40.095251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ca985-9de0-4f7e-9037-0085a0e5f885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:40.097250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ca985-9de0-4f7e-9037-0085a0e5f885 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:40.105811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 228/447] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:40.111283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ca985-9de0-4f7e-9037-0085a0e5f885 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:40.155012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:40.184128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c410346-e4f9-4d94-8647-e5bfd5f2b5b3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:40.210972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ca985-9de0-4f7e-9037-0085a0e5f885 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:40.216850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08825393-bc7f-42b4-a10e-09e8f2947977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:40.217534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08825393-bc7f-42b4-a10e-09e8f2947977 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:40.217826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08825393-bc7f-42b4-a10e-09e8f2947977 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:40.218106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08825393-bc7f-42b4-a10e-09e8f2947977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:40.243996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16d8ea-52d8-4a72-89f1-19aaa7a9a3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:40.244632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16d8ea-52d8-4a72-89f1-19aaa7a9a3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:40.244945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16d8ea-52d8-4a72-89f1-19aaa7a9a3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:40.245223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16d8ea-52d8-4a72-89f1-19aaa7a9a3b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:40.252875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:40.287849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08825393-bc7f-42b4-a10e-09e8f2947977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:40.289345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08825393-bc7f-42b4-a10e-09e8f2947977 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:40.313032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16d8ea-52d8-4a72-89f1-19aaa7a9a3b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:40.314427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16d8ea-52d8-4a72-89f1-19aaa7a9a3b4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:40.355361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:40.387349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 220/448] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:18:40.393031 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08825393-bc7f-42b4-a10e-09e8f2947977 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:40.414338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 229/449] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:18:40.419696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16d8ea-52d8-4a72-89f1-19aaa7a9a3b4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:40.457255 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:40.491548 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08825393-bc7f-42b4-a10e-09e8f2947977 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:40.517799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16d8ea-52d8-4a72-89f1-19aaa7a9a3b4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:40.526005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf838a-234e-4e1f-a7d0-4b93ecd063a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:40.526858 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf838a-234e-4e1f-a7d0-4b93ecd063a3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:40.527142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf838a-234e-4e1f-a7d0-4b93ecd063a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:40.527417 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf838a-234e-4e1f-a7d0-4b93ecd063a3 None admin] PATH_INFO: `/v3/projects/051f7e40d662400dae586acf29916006` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:40.528602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf838a-234e-4e1f-a7d0-4b93ecd063a3 None admin] RBAC: Authorizing `identity:get_project(project_id=051f7e40d662400dae586acf29916006)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:40.530077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf838a-234e-4e1f-a7d0-4b93ecd063a3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:40.531760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 221/450] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:40 2022] GET /identity/v3/projects/051f7e40d662400dae586acf29916006 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:40.537827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf838a-234e-4e1f-a7d0-4b93ecd063a3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:40.554808 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fe5d7-41f2-40ab-ac7b-8ee95f363df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:40.555666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe5d7-41f2-40ab-ac7b-8ee95f363df8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:40.555944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe5d7-41f2-40ab-ac7b-8ee95f363df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:40.556212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fe5d7-41f2-40ab-ac7b-8ee95f363df8 None admin] PATH_INFO: `/v3/projects/6252742811f240f8936cf0519e7401b8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:40.557414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fe5d7-41f2-40ab-ac7b-8ee95f363df8 None admin] RBAC: Authorizing `identity:get_project(project_id=6252742811f240f8936cf0519e7401b8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:40.558858 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fe5d7-41f2-40ab-ac7b-8ee95f363df8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:40.560535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 230/451] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:18:40 2022] GET /identity/v3/projects/6252742811f240f8936cf0519e7401b8 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:40.565915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fe5d7-41f2-40ab-ac7b-8ee95f363df8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:40.578573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:40.638075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf838a-234e-4e1f-a7d0-4b93ecd063a3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:40.668982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fe5d7-41f2-40ab-ac7b-8ee95f363df8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:40.672589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b7b8b-3d8c-45c1-9142-d4a58e617a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:40.673481 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b7b8b-3d8c-45c1-9142-d4a58e617a3b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:40.673768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b7b8b-3d8c-45c1-9142-d4a58e617a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:40.674045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b7b8b-3d8c-45c1-9142-d4a58e617a3b None admin] PATH_INFO: `/v3/groups/bd8d2e2be70a4fafb24ddf53fd8fbe0b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:40.675232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b7b8b-3d8c-45c1-9142-d4a58e617a3b None admin] RBAC: Authorizing `identity:get_group(group_id=bd8d2e2be70a4fafb24ddf53fd8fbe0b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:40.677017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b7b8b-3d8c-45c1-9142-d4a58e617a3b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:40.678704 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 222/452] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:40 2022] GET /identity/v3/groups/bd8d2e2be70a4fafb24ddf53fd8fbe0b => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:40.684371 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b7b8b-3d8c-45c1-9142-d4a58e617a3b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:40.688076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:40.703801 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2986bc6-5b7d-4d36-bd71-b0117b5c0fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:40.704654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2986bc6-5b7d-4d36-bd71-b0117b5c0fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:40.704964 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2986bc6-5b7d-4d36-bd71-b0117b5c0fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:40.705242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2986bc6-5b7d-4d36-bd71-b0117b5c0fc4 None admin] PATH_INFO: `/v3/groups/48bd262a9f53459dac117dc8de9dce6b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:40.706426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2986bc6-5b7d-4d36-bd71-b0117b5c0fc4 None admin] RBAC: Authorizing `identity:get_group(group_id=48bd262a9f53459dac117dc8de9dce6b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:40.708531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2986bc6-5b7d-4d36-bd71-b0117b5c0fc4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:40.710280 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 231/453] 10.222.0.39 () {56 vars in 1180 bytes} [Thu May 26 12:18:40 2022] GET /identity/v3/groups/48bd262a9f53459dac117dc8de9dce6b => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:40.718032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2986bc6-5b7d-4d36-bd71-b0117b5c0fc4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:40.788208 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b7b8b-3d8c-45c1-9142-d4a58e617a3b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:40.797305 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:40.818485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2986bc6-5b7d-4d36-bd71-b0117b5c0fc4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:40.822030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5860f-3243-4d8d-b495-782f279d925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:40.822686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5860f-3243-4d8d-b495-782f279d925a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:40.822973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5860f-3243-4d8d-b495-782f279d925a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:40.823252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5860f-3243-4d8d-b495-782f279d925a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:40.824092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5860f-3243-4d8d-b495-782f279d925a None admin] RBAC: Adding query filter params (group.id=bd8d2e2be70a4fafb24ddf53fd8fbe0b, role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=051f7e40d662400dae586acf29916006) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:40.824408 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5860f-3243-4d8d-b495-782f279d925a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:40.825882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5860f-3243-4d8d-b495-782f279d925a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:40.831687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 223/454] 10.222.0.39 () {56 vars in 1376 bytes} [Thu May 26 12:18:40 2022] GET /identity/v3/role_assignments?group.id=bd8d2e2be70a4fafb24ddf53fd8fbe0b&scope.project.id=051f7e40d662400dae586acf29916006&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:40.854878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a627a13-e017-4f96-bfa3-21375b1d6ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:40.855554 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627a13-e017-4f96-bfa3-21375b1d6ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:40.855844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627a13-e017-4f96-bfa3-21375b1d6ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:40.856121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a627a13-e017-4f96-bfa3-21375b1d6ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:40.857006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a627a13-e017-4f96-bfa3-21375b1d6ed0 None admin] RBAC: Adding query filter params (group.id=48bd262a9f53459dac117dc8de9dce6b, role.id=512083f4095a4f23a8dd4e8789fa20b3, scope.project.id=6252742811f240f8936cf0519e7401b8) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:40.857324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a627a13-e017-4f96-bfa3-21375b1d6ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:40.858815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a627a13-e017-4f96-bfa3-21375b1d6ed0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:40.865813 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 232/455] 10.222.0.39 () {56 vars in 1376 bytes} [Thu May 26 12:18:40 2022] GET /identity/v3/role_assignments?group.id=48bd262a9f53459dac117dc8de9dce6b&scope.project.id=6252742811f240f8936cf0519e7401b8&role.id=512083f4095a4f23a8dd4e8789fa20b3 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:43.621065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db55123-287f-4533-8e34-faf7f4664771 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:43.621579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db55123-287f-4533-8e34-faf7f4664771 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:43.621655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db55123-287f-4533-8e34-faf7f4664771 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:43.623261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 224/456] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:43.628174 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3915a45-4b35-47af-8ab3-345b56d74597 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:43.628567 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3915a45-4b35-47af-8ab3-345b56d74597 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:43.628754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3915a45-4b35-47af-8ab3-345b56d74597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:43.658095 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a3915a45-4b35-47af-8ab3-345b56d74597 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:43.659300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a3915a45-4b35-47af-8ab3-345b56d74597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:43.755262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 233/457] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:43.797377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db55123-287f-4533-8e34-faf7f4664771 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:43.915683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:43.967051 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db55123-287f-4533-8e34-faf7f4664771 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:44.018150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc518cf-4982-4fcd-8f1d-9a94965ac709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:44.019450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc518cf-4982-4fcd-8f1d-9a94965ac709 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:44.019938 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc518cf-4982-4fcd-8f1d-9a94965ac709 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:44.020480 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc518cf-4982-4fcd-8f1d-9a94965ac709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:44.038885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc518cf-4982-4fcd-8f1d-9a94965ac709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:44.040691 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc518cf-4982-4fcd-8f1d-9a94965ac709 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-7cc518cf-4982-4fcd-8f1d-9a94965ac709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:44.065866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:44.066800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:44.068386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:44.068386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:44.068386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:44.068386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:44.070674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 225/458] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:44.076085 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3915a45-4b35-47af-8ab3-345b56d74597 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:44.195419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:44.229277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0f743-2b9f-4fa8-b103-9ae9117fddc9 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:44.229921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0f743-2b9f-4fa8-b103-9ae9117fddc9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:44.230582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0f743-2b9f-4fa8-b103-9ae9117fddc9 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:44.232526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 226/459] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:44.236208 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3915a45-4b35-47af-8ab3-345b56d74597 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:44.237842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a232ba-3dce-4eb0-b01d-064bd45e61f6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:44.238339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a232ba-3dce-4eb0-b01d-064bd45e61f6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:44.238851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a232ba-3dce-4eb0-b01d-064bd45e61f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:44.257615 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-85a232ba-3dce-4eb0-b01d-064bd45e61f6 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:44.258791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-85a232ba-3dce-4eb0-b01d-064bd45e61f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:44.276685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d10dd1-1c02-4038-a962-40ec76f41c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:44.277772 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d10dd1-1c02-4038-a962-40ec76f41c06 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:44.278058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d10dd1-1c02-4038-a962-40ec76f41c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:44.278337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d10dd1-1c02-4038-a962-40ec76f41c06 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:44.279071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d10dd1-1c02-4038-a962-40ec76f41c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:44.279384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d10dd1-1c02-4038-a962-40ec76f41c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:44.281337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d10dd1-1c02-4038-a962-40ec76f41c06 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:44.299349 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 234/460] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:44.300874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9c8fb-1fff-4740-941d-4dbddf9ea5d3 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:44.301174 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9c8fb-1fff-4740-941d-4dbddf9ea5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:44.301560 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9c8fb-1fff-4740-941d-4dbddf9ea5d3 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:44.303317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 235/461] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:44.305593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9c8fb-1fff-4740-941d-4dbddf9ea5d3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:44.341865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 227/462] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:44.343164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208dd1f-2e80-4afe-8a51-14bd2a0555cc None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:44.343452 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208dd1f-2e80-4afe-8a51-14bd2a0555cc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:44.343727 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208dd1f-2e80-4afe-8a51-14bd2a0555cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:44.360869 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8208dd1f-2e80-4afe-8a51-14bd2a0555cc None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:44.362051 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8208dd1f-2e80-4afe-8a51-14bd2a0555cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:44.432746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:44.462486 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 228/463] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:44.463564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208dd1f-2e80-4afe-8a51-14bd2a0555cc None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:44.465540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9c8fb-1fff-4740-941d-4dbddf9ea5d3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:44.510875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:44.519077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af213e-feba-42c5-a897-28d909e05265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:44.519760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af213e-feba-42c5-a897-28d909e05265 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:44.520539 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af213e-feba-42c5-a897-28d909e05265 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:44.521064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af213e-feba-42c5-a897-28d909e05265 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:44.521845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af213e-feba-42c5-a897-28d909e05265 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:44.523900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af213e-feba-42c5-a897-28d909e05265 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:44.550606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 236/464] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:18:44 2022] POST /identity/v3/users => generated 246 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:18:44.552040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af213e-feba-42c5-a897-28d909e05265 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:44.587406 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208dd1f-2e80-4afe-8a51-14bd2a0555cc None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:44.627351 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b7b87-a527-4fb1-907d-8ce5983625c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:44.628166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b7b87-a527-4fb1-907d-8ce5983625c5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:44.628613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b7b87-a527-4fb1-907d-8ce5983625c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:44.629062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b7b87-a527-4fb1-907d-8ce5983625c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:44.642784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b7b87-a527-4fb1-907d-8ce5983625c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:44.644496 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b7b87-a527-4fb1-907d-8ce5983625c5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-235b7b87-a527-4fb1-907d-8ce5983625c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:44.665833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:44.666767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:44.667667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:44.667667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:44.667667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:44.667667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:44.668874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 229/465] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:44.670424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b4dee-9c5e-4cbc-b166-02e8fadeac42 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:44.671996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b4dee-9c5e-4cbc-b166-02e8fadeac42 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:44.672439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b4dee-9c5e-4cbc-b166-02e8fadeac42 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:44.673988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 230/466] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:44.674584 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b4dee-9c5e-4cbc-b166-02e8fadeac42 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:44.696458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af213e-feba-42c5-a897-28d909e05265 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:44.720134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:44.743412 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf8bdd-c231-41e9-b7e8-a357d8f9f16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:44.744992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf8bdd-c231-41e9-b7e8-a357d8f9f16f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:44.745497 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf8bdd-c231-41e9-b7e8-a357d8f9f16f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:44.746015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf8bdd-c231-41e9-b7e8-a357d8f9f16f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:44.761098 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf8bdd-c231-41e9-b7e8-a357d8f9f16f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:44.762836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf8bdd-c231-41e9-b7e8-a357d8f9f16f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b5cf8bdd-c231-41e9-b7e8-a357d8f9f16f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:44.785246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:44.786671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:44.787952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:44.787952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:44.787952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:44.787952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:44.787952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 237/467] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:44.788478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb589-0504-4bc4-9edd-33f1bbff4dd5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:44.788815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb589-0504-4bc4-9edd-33f1bbff4dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:44.789111 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb589-0504-4bc4-9edd-33f1bbff4dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:44.809372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-804bb589-0504-4bc4-9edd-33f1bbff4dd5 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:44.810969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-804bb589-0504-4bc4-9edd-33f1bbff4dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:44.831278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b4dee-9c5e-4cbc-b166-02e8fadeac42 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:44.866156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:44.888152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d82e3-6e53-46ad-aee4-e5ce6e1d95a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:44.889569 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d82e3-6e53-46ad-aee4-e5ce6e1d95a0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:44.890343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d82e3-6e53-46ad-aee4-e5ce6e1d95a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:44.890785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d82e3-6e53-46ad-aee4-e5ce6e1d95a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:44.892111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d82e3-6e53-46ad-aee4-e5ce6e1d95a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:44.892975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d82e3-6e53-46ad-aee4-e5ce6e1d95a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:44.894945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d82e3-6e53-46ad-aee4-e5ce6e1d95a0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:44.903306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 238/468] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:44.904285 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bb589-0504-4bc4-9edd-33f1bbff4dd5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:44.915983 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 231/469] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:44.917490 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d82e3-6e53-46ad-aee4-e5ce6e1d95a0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:45.021175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bb589-0504-4bc4-9edd-33f1bbff4dd5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:45.024889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:45.035498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d82e3-6e53-46ad-aee4-e5ce6e1d95a0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:45.058579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118a223-9df2-48dc-b8f5-7d53c4400779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:45.059420 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118a223-9df2-48dc-b8f5-7d53c4400779 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:45.059530 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118a223-9df2-48dc-b8f5-7d53c4400779 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:45.059786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118a223-9df2-48dc-b8f5-7d53c4400779 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:45.060507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118a223-9df2-48dc-b8f5-7d53c4400779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:45.060851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118a223-9df2-48dc-b8f5-7d53c4400779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:45.062240 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118a223-9df2-48dc-b8f5-7d53c4400779 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:45.078345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 239/470] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:45.078345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d042ef-559e-44a2-a634-222c337e7abb None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:45.078345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d042ef-559e-44a2-a634-222c337e7abb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:45.078345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d042ef-559e-44a2-a634-222c337e7abb None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:45.078345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 240/471] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:45.078345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d042ef-559e-44a2-a634-222c337e7abb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:45.082002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235fcbd-6b85-4de9-84cb-334b2ae8b3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:45.084109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235fcbd-6b85-4de9-84cb-334b2ae8b3f5 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:45.084109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235fcbd-6b85-4de9-84cb-334b2ae8b3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:45.084109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235fcbd-6b85-4de9-84cb-334b2ae8b3f5 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:45.084671 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235fcbd-6b85-4de9-84cb-334b2ae8b3f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:45.086178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235fcbd-6b85-4de9-84cb-334b2ae8b3f5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:45.107560 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 232/472] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:18:44 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:18:45.113091 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:45.115244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235fcbd-6b85-4de9-84cb-334b2ae8b3f5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:45.229746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d042ef-559e-44a2-a634-222c337e7abb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:45.243483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235fcbd-6b85-4de9-84cb-334b2ae8b3f5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:45.282187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2171d07-e49d-4e6e-9c9f-30b613b6765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:45.282896 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2171d07-e49d-4e6e-9c9f-30b613b6765d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:45.283210 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2171d07-e49d-4e6e-9c9f-30b613b6765d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:45.283483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2171d07-e49d-4e6e-9c9f-30b613b6765d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:45.289298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284dca-0708-4271-8073-734b36464ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:45.290398 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284dca-0708-4271-8073-734b36464ca8 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:45.290873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284dca-0708-4271-8073-734b36464ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:45.291155 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284dca-0708-4271-8073-734b36464ca8 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:45.291939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284dca-0708-4271-8073-734b36464ca8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:45.293456 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284dca-0708-4271-8073-734b36464ca8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:45.302812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2171d07-e49d-4e6e-9c9f-30b613b6765d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:45.305368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2171d07-e49d-4e6e-9c9f-30b613b6765d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:45.320924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 233/473] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:18:45 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:18:45.322501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b539a-d766-4161-aaec-2a553a267b62 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:45.322990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b539a-d766-4161-aaec-2a553a267b62 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:45.323487 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b539a-d766-4161-aaec-2a553a267b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:45.329779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e2171d07-e49d-4e6e-9c9f-30b613b6765d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:45.334071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:45.334954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:45.335799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:45.335799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:45.335799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:45.335799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:45.337377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 241/474] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:45.341251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2171d07-e49d-4e6e-9c9f-30b613b6765d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:45.350030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-984b539a-d766-4161-aaec-2a553a267b62 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:45.351345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-984b539a-d766-4161-aaec-2a553a267b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:45.438618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 234/475] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:45.443785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:45.462266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b539a-d766-4161-aaec-2a553a267b62 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:45.464295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2171d07-e49d-4e6e-9c9f-30b613b6765d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:45.502418 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3c2e6-922a-4f7b-afc2-9138a16c49ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:45.503107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3c2e6-922a-4f7b-afc2-9138a16c49ee None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:45.503394 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3c2e6-922a-4f7b-afc2-9138a16c49ee None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:45.503675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3c2e6-922a-4f7b-afc2-9138a16c49ee None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:45.504974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3c2e6-922a-4f7b-afc2-9138a16c49ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:45.505491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3c2e6-922a-4f7b-afc2-9138a16c49ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:45.507049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3c2e6-922a-4f7b-afc2-9138a16c49ee None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:45.522615 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 242/476] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:45.528559 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3c2e6-922a-4f7b-afc2-9138a16c49ee None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:45.598957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b539a-d766-4161-aaec-2a553a267b62 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:45.646382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3c2e6-922a-4f7b-afc2-9138a16c49ee None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:45.646992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaea34b-1d09-46e9-baae-9460df32cfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:45.648429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaea34b-1d09-46e9-baae-9460df32cfb7 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:45.649392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaea34b-1d09-46e9-baae-9460df32cfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:45.649392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaea34b-1d09-46e9-baae-9460df32cfb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:45.651583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaea34b-1d09-46e9-baae-9460df32cfb7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:45.651583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaea34b-1d09-46e9-baae-9460df32cfb7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:45.658836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:45.668451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.sql.core [None req-1eaea34b-1d09-46e9-baae-9460df32cfb7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:18:45.668451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 12:18:45.668451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [parameters: {'id': 'bab98e519b0b46f1a21f3b35146859b6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 12:18:45.668451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80140) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-1eaea34b-1d09-46e9-baae-9460df32cfb7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application conn.query(q) May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application result.read() May 26 12:18:45.684599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return ref.to_dict() May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:18:45.685515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application next(self.gen) May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application yield resource May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application next(self.gen) May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise self.value May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application session.commit() May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:18:45.686410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.session.flush() May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application compat.raise_( May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:18:45.687284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:18:45.688205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application conn.query(q) May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application result.read() May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:18:45.689062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [parameters: {'id': 'bab98e519b0b46f1a21f3b35146859b6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:45.689846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 12:18:45.690640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:45.691556 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 235/477] 10.222.0.39 () {60 vars in 1131 bytes} [Thu May 26 12:18:45 2022] POST /identity/v3/roles => generated 144 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:45.693611 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaea34b-1d09-46e9-baae-9460df32cfb7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:45.704493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b11ba7-1f4d-41b4-80cd-605bdfa9e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:45.705762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b11ba7-1f4d-41b4-80cd-605bdfa9e84f None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:45.706223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b11ba7-1f4d-41b4-80cd-605bdfa9e84f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:45.706663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b11ba7-1f4d-41b4-80cd-605bdfa9e84f None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:45.707532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b11ba7-1f4d-41b4-80cd-605bdfa9e84f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:45.709895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b11ba7-1f4d-41b4-80cd-605bdfa9e84f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:45.729129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:45.740992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 243/478] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:18:45 2022] POST /identity/v3/users => generated 249 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:18:45.834860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaea34b-1d09-46e9-baae-9460df32cfb7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:45.892257 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec9515-b1fc-440f-9ca8-19f3471284f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:45.893128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec9515-b1fc-440f-9ca8-19f3471284f6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:45.893414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec9515-b1fc-440f-9ca8-19f3471284f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:45.893692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec9515-b1fc-440f-9ca8-19f3471284f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:45.912791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec9515-b1fc-440f-9ca8-19f3471284f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-5cec9515-b1fc-440f-9ca8-19f3471284f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:45.921589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:45.922570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:45.923377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:45.923377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:45.923377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:45.923377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:45.923377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:45.923377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:45.923377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:45.923377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:45.923377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:45.923377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:45.923377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:18:45.923377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:45.923377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 236/479] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:18:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:45.929543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b11ba7-1f4d-41b4-80cd-605bdfa9e84f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:46.061133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b11ba7-1f4d-41b4-80cd-605bdfa9e84f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:46.095807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73e448-a33e-4dee-9ca4-e19f5136621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:46.096498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73e448-a33e-4dee-9ca4-e19f5136621f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:46.096807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73e448-a33e-4dee-9ca4-e19f5136621f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:46.097093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73e448-a33e-4dee-9ca4-e19f5136621f None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:46.097856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73e448-a33e-4dee-9ca4-e19f5136621f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:46.098173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73e448-a33e-4dee-9ca4-e19f5136621f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:46.099663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73e448-a33e-4dee-9ca4-e19f5136621f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:46.108949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 244/480] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:47.231325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3904e-dc71-478e-b71f-057b388962b0 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:47.231841 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3904e-dc71-478e-b71f-057b388962b0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:47.231917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3904e-dc71-478e-b71f-057b388962b0 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:47.233577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 237/481] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:47.238417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528a721-c601-40c6-bbef-f9a6cfb7d9f9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:47.238871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528a721-c601-40c6-bbef-f9a6cfb7d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:47.239620 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528a721-c601-40c6-bbef-f9a6cfb7d9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:47.265710 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5528a721-c601-40c6-bbef-f9a6cfb7d9f9 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:47.267197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5528a721-c601-40c6-bbef-f9a6cfb7d9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:47.342803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:47.354505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 245/482] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:18:47.386036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3904e-dc71-478e-b71f-057b388962b0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:47.470276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:47.528366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3904e-dc71-478e-b71f-057b388962b0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:47.576272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847b617-5aec-4f24-8973-6b485e5616a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:47.577105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847b617-5aec-4f24-8973-6b485e5616a6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:47.577390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847b617-5aec-4f24-8973-6b485e5616a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:47.577667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847b617-5aec-4f24-8973-6b485e5616a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:47.594819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847b617-5aec-4f24-8973-6b485e5616a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-3847b617-5aec-4f24-8973-6b485e5616a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:47.602937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:47.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:47.604629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:47.604629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:47.604629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:47.604629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:47.604629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:47.604629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:47.604629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:47.604629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:47.604629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:47.604629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:47.604629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:47.604629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:47.604629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 238/483] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:18:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:47.609813 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528a721-c601-40c6-bbef-f9a6cfb7d9f9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:47.762873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528a721-c601-40c6-bbef-f9a6cfb7d9f9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:47.813800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c1ebf-3da6-4c91-b635-891c8364247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:47.814403 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c1ebf-3da6-4c91-b635-891c8364247b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:47.814691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c1ebf-3da6-4c91-b635-891c8364247b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:47.814967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c1ebf-3da6-4c91-b635-891c8364247b None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:47.815726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c1ebf-3da6-4c91-b635-891c8364247b None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:47.816036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c1ebf-3da6-4c91-b635-891c8364247b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:47.818356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c1ebf-3da6-4c91-b635-891c8364247b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:47.832251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 246/484] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:18:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:47.837700 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847b617-5aec-4f24-8973-6b485e5616a6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:48.003444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847b617-5aec-4f24-8973-6b485e5616a6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:48.027409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:48.054380 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655cf3e-7b9e-4209-affd-f26cf9186273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:48.055198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655cf3e-7b9e-4209-affd-f26cf9186273 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:48.055483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655cf3e-7b9e-4209-affd-f26cf9186273 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:48.055764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655cf3e-7b9e-4209-affd-f26cf9186273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:48.074886 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655cf3e-7b9e-4209-affd-f26cf9186273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:48.076340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655cf3e-7b9e-4209-affd-f26cf9186273 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-5655cf3e-7b9e-4209-affd-f26cf9186273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:48.100346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:48.101276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:48.102115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:48.102115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:48.102115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:48.102115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:48.102115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 239/485] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:48.106698 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655cf3e-7b9e-4209-affd-f26cf9186273 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:48.106814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe1f2d-0ba1-4e32-bf82-18ebfb513ab5 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:48.107006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe1f2d-0ba1-4e32-bf82-18ebfb513ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:48.107626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe1f2d-0ba1-4e32-bf82-18ebfb513ab5 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:48.110507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 247/486] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:48.115543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113879fe-bf07-4f3f-b171-beb909d60a52 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:48.115836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113879fe-bf07-4f3f-b171-beb909d60a52 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:48.116121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113879fe-bf07-4f3f-b171-beb909d60a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:48.139062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-113879fe-bf07-4f3f-b171-beb909d60a52 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:48.140263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-113879fe-bf07-4f3f-b171-beb909d60a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:48.239549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:48.278038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 248/487] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:18:48.289086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655cf3e-7b9e-4209-affd-f26cf9186273 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:48.309784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113879fe-bf07-4f3f-b171-beb909d60a52 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:48.347242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03d053-62b5-4397-9c7a-4c821f0938bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:48.347840 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03d053-62b5-4397-9c7a-4c821f0938bb None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:48.348129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03d053-62b5-4397-9c7a-4c821f0938bb None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:48.348485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03d053-62b5-4397-9c7a-4c821f0938bb None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:48.349250 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03d053-62b5-4397-9c7a-4c821f0938bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:48.349566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03d053-62b5-4397-9c7a-4c821f0938bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:48.351017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03d053-62b5-4397-9c7a-4c821f0938bb None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:48.372193 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 240/488] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:48.377458 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03d053-62b5-4397-9c7a-4c821f0938bb None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:48.418000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113879fe-bf07-4f3f-b171-beb909d60a52 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:48.440160 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:48.456984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114d330-56ca-491e-8b30-5696be86003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:48.458388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114d330-56ca-491e-8b30-5696be86003c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:48.458901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114d330-56ca-491e-8b30-5696be86003c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:48.459237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114d330-56ca-491e-8b30-5696be86003c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:48.470805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114d330-56ca-491e-8b30-5696be86003c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-d114d330-56ca-491e-8b30-5696be86003c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:48.479347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:48.480310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:48.481516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:48.481516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:48.481516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:48.481516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:48.481516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:48.481516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:48.481516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:48.481516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:48.481516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:48.481516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:48.481516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:48.481516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:48.485376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 249/489] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:18:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:48.486717 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b004f-b441-4312-8113-7b9d1fb142ae None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:48.487428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b004f-b441-4312-8113-7b9d1fb142ae None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:48.487428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b004f-b441-4312-8113-7b9d1fb142ae None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:48.492928 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 250/490] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:48.492928 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b004f-b441-4312-8113-7b9d1fb142ae None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:48.530300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03d053-62b5-4397-9c7a-4c821f0938bb None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:48.558400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:48.576424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccb56f-5e14-4182-8ceb-e118a773b2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:48.578230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccb56f-5e14-4182-8ceb-e118a773b2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:48.578750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccb56f-5e14-4182-8ceb-e118a773b2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:48.579481 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccb56f-5e14-4182-8ceb-e118a773b2c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:48.590355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccb56f-5e14-4182-8ceb-e118a773b2c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:48.592303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccb56f-5e14-4182-8ceb-e118a773b2c2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-abccb56f-5e14-4182-8ceb-e118a773b2c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:18:48.613655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:48.614719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:48.615616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:48.615616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:48.615616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:18:48.615616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:18:48.615616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:18:48.615616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:18:48.615616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:18:48.615616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:18:48.615616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:18:48.615616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:48.619051 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 241/491] 10.222.0.39 () {56 vars in 1093 bytes} [Thu May 26 12:18:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:48.621297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e4bd3-1878-4a91-a1bd-b56e920524dc None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:48.621897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e4bd3-1878-4a91-a1bd-b56e920524dc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:48.622355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e4bd3-1878-4a91-a1bd-b56e920524dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:48.624836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b004f-b441-4312-8113-7b9d1fb142ae None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:48.646558 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e97e4bd3-1878-4a91-a1bd-b56e920524dc None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:48.648143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e97e4bd3-1878-4a91-a1bd-b56e920524dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:48.667093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654897fb-11f4-4257-98a0-6bd9b5138b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:48.667963 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654897fb-11f4-4257-98a0-6bd9b5138b64 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:48.668318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654897fb-11f4-4257-98a0-6bd9b5138b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:48.668672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654897fb-11f4-4257-98a0-6bd9b5138b64 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:48.669525 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654897fb-11f4-4257-98a0-6bd9b5138b64 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:48.669906 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654897fb-11f4-4257-98a0-6bd9b5138b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:48.671371 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654897fb-11f4-4257-98a0-6bd9b5138b64 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:48.681138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 251/492] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:18:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:48.686372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654897fb-11f4-4257-98a0-6bd9b5138b64 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:48.748518 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 242/493] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:48.748518 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e4bd3-1878-4a91-a1bd-b56e920524dc None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:48.781341 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:48.827950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654897fb-11f4-4257-98a0-6bd9b5138b64 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:48.830846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:48.866205 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89c88c-f566-4361-8d80-62855d3b2c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:48.866798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89c88c-f566-4361-8d80-62855d3b2c58 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:48.867082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89c88c-f566-4361-8d80-62855d3b2c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:48.867358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89c88c-f566-4361-8d80-62855d3b2c58 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:48.868199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89c88c-f566-4361-8d80-62855d3b2c58 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:48.868511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89c88c-f566-4361-8d80-62855d3b2c58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:48.870010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89c88c-f566-4361-8d80-62855d3b2c58 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:48.871373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e4bd3-1878-4a91-a1bd-b56e920524dc None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:48.915683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 252/494] 10.222.0.39 () {56 vars in 1133 bytes} [Thu May 26 12:18:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:48.915683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89c88c-f566-4361-8d80-62855d3b2c58 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:48.918141 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cdc4a-1b23-4d0e-9ab5-63e9562542bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:48.918577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cdc4a-1b23-4d0e-9ab5-63e9562542bd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:48.918861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cdc4a-1b23-4d0e-9ab5-63e9562542bd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:48.919137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cdc4a-1b23-4d0e-9ab5-63e9562542bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:48.932047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cdc4a-1b23-4d0e-9ab5-63e9562542bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:48.934001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cdc4a-1b23-4d0e-9ab5-63e9562542bd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-412cdc4a-1b23-4d0e-9ab5-63e9562542bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:48.953129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:48.954026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:48.954864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:48.954864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:48.954864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:48.954864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:48.954864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 243/495] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:48.955563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f0f51-ac5f-4ad6-8e1e-9766c71f96ca None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:48.955847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f0f51-ac5f-4ad6-8e1e-9766c71f96ca None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:48.956127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f0f51-ac5f-4ad6-8e1e-9766c71f96ca None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:48.957717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 244/496] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:48.958425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f0f51-ac5f-4ad6-8e1e-9766c71f96ca None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:49.026711 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89c88c-f566-4361-8d80-62855d3b2c58 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:49.033137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:49.060876 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2255c5d-e2b3-49bd-a042-423f8e260308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:49.061677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2255c5d-e2b3-49bd-a042-423f8e260308 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:49.061972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2255c5d-e2b3-49bd-a042-423f8e260308 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:49.062251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2255c5d-e2b3-49bd-a042-423f8e260308 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:49.063442 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f0f51-ac5f-4ad6-8e1e-9766c71f96ca None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:49.072315 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2255c5d-e2b3-49bd-a042-423f8e260308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f2255c5d-e2b3-49bd-a042-423f8e260308 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:49.079998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:49.080967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:49.081860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:49.081860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:49.081860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:49.081860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:49.081860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:49.081860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:49.081860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:49.081860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:49.081860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:49.081860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:49.081860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:49.081860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:49.081860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 253/497] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:18:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:49.082523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63993356-fdfd-4576-872a-c127871edb04 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:49.083184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63993356-fdfd-4576-872a-c127871edb04 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:49.083463 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63993356-fdfd-4576-872a-c127871edb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:49.099324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-63993356-fdfd-4576-872a-c127871edb04 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:49.100518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-63993356-fdfd-4576-872a-c127871edb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:49.103312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfe1a0-bce3-4cbb-8add-7513b3188790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:49.103961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe1a0-bce3-4cbb-8add-7513b3188790 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:49.104239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe1a0-bce3-4cbb-8add-7513b3188790 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:49.104513 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe1a0-bce3-4cbb-8add-7513b3188790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:49.117161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:49.168208 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 254/498] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:49.169162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63993356-fdfd-4576-872a-c127871edb04 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:49.185505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfe1a0-bce3-4cbb-8add-7513b3188790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:49.186978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfe1a0-bce3-4cbb-8add-7513b3188790 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:49.257267 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:49.269047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63993356-fdfd-4576-872a-c127871edb04 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:49.288699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 245/499] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:49.290111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc22701-e332-41c3-85fa-d4f6129e9553 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:49.290614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc22701-e332-41c3-85fa-d4f6129e9553 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:49.290686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc22701-e332-41c3-85fa-d4f6129e9553 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:49.292890 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 246/500] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:49.292890 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc22701-e332-41c3-85fa-d4f6129e9553 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:49.304901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98884303-933b-4cdf-b2b9-204beea15786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:49.305569 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98884303-933b-4cdf-b2b9-204beea15786 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:49.305854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98884303-933b-4cdf-b2b9-204beea15786 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:49.306132 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98884303-933b-4cdf-b2b9-204beea15786 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:49.306865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98884303-933b-4cdf-b2b9-204beea15786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:49.307177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98884303-933b-4cdf-b2b9-204beea15786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:49.308571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98884303-933b-4cdf-b2b9-204beea15786 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:49.324479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 255/501] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:49.324479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98884303-933b-4cdf-b2b9-204beea15786 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:49.335973 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:49.397991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc22701-e332-41c3-85fa-d4f6129e9553 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:49.420149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98884303-933b-4cdf-b2b9-204beea15786 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:49.430335 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200138d7-0376-415d-9bd8-5a5c899eecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:49.431004 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200138d7-0376-415d-9bd8-5a5c899eecd0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:49.431288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200138d7-0376-415d-9bd8-5a5c899eecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:49.431562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200138d7-0376-415d-9bd8-5a5c899eecd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:49.432311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200138d7-0376-415d-9bd8-5a5c899eecd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:49.432619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200138d7-0376-415d-9bd8-5a5c899eecd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:49.434016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200138d7-0376-415d-9bd8-5a5c899eecd0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:49.441843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 247/502] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:18:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:49.443105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200138d7-0376-415d-9bd8-5a5c899eecd0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:49.457135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d552888-6358-4a17-ad57-ca588e348615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:49.458652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d552888-6358-4a17-ad57-ca588e348615 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:49.459126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d552888-6358-4a17-ad57-ca588e348615 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:49.459405 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d552888-6358-4a17-ad57-ca588e348615 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:49.469617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d552888-6358-4a17-ad57-ca588e348615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:49.476360 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-7d552888-6358-4a17-ad57-ca588e348615 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:49.477229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:49.478856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 256/503] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:18:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:49.479915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f306b-df37-4fd7-a7d4-e141434b54c5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:49.480617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f306b-df37-4fd7-a7d4-e141434b54c5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:49.480617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f306b-df37-4fd7-a7d4-e141434b54c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:49.496389 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1f7f306b-df37-4fd7-a7d4-e141434b54c5 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:49.497625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1f7f306b-df37-4fd7-a7d4-e141434b54c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:49.544976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200138d7-0376-415d-9bd8-5a5c899eecd0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:49.563689 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 257/504] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:49.564347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f306b-df37-4fd7-a7d4-e141434b54c5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:49.566490 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:49.579469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35cde9-ac91-46eb-a6ca-20c0a750c0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:49.580259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35cde9-ac91-46eb-a6ca-20c0a750c0ef None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:49.580546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35cde9-ac91-46eb-a6ca-20c0a750c0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:49.580942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35cde9-ac91-46eb-a6ca-20c0a750c0ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:49.593000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35cde9-ac91-46eb-a6ca-20c0a750c0ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:49.594449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35cde9-ac91-46eb-a6ca-20c0a750c0ef None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0b35cde9-ac91-46eb-a6ca-20c0a750c0ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:49.611517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:49.612447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:49.613349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:49.613349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:49.613349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:49.613349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:49.613349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 248/505] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:49.613612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35cde9-ac91-46eb-a6ca-20c0a750c0ef None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:49.675171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f306b-df37-4fd7-a7d4-e141434b54c5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:49.704343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:49.710529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915ebe7-9fb0-4ddc-b432-009ff26f78ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:49.711328 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915ebe7-9fb0-4ddc-b432-009ff26f78ab None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:49.711612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915ebe7-9fb0-4ddc-b432-009ff26f78ab None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:49.711919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915ebe7-9fb0-4ddc-b432-009ff26f78ab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:49.719121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915ebe7-9fb0-4ddc-b432-009ff26f78ab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:49.720089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35cde9-ac91-46eb-a6ca-20c0a750c0ef None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:49.720597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915ebe7-9fb0-4ddc-b432-009ff26f78ab None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-d915ebe7-9fb0-4ddc-b432-009ff26f78ab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:18:49.736477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:49.737381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:49.738265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:49.738265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:49.738265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:18:49.738265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:18:49.738265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:18:49.738265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:18:49.738265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:18:49.738265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:18:49.738265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:18:49.738265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:49.738265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 258/506] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:49.739344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915ebe7-9fb0-4ddc-b432-009ff26f78ab None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:49.757873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779a79f-84b1-470a-aa16-09de9a61c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:49.758669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779a79f-84b1-470a-aa16-09de9a61c640 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:49.759173 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779a79f-84b1-470a-aa16-09de9a61c640 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:49.759282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779a79f-84b1-470a-aa16-09de9a61c640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:49.770454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779a79f-84b1-470a-aa16-09de9a61c640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:49.772375 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779a79f-84b1-470a-aa16-09de9a61c640 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-6779a79f-84b1-470a-aa16-09de9a61c640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:49.789885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:49.790962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:49.791810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:49.791810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:49.791810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:49.791810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:49.791810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 249/507] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:49.791810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779a79f-84b1-470a-aa16-09de9a61c640 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:49.804957 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:49.843553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915ebe7-9fb0-4ddc-b432-009ff26f78ab None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:49.878400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35239177-6aed-4d2a-8c75-77df6a1985dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:49.879223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35239177-6aed-4d2a-8c75-77df6a1985dc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:49.880087 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35239177-6aed-4d2a-8c75-77df6a1985dc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:49.880409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35239177-6aed-4d2a-8c75-77df6a1985dc None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:49.881332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35239177-6aed-4d2a-8c75-77df6a1985dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:49.881642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35239177-6aed-4d2a-8c75-77df6a1985dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:49.883039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35239177-6aed-4d2a-8c75-77df6a1985dc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:49.892779 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 259/508] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:18:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:49.893468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779a79f-84b1-470a-aa16-09de9a61c640 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:49.893593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35239177-6aed-4d2a-8c75-77df6a1985dc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:49.930759 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649b8a9-e302-4a9f-b82a-68fd1f76d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:49.931477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649b8a9-e302-4a9f-b82a-68fd1f76d615 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:49.931763 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649b8a9-e302-4a9f-b82a-68fd1f76d615 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:49.932037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649b8a9-e302-4a9f-b82a-68fd1f76d615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:49.938482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:49.944063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649b8a9-e302-4a9f-b82a-68fd1f76d615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:49.945743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649b8a9-e302-4a9f-b82a-68fd1f76d615 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-f649b8a9-e302-4a9f-b82a-68fd1f76d615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:49.962830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:49.963726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:49.964807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:49.964807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:49.964807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:49.964807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:49.964807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 250/509] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:49.964807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649b8a9-e302-4a9f-b82a-68fd1f76d615 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:49.996635 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35239177-6aed-4d2a-8c75-77df6a1985dc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:50.019280 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:50.030461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3eefa-c0c4-4c8c-a4be-01b26aa2e5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:50.031155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3eefa-c0c4-4c8c-a4be-01b26aa2e5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:50.031441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3eefa-c0c4-4c8c-a4be-01b26aa2e5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:50.031720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3eefa-c0c4-4c8c-a4be-01b26aa2e5d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:50.032440 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3eefa-c0c4-4c8c-a4be-01b26aa2e5d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:50.032779 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3eefa-c0c4-4c8c-a4be-01b26aa2e5d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:50.034171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3eefa-c0c4-4c8c-a4be-01b26aa2e5d8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:50.046226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 260/510] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:50.047014 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3eefa-c0c4-4c8c-a4be-01b26aa2e5d8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:50.064466 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649b8a9-e302-4a9f-b82a-68fd1f76d615 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:50.097961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ce200-9618-43f3-9377-d8f3da10c7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:50.098948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ce200-9618-43f3-9377-d8f3da10c7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:50.099248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ce200-9618-43f3-9377-d8f3da10c7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:50.099528 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ce200-9618-43f3-9377-d8f3da10c7b7 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:50.100369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ce200-9618-43f3-9377-d8f3da10c7b7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:50.100681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ce200-9618-43f3-9377-d8f3da10c7b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:50.102138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ce200-9618-43f3-9377-d8f3da10c7b7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:50.139011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 251/511] 10.222.0.39 () {56 vars in 1137 bytes} [Thu May 26 12:18:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:50.139835 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ce200-9618-43f3-9377-d8f3da10c7b7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:50.146104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3eefa-c0c4-4c8c-a4be-01b26aa2e5d8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:50.179409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc724c-99c8-4116-a175-f0cd14de5b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:50.180064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc724c-99c8-4116-a175-f0cd14de5b7b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:50.180351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc724c-99c8-4116-a175-f0cd14de5b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:50.180626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc724c-99c8-4116-a175-f0cd14de5b7b None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:50.181433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc724c-99c8-4116-a175-f0cd14de5b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:50.181686 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc724c-99c8-4116-a175-f0cd14de5b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:50.183066 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc724c-99c8-4116-a175-f0cd14de5b7b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:50.189047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:50.195287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 261/512] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:50.196083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc724c-99c8-4116-a175-f0cd14de5b7b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:50.240253 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ce200-9618-43f3-9377-d8f3da10c7b7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:50.240766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:50.275293 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5c4d0-a01c-46ee-ad52-7966b94c266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:50.276085 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5c4d0-a01c-46ee-ad52-7966b94c266e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:50.276368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5c4d0-a01c-46ee-ad52-7966b94c266e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:50.276644 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5c4d0-a01c-46ee-ad52-7966b94c266e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:50.286688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5c4d0-a01c-46ee-ad52-7966b94c266e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:50.288153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5c4d0-a01c-46ee-ad52-7966b94c266e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:50.295177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc724c-99c8-4116-a175-f0cd14de5b7b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-bff5c4d0-a01c-46ee-ad52-7966b94c266e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:50.306522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:50.307662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:50.308506 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:50.308506 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:50.308506 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:50.308506 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:50.308506 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 252/513] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:50.308802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5c4d0-a01c-46ee-ad52-7966b94c266e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:50.330912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf47baf-4819-498e-9015-02c28a393198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:50.331580 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf47baf-4819-498e-9015-02c28a393198 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:50.331868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf47baf-4819-498e-9015-02c28a393198 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:50.332149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf47baf-4819-498e-9015-02c28a393198 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:50.333033 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf47baf-4819-498e-9015-02c28a393198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:50.333343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf47baf-4819-498e-9015-02c28a393198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:50.334722 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf47baf-4819-498e-9015-02c28a393198 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:50.346597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 262/514] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:50.348367 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf47baf-4819-498e-9015-02c28a393198 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:50.410517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:50.414022 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5c4d0-a01c-46ee-ad52-7966b94c266e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:50.446643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf47baf-4819-498e-9015-02c28a393198 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:50.449317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b539f-1970-45fd-a04c-33273440cd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:50.449683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:50.450109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b539f-1970-45fd-a04c-33273440cd30 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:50.450398 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b539f-1970-45fd-a04c-33273440cd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:50.450675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b539f-1970-45fd-a04c-33273440cd30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:50.457434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b539f-1970-45fd-a04c-33273440cd30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:50.459422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b539f-1970-45fd-a04c-33273440cd30 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-195b539f-1970-45fd-a04c-33273440cd30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:18:50.475464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:50.476484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:50.477585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:18:50.477585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:18:50.477585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:18:50.477585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:18:50.477585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:18:50.477585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:18:50.477585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:50.477585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:50.477585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 253/515] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:50.477585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b539f-1970-45fd-a04c-33273440cd30 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:50.485046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf34ce-321b-4942-aa51-902fd4ba55d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:50.485739 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf34ce-321b-4942-aa51-902fd4ba55d9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:50.486029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf34ce-321b-4942-aa51-902fd4ba55d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:50.486307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf34ce-321b-4942-aa51-902fd4ba55d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:50.553725 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf34ce-321b-4942-aa51-902fd4ba55d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:50.555203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf34ce-321b-4942-aa51-902fd4ba55d9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:50.575871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b539f-1970-45fd-a04c-33273440cd30 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:50.609788 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cf94b-c3c7-4492-aec6-34310714f42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:50.610574 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cf94b-c3c7-4492-aec6-34310714f42d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:50.610865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cf94b-c3c7-4492-aec6-34310714f42d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:50.611164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cf94b-c3c7-4492-aec6-34310714f42d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:50.618718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cf94b-c3c7-4492-aec6-34310714f42d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:50.620170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94cf94b-c3c7-4492-aec6-34310714f42d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-d94cf94b-c3c7-4492-aec6-34310714f42d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:18:50.635301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:50.636209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:50.637182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:50.637182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:50.637182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:18:50.637182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:18:50.637182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:18:50.637182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:18:50.637182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:18:50.637182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:18:50.637182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:18:50.637182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:50.637182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 254/516] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:50.637760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cf94b-c3c7-4492-aec6-34310714f42d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:50.657123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 263/517] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:50.657944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf34ce-321b-4942-aa51-902fd4ba55d9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:50.661113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:50.666075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:50.745767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cf94b-c3c7-4492-aec6-34310714f42d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:50.756052 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf34ce-321b-4942-aa51-902fd4ba55d9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:50.782981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a132be0-5bd8-4fbf-aac9-57e5e4e9ef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:50.783642 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a132be0-5bd8-4fbf-aac9-57e5e4e9ef64 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:50.783921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a132be0-5bd8-4fbf-aac9-57e5e4e9ef64 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:50.784196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a132be0-5bd8-4fbf-aac9-57e5e4e9ef64 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:50.784943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a132be0-5bd8-4fbf-aac9-57e5e4e9ef64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:50.785254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a132be0-5bd8-4fbf-aac9-57e5e4e9ef64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:50.786756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a132be0-5bd8-4fbf-aac9-57e5e4e9ef64 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:50.790780 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffed4c-8e4f-466a-ae48-165e14d66aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:50.791448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffed4c-8e4f-466a-ae48-165e14d66aa2 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:50.791738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffed4c-8e4f-466a-ae48-165e14d66aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:50.792027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffed4c-8e4f-466a-ae48-165e14d66aa2 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:50.792763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffed4c-8e4f-466a-ae48-165e14d66aa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:50.794212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffed4c-8e4f-466a-ae48-165e14d66aa2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:50.798214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 255/518] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:50.798985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a132be0-5bd8-4fbf-aac9-57e5e4e9ef64 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:50.813438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 264/519] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:18:50 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:18:50.814250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffed4c-8e4f-466a-ae48-165e14d66aa2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:50.886193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:50.921072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:50.936193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffed4c-8e4f-466a-ae48-165e14d66aa2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:50.944228 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a132be0-5bd8-4fbf-aac9-57e5e4e9ef64 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:50.975707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7419ec-6497-41f5-9ec3-85f00c72a593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:50.976694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7419ec-6497-41f5-9ec3-85f00c72a593 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:50.977005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7419ec-6497-41f5-9ec3-85f00c72a593 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:50.977286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7419ec-6497-41f5-9ec3-85f00c72a593 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:50.978174 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7419ec-6497-41f5-9ec3-85f00c72a593 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:50.978467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7419ec-6497-41f5-9ec3-85f00c72a593 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:50.979969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7419ec-6497-41f5-9ec3-85f00c72a593 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:50.983601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037febb-054c-419b-b554-afdd31407990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:50.984558 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037febb-054c-419b-b554-afdd31407990 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:50.985075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037febb-054c-419b-b554-afdd31407990 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:50.985549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037febb-054c-419b-b554-afdd31407990 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:50.986570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037febb-054c-419b-b554-afdd31407990 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:50.987086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037febb-054c-419b-b554-afdd31407990 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:50.988773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037febb-054c-419b-b554-afdd31407990 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:50.999625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 265/520] 10.222.0.39 () {56 vars in 1137 bytes} [Thu May 26 12:18:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:51.000214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7419ec-6497-41f5-9ec3-85f00c72a593 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:51.013295 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 256/521] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:18:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:51.014166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037febb-054c-419b-b554-afdd31407990 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:51.111169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7419ec-6497-41f5-9ec3-85f00c72a593 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:51.128542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037febb-054c-419b-b554-afdd31407990 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:51.131039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:51.151145 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f86046-14a7-4401-9ead-9ebb73b631e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:51.151952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f86046-14a7-4401-9ead-9ebb73b631e7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:51.152237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f86046-14a7-4401-9ead-9ebb73b631e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:51.152518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f86046-14a7-4401-9ead-9ebb73b631e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:51.163376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f86046-14a7-4401-9ead-9ebb73b631e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:51.164924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f86046-14a7-4401-9ead-9ebb73b631e7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:51.169000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a9305-a7a0-4379-acce-ba4e0ac750e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:51.170022 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a9305-a7a0-4379-acce-ba4e0ac750e0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:51.170482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a9305-a7a0-4379-acce-ba4e0ac750e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:51.170932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a9305-a7a0-4379-acce-ba4e0ac750e0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:51.179853 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a9305-a7a0-4379-acce-ba4e0ac750e0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:51.181358 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a9305-a7a0-4379-acce-ba4e0ac750e0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c1f86046-14a7-4401-9ead-9ebb73b631e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:51.183911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:51.184902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:51.185818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:51.185818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:51.185818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:51.185818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:51.186028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:51.186105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 266/522] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:51.186470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f86046-14a7-4401-9ead-9ebb73b631e7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-590a9305-a7a0-4379-acce-ba4e0ac750e0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:18:51.199731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:51.200675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:51.201612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:51.201612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:51.201612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:18:51.201612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:18:51.201612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:18:51.201612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:18:51.201612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:18:51.201612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:18:51.201612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:18:51.201612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:51.207036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 257/523] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:18:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:51.207036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a9305-a7a0-4379-acce-ba4e0ac750e0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:51.295683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f86046-14a7-4401-9ead-9ebb73b631e7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:51.315543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a9305-a7a0-4379-acce-ba4e0ac750e0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:51.330902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaabd4f-1c15-43cd-821b-7328931fbd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:51.331670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaabd4f-1c15-43cd-821b-7328931fbd35 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:51.331960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaabd4f-1c15-43cd-821b-7328931fbd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:51.332237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaabd4f-1c15-43cd-821b-7328931fbd35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:51.357419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862a9c5-13e5-4b4f-8c3a-9c759fbbd484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:51.358096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862a9c5-13e5-4b4f-8c3a-9c759fbbd484 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:51.358382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862a9c5-13e5-4b4f-8c3a-9c759fbbd484 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:51.358664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862a9c5-13e5-4b4f-8c3a-9c759fbbd484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:51.359509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862a9c5-13e5-4b4f-8c3a-9c759fbbd484 None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=04f5fbbe45ec4dcf8301da8483af2941) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:51.359820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862a9c5-13e5-4b4f-8c3a-9c759fbbd484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:51.361310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862a9c5-13e5-4b4f-8c3a-9c759fbbd484 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:51.367958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 258/524] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:51 2022] GET /identity/v3/role_assignments?user.id=04f5fbbe45ec4dcf8301da8483af2941&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:51.368766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862a9c5-13e5-4b4f-8c3a-9c759fbbd484 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:51.386543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:51.430069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaabd4f-1c15-43cd-821b-7328931fbd35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:51.432586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaabd4f-1c15-43cd-821b-7328931fbd35 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:51.454188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:51.499729 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862a9c5-13e5-4b4f-8c3a-9c759fbbd484 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:51.540414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783ef27-1d7e-402c-b1bc-590dd266f10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:51.541144 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ef27-1d7e-402c-b1bc-590dd266f10f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:51.541434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ef27-1d7e-402c-b1bc-590dd266f10f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:51.541715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783ef27-1d7e-402c-b1bc-590dd266f10f None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:51.542470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783ef27-1d7e-402c-b1bc-590dd266f10f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:51.542787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783ef27-1d7e-402c-b1bc-590dd266f10f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:51.544196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783ef27-1d7e-402c-b1bc-590dd266f10f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:51.560045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 259/525] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:51.560929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783ef27-1d7e-402c-b1bc-590dd266f10f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:51.591112 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 267/526] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:51.592187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaabd4f-1c15-43cd-821b-7328931fbd35 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:51.684657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783ef27-1d7e-402c-b1bc-590dd266f10f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:51.689016 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:51.717097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:51.726678 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd320e5-27da-47e0-a8c9-50053ec8035b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:51.727361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd320e5-27da-47e0-a8c9-50053ec8035b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:51.727646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd320e5-27da-47e0-a8c9-50053ec8035b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:51.727926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd320e5-27da-47e0-a8c9-50053ec8035b None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:51.728801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd320e5-27da-47e0-a8c9-50053ec8035b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:51.729166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd320e5-27da-47e0-a8c9-50053ec8035b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:51.730591 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd320e5-27da-47e0-a8c9-50053ec8035b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:51.734822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaabd4f-1c15-43cd-821b-7328931fbd35 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:51.748789 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 260/527] 10.222.0.39 () {56 vars in 1139 bytes} [Thu May 26 12:18:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:51.749649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd320e5-27da-47e0-a8c9-50053ec8035b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:51.774307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543225c-9a7d-4dd5-a283-e26613670607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:51.775587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543225c-9a7d-4dd5-a283-e26613670607 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:51.776124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543225c-9a7d-4dd5-a283-e26613670607 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:51.776601 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543225c-9a7d-4dd5-a283-e26613670607 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:51.784671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543225c-9a7d-4dd5-a283-e26613670607 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:51.787085 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543225c-9a7d-4dd5-a283-e26613670607 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c543225c-9a7d-4dd5-a283-e26613670607 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:18:51.808960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:51.809871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:51.810762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:18:51.810762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:18:51.810762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:18:51.810762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:18:51.810762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:18:51.810762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:18:51.810762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:51.810762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:51.813663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 268/528] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:51.814881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543225c-9a7d-4dd5-a283-e26613670607 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:51.865165 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd320e5-27da-47e0-a8c9-50053ec8035b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:51.906969 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7843cf-625c-43e1-ae07-66a9f26e0a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:51.907779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7843cf-625c-43e1-ae07-66a9f26e0a23 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:51.908063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7843cf-625c-43e1-ae07-66a9f26e0a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:51.908337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7843cf-625c-43e1-ae07-66a9f26e0a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:51.920496 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7843cf-625c-43e1-ae07-66a9f26e0a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:51.922032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7843cf-625c-43e1-ae07-66a9f26e0a23 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:51.943124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543225c-9a7d-4dd5-a283-e26613670607 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-de7843cf-625c-43e1-ae07-66a9f26e0a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:51.950337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:51.951260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:51.952093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:51.952093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:51.952093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:51.952093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:51.957233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 261/529] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:51.958586 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7843cf-625c-43e1-ae07-66a9f26e0a23 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:51.980449 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:51.992104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ef9a0-54b4-4861-b9ab-b0f895bbe006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:51.993167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef9a0-54b4-4861-b9ab-b0f895bbe006 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:51.993658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef9a0-54b4-4861-b9ab-b0f895bbe006 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:51.994136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ef9a0-54b4-4861-b9ab-b0f895bbe006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:52.029140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:52.073497 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ef9a0-54b4-4861-b9ab-b0f895bbe006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:52.075307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ef9a0-54b4-4861-b9ab-b0f895bbe006 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:52.092431 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7843cf-625c-43e1-ae07-66a9f26e0a23 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:52.142751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30afc57-ec64-4510-ab47-40f72031c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:52.143434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30afc57-ec64-4510-ab47-40f72031c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:52.143723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30afc57-ec64-4510-ab47-40f72031c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:52.144009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30afc57-ec64-4510-ab47-40f72031c6a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:52.144860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30afc57-ec64-4510-ab47-40f72031c6a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:52.145735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30afc57-ec64-4510-ab47-40f72031c6a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:52.147336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30afc57-ec64-4510-ab47-40f72031c6a3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:52.166897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 262/530] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:18:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:52.167780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30afc57-ec64-4510-ab47-40f72031c6a3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:52.186289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 269/531] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:52.187544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ef9a0-54b4-4861-b9ab-b0f895bbe006 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:52.221058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:52.301272 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ef9a0-54b4-4861-b9ab-b0f895bbe006 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:52.304199 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:52.314870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30afc57-ec64-4510-ab47-40f72031c6a3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:52.339182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d55d05-8bd8-4be6-a8ed-c24222011fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:52.340218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d55d05-8bd8-4be6-a8ed-c24222011fff None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:52.340836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d55d05-8bd8-4be6-a8ed-c24222011fff None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:52.341313 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d55d05-8bd8-4be6-a8ed-c24222011fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:52.342395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d55d05-8bd8-4be6-a8ed-c24222011fff None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=64fd1405d96d435faba0c8857009f889) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:52.342922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d55d05-8bd8-4be6-a8ed-c24222011fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:52.344684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d55d05-8bd8-4be6-a8ed-c24222011fff None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:52.352544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 270/532] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:52 2022] GET /identity/v3/role_assignments?user.id=64fd1405d96d435faba0c8857009f889&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:52.353853 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d55d05-8bd8-4be6-a8ed-c24222011fff None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:52.360084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8491548-e1da-40cc-82fe-487eec0eda0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:52.360875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8491548-e1da-40cc-82fe-487eec0eda0a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:52.361166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8491548-e1da-40cc-82fe-487eec0eda0a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:52.361540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8491548-e1da-40cc-82fe-487eec0eda0a None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:52.362890 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8491548-e1da-40cc-82fe-487eec0eda0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:52.363214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8491548-e1da-40cc-82fe-487eec0eda0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:52.365353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8491548-e1da-40cc-82fe-487eec0eda0a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:52.383772 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 263/533] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:52.388948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8491548-e1da-40cc-82fe-487eec0eda0a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:52.467968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:52.476361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d55d05-8bd8-4be6-a8ed-c24222011fff None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:52.515550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758df4d8-fe41-4206-9aee-fbcef04d2f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:52.517091 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758df4d8-fe41-4206-9aee-fbcef04d2f04 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:52.517581 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758df4d8-fe41-4206-9aee-fbcef04d2f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:52.518057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758df4d8-fe41-4206-9aee-fbcef04d2f04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:52.529395 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8491548-e1da-40cc-82fe-487eec0eda0a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:52.532200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758df4d8-fe41-4206-9aee-fbcef04d2f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:52.534041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758df4d8-fe41-4206-9aee-fbcef04d2f04 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-758df4d8-fe41-4206-9aee-fbcef04d2f04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:52.555721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:52.556649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:52.557519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:52.557519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:52.557519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:52.557519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:52.564396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 271/534] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:52.566545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758df4d8-fe41-4206-9aee-fbcef04d2f04 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:52.621844 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c2829-2ec4-4802-86fb-f33278b61640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:52.622675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c2829-2ec4-4802-86fb-f33278b61640 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:52.622973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c2829-2ec4-4802-86fb-f33278b61640 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:52.623275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c2829-2ec4-4802-86fb-f33278b61640 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:52.653509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c2829-2ec4-4802-86fb-f33278b61640 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:52.653509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c2829-2ec4-4802-86fb-f33278b61640 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-732c2829-2ec4-4802-86fb-f33278b61640 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:18:52.669229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:52.670926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:52.671794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:18:52.671794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:18:52.671794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:18:52.671794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:18:52.671794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:18:52.671794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:18:52.671794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:52.671794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:52.671794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 264/535] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:52.676929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c2829-2ec4-4802-86fb-f33278b61640 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:52.694659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:52.722923 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758df4d8-fe41-4206-9aee-fbcef04d2f04 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:52.821518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d564d4d-6c4c-4424-8671-9bb3de85a405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:52.822215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d564d4d-6c4c-4424-8671-9bb3de85a405 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:52.822496 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d564d4d-6c4c-4424-8671-9bb3de85a405 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:52.822764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d564d4d-6c4c-4424-8671-9bb3de85a405 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:52.823502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d564d4d-6c4c-4424-8671-9bb3de85a405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:52.823809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d564d4d-6c4c-4424-8671-9bb3de85a405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:52.825238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d564d4d-6c4c-4424-8671-9bb3de85a405 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:52.852120 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 272/536] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:52.857809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d564d4d-6c4c-4424-8671-9bb3de85a405 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:52.871065 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:52.906684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c2829-2ec4-4802-86fb-f33278b61640 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:52.976912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d564d4d-6c4c-4424-8671-9bb3de85a405 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:52.993678 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78c784-c316-4d74-b718-6e102b9fabee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:52.994355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78c784-c316-4d74-b718-6e102b9fabee None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:52.994642 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78c784-c316-4d74-b718-6e102b9fabee None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:52.994922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78c784-c316-4d74-b718-6e102b9fabee None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:52.995723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78c784-c316-4d74-b718-6e102b9fabee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:52.996038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78c784-c316-4d74-b718-6e102b9fabee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:53.005857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78c784-c316-4d74-b718-6e102b9fabee None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:53.019866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 265/537] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:18:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:53.025447 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0c524-d787-43a8-b35b-d3b685469f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:53.025673 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78c784-c316-4d74-b718-6e102b9fabee None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:53.026267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0c524-d787-43a8-b35b-d3b685469f06 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:53.026599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0c524-d787-43a8-b35b-d3b685469f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:53.026880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0c524-d787-43a8-b35b-d3b685469f06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:53.034797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0c524-d787-43a8-b35b-d3b685469f06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:53.037198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0c524-d787-43a8-b35b-d3b685469f06 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-faf0c524-d787-43a8-b35b-d3b685469f06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:18:53.068192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:53.069184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:53.070886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:18:53.070886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:18:53.070886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:18:53.070886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:18:53.070886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:18:53.070886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:18:53.070886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:53.070886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:53.070886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 273/538] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:53.078099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0c524-d787-43a8-b35b-d3b685469f06 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:53.104532 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:53.154656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78c784-c316-4d74-b718-6e102b9fabee None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:53.170757 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:53.211168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0c524-d787-43a8-b35b-d3b685469f06 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:53.248954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccee065-4dec-4532-94e0-9fa23b1be2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:53.249626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccee065-4dec-4532-94e0-9fa23b1be2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:53.249906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccee065-4dec-4532-94e0-9fa23b1be2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:53.250179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccee065-4dec-4532-94e0-9fa23b1be2b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:53.251025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccee065-4dec-4532-94e0-9fa23b1be2b1 None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=e854100c04be43c78bce1f95ff85bfc6) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:53.251337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccee065-4dec-4532-94e0-9fa23b1be2b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:53.252787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccee065-4dec-4532-94e0-9fa23b1be2b1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:53.256247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d6295-5c53-4229-9331-8794d4fc4cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:53.256944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d6295-5c53-4229-9331-8794d4fc4cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:53.257223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d6295-5c53-4229-9331-8794d4fc4cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:53.257493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d6295-5c53-4229-9331-8794d4fc4cf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:53.258286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d6295-5c53-4229-9331-8794d4fc4cf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:53.258596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d6295-5c53-4229-9331-8794d4fc4cf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:53.260098 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d6295-5c53-4229-9331-8794d4fc4cf1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:53.273733 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 266/539] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:53 2022] GET /identity/v3/role_assignments?user.id=e854100c04be43c78bce1f95ff85bfc6&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:53.284681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 274/540] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:18:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:53.291399 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccee065-4dec-4532-94e0-9fa23b1be2b1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:53.375368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b1d56-7e6e-4014-876d-133e8817c773 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:53.375980 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b1d56-7e6e-4014-876d-133e8817c773 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:53.375980 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b1d56-7e6e-4014-876d-133e8817c773 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:53.377329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 275/541] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:53.384133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851cbf6-95f8-45a0-96c1-ea7b1b0b5d3a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:53.384780 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851cbf6-95f8-45a0-96c1-ea7b1b0b5d3a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:53.385286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851cbf6-95f8-45a0-96c1-ea7b1b0b5d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:53.405330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9851cbf6-95f8-45a0-96c1-ea7b1b0b5d3a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:53.406901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9851cbf6-95f8-45a0-96c1-ea7b1b0b5d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:53.450911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccee065-4dec-4532-94e0-9fa23b1be2b1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:53.509370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093bfc-0fca-4498-ba25-c8b22f0cc7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:53.510043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093bfc-0fca-4498-ba25-c8b22f0cc7ce None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:53.510332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093bfc-0fca-4498-ba25-c8b22f0cc7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:53.510609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093bfc-0fca-4498-ba25-c8b22f0cc7ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:53.511553 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01093bfc-0fca-4498-ba25-c8b22f0cc7ce None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=d2ea8fd0ebfd42fdbed9a989d85c8787) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:53.511874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01093bfc-0fca-4498-ba25-c8b22f0cc7ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:53.513153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 276/542] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:53.514300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01093bfc-0fca-4498-ba25-c8b22f0cc7ce None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:53.520825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 267/543] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:53 2022] GET /identity/v3/role_assignments?user.id=d2ea8fd0ebfd42fdbed9a989d85c8787&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:53.556026 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851cbf6-95f8-45a0-96c1-ea7b1b0b5d3a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:53.658737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:53.725587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851cbf6-95f8-45a0-96c1-ea7b1b0b5d3a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:53.776313 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd662039-690e-491c-9801-dc3c7ae22db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:53.777161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd662039-690e-491c-9801-dc3c7ae22db0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:53.777444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd662039-690e-491c-9801-dc3c7ae22db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:53.777718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd662039-690e-491c-9801-dc3c7ae22db0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:53.789215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd662039-690e-491c-9801-dc3c7ae22db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-bd662039-690e-491c-9801-dc3c7ae22db0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:53.796984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:53.797926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:53.798767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:53.798767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:53.798767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:53.798767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:53.798767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:53.798767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:53.798767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:53.798767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:53.798767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:53.798767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:53.798767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:53.798767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:53.798767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 277/544] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:18:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:53.804321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093bfc-0fca-4498-ba25-c8b22f0cc7ce None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:53.808112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:53.947002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01093bfc-0fca-4498-ba25-c8b22f0cc7ce None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:54.018034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95ad22-6ec6-4524-9a87-c8aa5f34414a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:54.018726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95ad22-6ec6-4524-9a87-c8aa5f34414a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:54.019012 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95ad22-6ec6-4524-9a87-c8aa5f34414a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:54.019291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95ad22-6ec6-4524-9a87-c8aa5f34414a None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:54.020197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95ad22-6ec6-4524-9a87-c8aa5f34414a None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:54.020530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95ad22-6ec6-4524-9a87-c8aa5f34414a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:54.021928 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95ad22-6ec6-4524-9a87-c8aa5f34414a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:54.037284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 268/545] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:18:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:54.042890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd662039-690e-491c-9801-dc3c7ae22db0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:54.189230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd662039-690e-491c-9801-dc3c7ae22db0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:54.216233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:54.238785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee7e6a-fe55-4798-8569-abb172a92363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:54.240222 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee7e6a-fe55-4798-8569-abb172a92363 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:54.240656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee7e6a-fe55-4798-8569-abb172a92363 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:54.241113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee7e6a-fe55-4798-8569-abb172a92363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:54.250356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecad46c-c8bf-425a-a9e9-791240c2f6f4 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:54.250648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecad46c-c8bf-425a-a9e9-791240c2f6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:54.250992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecad46c-c8bf-425a-a9e9-791240c2f6f4 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:54.252685 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 269/546] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:54.257318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee7e6a-fe55-4798-8569-abb172a92363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:54.258826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8612eb-a797-4bcc-867d-9c399d6e664d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:54.259123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8612eb-a797-4bcc-867d-9c399d6e664d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:54.259310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee7e6a-fe55-4798-8569-abb172a92363 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:54.259420 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8612eb-a797-4bcc-867d-9c399d6e664d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-77ee7e6a-fe55-4798-8569-abb172a92363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:54.278690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:54.279753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:54.280872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:54.280872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:54.280872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:54.280872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:54.282427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 278/547] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:54.288828 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee7e6a-fe55-4798-8569-abb172a92363 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:54.293023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4a8612eb-a797-4bcc-867d-9c399d6e664d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:54.294229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4a8612eb-a797-4bcc-867d-9c399d6e664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:54.421205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:54.432352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 270/548] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:54.438475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee7e6a-fe55-4798-8569-abb172a92363 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:54.465824 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8612eb-a797-4bcc-867d-9c399d6e664d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:54.502023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be8150-2b2f-4538-8e73-204b465cb911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:54.503036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be8150-2b2f-4538-8e73-204b465cb911 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:54.503706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be8150-2b2f-4538-8e73-204b465cb911 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:54.505350 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be8150-2b2f-4538-8e73-204b465cb911 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:54.506750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be8150-2b2f-4538-8e73-204b465cb911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:54.507901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be8150-2b2f-4538-8e73-204b465cb911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:54.510857 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be8150-2b2f-4538-8e73-204b465cb911 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:54.537211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 279/549] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:54.544247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be8150-2b2f-4538-8e73-204b465cb911 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:54.593171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:54.629409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8612eb-a797-4bcc-867d-9c399d6e664d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:54.708804 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51f046-119f-4da4-b42c-138d71536b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:54.710064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51f046-119f-4da4-b42c-138d71536b2d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:54.711201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51f046-119f-4da4-b42c-138d71536b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:54.711840 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51f046-119f-4da4-b42c-138d71536b2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:54.726111 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be8150-2b2f-4538-8e73-204b465cb911 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:54.733196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51f046-119f-4da4-b42c-138d71536b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-9a51f046-119f-4da4-b42c-138d71536b2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:54.750072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:54.751552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:54.752576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:54.752576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:54.752576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:54.752576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:54.752576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:54.752576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:54.752576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:54.752576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:54.752576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:54.752576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:54.752576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:54.752576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:54.759968 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 271/550] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:18:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:54.767067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51f046-119f-4da4-b42c-138d71536b2d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:54.798493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68706fd-519d-4b58-aa0c-dd40c25ad131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:54.800831 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68706fd-519d-4b58-aa0c-dd40c25ad131 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:54.802127 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68706fd-519d-4b58-aa0c-dd40c25ad131 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:54.803874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68706fd-519d-4b58-aa0c-dd40c25ad131 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:54.826756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68706fd-519d-4b58-aa0c-dd40c25ad131 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:54.828245 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68706fd-519d-4b58-aa0c-dd40c25ad131 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-d68706fd-519d-4b58-aa0c-dd40c25ad131 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:18:54.846523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:54.847489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:54.849209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:54.849209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:54.849209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:18:54.849209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:18:54.849209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:18:54.849209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:18:54.849209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:18:54.849209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:18:54.849209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:18:54.849209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:54.849209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 280/551] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:18:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:18:54.864886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68706fd-519d-4b58-aa0c-dd40c25ad131 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:54.874642 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:54.934909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51f046-119f-4da4-b42c-138d71536b2d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:54.998965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400747a4-49d3-4721-863e-84e4ab424a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:55.000117 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400747a4-49d3-4721-863e-84e4ab424a8a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:55.000597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400747a4-49d3-4721-863e-84e4ab424a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:55.001123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400747a4-49d3-4721-863e-84e4ab424a8a None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:55.002369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400747a4-49d3-4721-863e-84e4ab424a8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:55.003187 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400747a4-49d3-4721-863e-84e4ab424a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:55.005424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400747a4-49d3-4721-863e-84e4ab424a8a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:55.016055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 272/552] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:18:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:55.025714 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400747a4-49d3-4721-863e-84e4ab424a8a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:55.045260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:55.060442 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68706fd-519d-4b58-aa0c-dd40c25ad131 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:55.102347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a98701-0df0-4943-9dbd-328d9c944504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:55.103425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a98701-0df0-4943-9dbd-328d9c944504 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:55.103913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a98701-0df0-4943-9dbd-328d9c944504 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:55.104396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a98701-0df0-4943-9dbd-328d9c944504 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:55.105477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a98701-0df0-4943-9dbd-328d9c944504 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:55.105992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a98701-0df0-4943-9dbd-328d9c944504 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:55.107653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a98701-0df0-4943-9dbd-328d9c944504 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:55.131545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 281/553] 10.222.0.39 () {56 vars in 1135 bytes} [Thu May 26 12:18:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:55.133130 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a98701-0df0-4943-9dbd-328d9c944504 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:55.246708 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400747a4-49d3-4721-863e-84e4ab424a8a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:55.257486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a98701-0df0-4943-9dbd-328d9c944504 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:55.293843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:55.307520 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ac8dd-539e-4ec8-aae6-20d868d578f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:55.308638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ac8dd-539e-4ec8-aae6-20d868d578f2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:55.309184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ac8dd-539e-4ec8-aae6-20d868d578f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:55.309676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ac8dd-539e-4ec8-aae6-20d868d578f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:55.328354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d87260-5645-42ff-8b27-9fb6a94b5631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:55.329547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d87260-5645-42ff-8b27-9fb6a94b5631 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:55.330047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d87260-5645-42ff-8b27-9fb6a94b5631 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:55.332434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d87260-5645-42ff-8b27-9fb6a94b5631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:55.345291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:55.358169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d87260-5645-42ff-8b27-9fb6a94b5631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:55.359956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d87260-5645-42ff-8b27-9fb6a94b5631 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-73d87260-5645-42ff-8b27-9fb6a94b5631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:55.389509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:55.390435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:55.391973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:55.391973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:55.391973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:55.391973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:55.391973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 273/554] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:55.392530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1075b6-b88a-49e3-bfd7-a316fedc8434 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:55.397538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1075b6-b88a-49e3-bfd7-a316fedc8434 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:55.397870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1075b6-b88a-49e3-bfd7-a316fedc8434 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:55.399574 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 274/555] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:55.400411 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1075b6-b88a-49e3-bfd7-a316fedc8434 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:55.423244 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ac8dd-539e-4ec8-aae6-20d868d578f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:55.424847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ac8dd-539e-4ec8-aae6-20d868d578f2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:55.515113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1075b6-b88a-49e3-bfd7-a316fedc8434 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:55.540748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 282/556] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:18:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:18:55.540748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cff72a-0d2d-473b-8979-cf091ec29e16 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:55.540748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cff72a-0d2d-473b-8979-cf091ec29e16 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:55.540748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cff72a-0d2d-473b-8979-cf091ec29e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:55.558905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c084c98-6043-4c1a-b53b-9b04e30c78dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:55.559126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c5cff72a-0d2d-473b-8979-cf091ec29e16 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:55.560047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c084c98-6043-4c1a-b53b-9b04e30c78dd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:55.560243 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c5cff72a-0d2d-473b-8979-cf091ec29e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:55.560765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c084c98-6043-4c1a-b53b-9b04e30c78dd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:55.561262 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c084c98-6043-4c1a-b53b-9b04e30c78dd None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:55.562211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c084c98-6043-4c1a-b53b-9b04e30c78dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:55.562740 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c084c98-6043-4c1a-b53b-9b04e30c78dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:55.564358 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c084c98-6043-4c1a-b53b-9b04e30c78dd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:55.578167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 275/557] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:55.579440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c084c98-6043-4c1a-b53b-9b04e30c78dd None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:55.608758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:55.609078 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:55.646576 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 283/558] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:55.647799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cff72a-0d2d-473b-8979-cf091ec29e16 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:55.690515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c084c98-6043-4c1a-b53b-9b04e30c78dd None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:55.727230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16816cb1-0073-4464-898d-71a1cc12e9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:55.728403 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16816cb1-0073-4464-898d-71a1cc12e9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:55.728964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16816cb1-0073-4464-898d-71a1cc12e9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:55.729476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16816cb1-0073-4464-898d-71a1cc12e9c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:55.741002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16816cb1-0073-4464-898d-71a1cc12e9c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:55.742736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16816cb1-0073-4464-898d-71a1cc12e9c6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-16816cb1-0073-4464-898d-71a1cc12e9c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:55.761147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:55.762564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:55.763459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:55.763459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:55.763459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:55.763459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:55.765491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 276/559] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:55.766881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16816cb1-0073-4464-898d-71a1cc12e9c6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:55.779721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cff72a-0d2d-473b-8979-cf091ec29e16 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:55.818864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587b69e-7c30-4e93-9824-b5220d7339fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:55.819670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b69e-7c30-4e93-9824-b5220d7339fc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:55.819948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b69e-7c30-4e93-9824-b5220d7339fc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:55.820218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587b69e-7c30-4e93-9824-b5220d7339fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:55.827787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587b69e-7c30-4e93-9824-b5220d7339fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:55.829327 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587b69e-7c30-4e93-9824-b5220d7339fc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6587b69e-7c30-4e93-9824-b5220d7339fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:18:55.845152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:55.846247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:55.847295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:55.847295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:55.847295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:18:55.847295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:18:55.847295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:18:55.847295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:18:55.847295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:18:55.847295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:18:55.847295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:18:55.847295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:55.847295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 284/560] 10.222.0.39 () {56 vars in 1093 bytes} [Thu May 26 12:18:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:55.847897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587b69e-7c30-4e93-9824-b5220d7339fc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:55.856148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:55.878994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16816cb1-0073-4464-898d-71a1cc12e9c6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:55.892501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:55.920435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d52ad-26d7-40e0-b488-ff36e1d2fd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:55.921267 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d52ad-26d7-40e0-b488-ff36e1d2fd9f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:55.921547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d52ad-26d7-40e0-b488-ff36e1d2fd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:55.921820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d52ad-26d7-40e0-b488-ff36e1d2fd9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:55.933747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d52ad-26d7-40e0-b488-ff36e1d2fd9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b54d52ad-26d7-40e0-b488-ff36e1d2fd9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:55.941707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:55.943278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:55.944278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:55.944278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:55.944278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:55.944278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:55.944278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:55.944278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:55.944278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:55.944278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:55.944278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:55.944278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:55.944278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:55.944278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:55.946727 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 277/561] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:18:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:55.948227 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2600-51d9-47aa-a8c9-f6e1c30ba94f None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:55.948519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2600-51d9-47aa-a8c9-f6e1c30ba94f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:55.948827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf2600-51d9-47aa-a8c9-f6e1c30ba94f None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:55.950274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 278/562] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:55.955007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf2600-51d9-47aa-a8c9-f6e1c30ba94f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:55.974537 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587b69e-7c30-4e93-9824-b5220d7339fc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:56.014458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421515e-40f8-47e5-a47c-c7f18e7a2da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:56.015131 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421515e-40f8-47e5-a47c-c7f18e7a2da1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.015425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421515e-40f8-47e5-a47c-c7f18e7a2da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.015748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421515e-40f8-47e5-a47c-c7f18e7a2da1 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.016429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421515e-40f8-47e5-a47c-c7f18e7a2da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:56.017093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421515e-40f8-47e5-a47c-c7f18e7a2da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:56.018472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421515e-40f8-47e5-a47c-c7f18e7a2da1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:56.034134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 285/563] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:56.034134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421515e-40f8-47e5-a47c-c7f18e7a2da1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:56.071894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf2600-51d9-47aa-a8c9-f6e1c30ba94f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:56.108562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f433-bafd-4bef-b9b1-526ec7718e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:56.109271 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f433-bafd-4bef-b9b1-526ec7718e43 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.109557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f433-bafd-4bef-b9b1-526ec7718e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.109833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f433-bafd-4bef-b9b1-526ec7718e43 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.110673 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0f433-bafd-4bef-b9b1-526ec7718e43 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:56.110987 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0f433-bafd-4bef-b9b1-526ec7718e43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:56.112433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0f433-bafd-4bef-b9b1-526ec7718e43 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:56.122907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:56.132236 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 279/564] 10.222.0.39 () {56 vars in 1133 bytes} [Thu May 26 12:18:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:56.133323 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e1269-c88b-47c4-bbf1-9d8e5f89120d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.133614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e1269-c88b-47c4-bbf1-9d8e5f89120d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.133895 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e1269-c88b-47c4-bbf1-9d8e5f89120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.139218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:56.146431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421515e-40f8-47e5-a47c-c7f18e7a2da1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:56.152358 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2f5e1269-c88b-47c4-bbf1-9d8e5f89120d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:56.153582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2f5e1269-c88b-47c4-bbf1-9d8e5f89120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:56.181799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4095260-4d6e-4fcd-aabd-5cc27bae4211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:56.182468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4095260-4d6e-4fcd-aabd-5cc27bae4211 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.182752 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4095260-4d6e-4fcd-aabd-5cc27bae4211 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.183029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4095260-4d6e-4fcd-aabd-5cc27bae4211 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.183770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4095260-4d6e-4fcd-aabd-5cc27bae4211 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:56.184075 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4095260-4d6e-4fcd-aabd-5cc27bae4211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:56.185485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4095260-4d6e-4fcd-aabd-5cc27bae4211 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:56.194814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 286/565] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:18:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:56.195597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4095260-4d6e-4fcd-aabd-5cc27bae4211 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:56.223696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 280/566] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:56.224729 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e1269-c88b-47c4-bbf1-9d8e5f89120d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:56.293397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4095260-4d6e-4fcd-aabd-5cc27bae4211 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:56.323709 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e1269-c88b-47c4-bbf1-9d8e5f89120d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:56.327516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22e4ec-3dfc-47dc-a90a-bdd911037043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:56.328304 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22e4ec-3dfc-47dc-a90a-bdd911037043 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.328592 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22e4ec-3dfc-47dc-a90a-bdd911037043 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.328903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22e4ec-3dfc-47dc-a90a-bdd911037043 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.336265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22e4ec-3dfc-47dc-a90a-bdd911037043 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:56.337739 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22e4ec-3dfc-47dc-a90a-bdd911037043 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:56.350841 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-1d22e4ec-3dfc-47dc-a90a-bdd911037043 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:18:56.352749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:56.353692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:56.354617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:18:56.354617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:18:56.354617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:18:56.354617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:18:56.354617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:18:56.354617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:18:56.354617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:56.354617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:56.354617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 287/567] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:56.355513 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce40a-b90c-4f53-88b0-2ccb55ca68b2 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.355630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce40a-b90c-4f53-88b0-2ccb55ca68b2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.355847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ce40a-b90c-4f53-88b0-2ccb55ca68b2 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.357147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 288/568] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:56.357829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ce40a-b90c-4f53-88b0-2ccb55ca68b2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:56.364749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c090866-12df-44f9-b29e-5532b96a5e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:56.365579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c090866-12df-44f9-b29e-5532b96a5e3f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.365880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c090866-12df-44f9-b29e-5532b96a5e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.366147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c090866-12df-44f9-b29e-5532b96a5e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.376493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c090866-12df-44f9-b29e-5532b96a5e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:56.376900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:56.378141 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c090866-12df-44f9-b29e-5532b96a5e3f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-1c090866-12df-44f9-b29e-5532b96a5e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:56.396826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:56.397775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:56.398686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:56.398686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:56.398686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:56.398686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:56.398686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 281/569] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:56.398959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c090866-12df-44f9-b29e-5532b96a5e3f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:56.460194 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ce40a-b90c-4f53-88b0-2ccb55ca68b2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:56.493823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6220-7af5-46d6-85f8-a14b0626c172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:56.494609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6220-7af5-46d6-85f8-a14b0626c172 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.494898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6220-7af5-46d6-85f8-a14b0626c172 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.495179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6220-7af5-46d6-85f8-a14b0626c172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.498588 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c090866-12df-44f9-b29e-5532b96a5e3f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:56.505351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6220-7af5-46d6-85f8-a14b0626c172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:56.506822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6220-7af5-46d6-85f8-a14b0626c172 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f02d6220-7af5-46d6-85f8-a14b0626c172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:56.524953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:56.525851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:56.526997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:56.526997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:56.526997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:56.526997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:56.526997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 289/570] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:56.526997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6220-7af5-46d6-85f8-a14b0626c172 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:56.533881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05298c-2c50-4f82-b2ab-78385e7ebdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:56.534682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05298c-2c50-4f82-b2ab-78385e7ebdfd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.534966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05298c-2c50-4f82-b2ab-78385e7ebdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.535244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05298c-2c50-4f82-b2ab-78385e7ebdfd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.546163 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05298c-2c50-4f82-b2ab-78385e7ebdfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ad05298c-2c50-4f82-b2ab-78385e7ebdfd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:56.553986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:56.554941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:56.555785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:56.555785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:56.555785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:56.555785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:56.555785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:56.555785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:56.555785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:56.555785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:56.555785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:56.555785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:56.555785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:56.555785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:56.555785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 282/571] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:18:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:56.556674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8039c05-b491-4f5f-a787-e6ae7227e026 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.556972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8039c05-b491-4f5f-a787-e6ae7227e026 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.557241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8039c05-b491-4f5f-a787-e6ae7227e026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.574547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c8039c05-b491-4f5f-a787-e6ae7227e026 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:56.576078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c8039c05-b491-4f5f-a787-e6ae7227e026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:56.603679 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:56.610981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:56.638062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6220-7af5-46d6-85f8-a14b0626c172 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:56.646388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 283/572] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:56.647231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8039c05-b491-4f5f-a787-e6ae7227e026 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:56.678253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ace5f7-28cf-4ab0-95a0-535681ccb449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:56.678912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ace5f7-28cf-4ab0-95a0-535681ccb449 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.679193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ace5f7-28cf-4ab0-95a0-535681ccb449 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.679468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ace5f7-28cf-4ab0-95a0-535681ccb449 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.680248 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ace5f7-28cf-4ab0-95a0-535681ccb449 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:56.680558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ace5f7-28cf-4ab0-95a0-535681ccb449 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:56.682095 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ace5f7-28cf-4ab0-95a0-535681ccb449 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:56.694586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 290/573] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:18:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:56.695381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ace5f7-28cf-4ab0-95a0-535681ccb449 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:56.747750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8039c05-b491-4f5f-a787-e6ae7227e026 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:56.781599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eb3d6-7a19-48eb-a45f-50545b8e01c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:56.782268 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eb3d6-7a19-48eb-a45f-50545b8e01c1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.782556 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eb3d6-7a19-48eb-a45f-50545b8e01c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.782838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eb3d6-7a19-48eb-a45f-50545b8e01c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.783568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eb3d6-7a19-48eb-a45f-50545b8e01c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:56.783880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eb3d6-7a19-48eb-a45f-50545b8e01c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:56.785310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eb3d6-7a19-48eb-a45f-50545b8e01c1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:56.793666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ace5f7-28cf-4ab0-95a0-535681ccb449 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:56.797369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 284/574] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:56.798129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eb3d6-7a19-48eb-a45f-50545b8e01c1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:56.824149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:56.829508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:56.830279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32212fc3-33bd-4353-af15-167275f959f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:56.831326 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32212fc3-33bd-4353-af15-167275f959f4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.831757 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32212fc3-33bd-4353-af15-167275f959f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.832147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32212fc3-33bd-4353-af15-167275f959f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.832946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32212fc3-33bd-4353-af15-167275f959f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:56.833310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32212fc3-33bd-4353-af15-167275f959f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:56.835577 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32212fc3-33bd-4353-af15-167275f959f4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:56.853269 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 291/575] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:56.853269 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32212fc3-33bd-4353-af15-167275f959f4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:56.909833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eb3d6-7a19-48eb-a45f-50545b8e01c1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:56.942891 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530f47d-d6b8-43d3-8667-aa0637d0d3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:56.943556 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530f47d-d6b8-43d3-8667-aa0637d0d3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.943840 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530f47d-d6b8-43d3-8667-aa0637d0d3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.944116 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530f47d-d6b8-43d3-8667-aa0637d0d3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:56.944896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530f47d-d6b8-43d3-8667-aa0637d0d3d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:56.945205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530f47d-d6b8-43d3-8667-aa0637d0d3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:56.946565 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530f47d-d6b8-43d3-8667-aa0637d0d3d5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:56.954356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 285/576] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:18:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:56.955147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530f47d-d6b8-43d3-8667-aa0637d0d3d5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:56.955266 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32212fc3-33bd-4353-af15-167275f959f4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:56.989833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df851128-b41f-4a7e-84c1-da750de5db11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:56.990745 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df851128-b41f-4a7e-84c1-da750de5db11 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:56.991036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df851128-b41f-4a7e-84c1-da750de5db11 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:56.991316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df851128-b41f-4a7e-84c1-da750de5db11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:57.001418 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df851128-b41f-4a7e-84c1-da750de5db11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-df851128-b41f-4a7e-84c1-da750de5db11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:57.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:57.010629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:57.011450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:57.011450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:57.011450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:57.011450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:57.011450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:57.011450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:57.011450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:57.011450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:57.011450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:57.011450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:57.011450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:57.011450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:57.012247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 292/577] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:18:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:57.013230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df851128-b41f-4a7e-84c1-da750de5db11 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:57.049786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:57.058866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530f47d-d6b8-43d3-8667-aa0637d0d3d5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:57.062700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:57.092564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4258db8-12f1-497f-8bcd-eff2bb4480a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:57.093249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4258db8-12f1-497f-8bcd-eff2bb4480a2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:57.093533 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4258db8-12f1-497f-8bcd-eff2bb4480a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:57.093808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4258db8-12f1-497f-8bcd-eff2bb4480a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:57.094644 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4258db8-12f1-497f-8bcd-eff2bb4480a2 None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=691c9da310ef42a189bb78183867e46a) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:57.094955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4258db8-12f1-497f-8bcd-eff2bb4480a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:57.096382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4258db8-12f1-497f-8bcd-eff2bb4480a2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:57.101868 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 286/578] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:18:56 2022] GET /identity/v3/role_assignments?user.id=691c9da310ef42a189bb78183867e46a&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:57.102637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4258db8-12f1-497f-8bcd-eff2bb4480a2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:57.113849 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df851128-b41f-4a7e-84c1-da750de5db11 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:57.154469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46de27-734c-4f44-8fa6-b969ae0b91ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:57.155283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46de27-734c-4f44-8fa6-b969ae0b91ce None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:57.155569 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46de27-734c-4f44-8fa6-b969ae0b91ce None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:57.155848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46de27-734c-4f44-8fa6-b969ae0b91ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:57.164191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46de27-734c-4f44-8fa6-b969ae0b91ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:57.165724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46de27-734c-4f44-8fa6-b969ae0b91ce None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-5d46de27-734c-4f44-8fa6-b969ae0b91ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:18:57.181693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:57.182747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:57.183644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:18:57.183644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:18:57.183644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:18:57.183644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:18:57.183644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:18:57.183644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:18:57.183644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:57.183644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:57.187879 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 293/579] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:57.188886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46de27-734c-4f44-8fa6-b969ae0b91ce None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:57.230977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4258db8-12f1-497f-8bcd-eff2bb4480a2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:57.272998 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c035ab3-5fae-49ed-be9f-7b2de8087af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:57.274176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035ab3-5fae-49ed-be9f-7b2de8087af3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:57.274660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035ab3-5fae-49ed-be9f-7b2de8087af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:57.274939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035ab3-5fae-49ed-be9f-7b2de8087af3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:57.284755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c035ab3-5fae-49ed-be9f-7b2de8087af3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:57.285032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c035ab3-5fae-49ed-be9f-7b2de8087af3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-6c035ab3-5fae-49ed-be9f-7b2de8087af3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:18:57.299751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:57.301078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:57.302796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:57.302796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:57.302796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:18:57.302796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:18:57.302796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:18:57.302796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:18:57.302796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:18:57.302796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:18:57.302796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:18:57.302796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:57.303323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46de27-734c-4f44-8fa6-b969ae0b91ce None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:57.306068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 287/580] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:57.306969 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c035ab3-5fae-49ed-be9f-7b2de8087af3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:57.313987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:57.336181 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:57.339781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d26989-a25f-4d74-bfe0-25268a003d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:57.340584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d26989-a25f-4d74-bfe0-25268a003d1b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:57.340913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d26989-a25f-4d74-bfe0-25268a003d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:57.341199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d26989-a25f-4d74-bfe0-25268a003d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:57.352815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d26989-a25f-4d74-bfe0-25268a003d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:57.354292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d26989-a25f-4d74-bfe0-25268a003d1b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e2d26989-a25f-4d74-bfe0-25268a003d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:57.373097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:57.375170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:57.377067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:57.377067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:57.377067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:57.377067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:57.377067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 294/581] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:57.377067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d26989-a25f-4d74-bfe0-25268a003d1b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:57.423369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c035ab3-5fae-49ed-be9f-7b2de8087af3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:57.463296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7ade8-2624-44fd-9923-c23de343f6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:57.463970 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7ade8-2624-44fd-9923-c23de343f6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:57.464254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7ade8-2624-44fd-9923-c23de343f6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:57.464528 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7ade8-2624-44fd-9923-c23de343f6b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:57.465418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7ade8-2624-44fd-9923-c23de343f6b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:57.465841 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7ade8-2624-44fd-9923-c23de343f6b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:57.467203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7ade8-2624-44fd-9923-c23de343f6b1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:57.480699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d26989-a25f-4d74-bfe0-25268a003d1b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:57.481768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 288/582] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:18:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:57.482580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7ade8-2624-44fd-9923-c23de343f6b1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:57.515729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c42a93-83bc-4153-b26a-1d3ee27288bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:57.516401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42a93-83bc-4153-b26a-1d3ee27288bc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:57.516969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42a93-83bc-4153-b26a-1d3ee27288bc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:57.517249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c42a93-83bc-4153-b26a-1d3ee27288bc None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:57.518056 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c42a93-83bc-4153-b26a-1d3ee27288bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:57.518374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c42a93-83bc-4153-b26a-1d3ee27288bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:57.519801 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c42a93-83bc-4153-b26a-1d3ee27288bc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:57.531376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 295/583] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:57.532185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c42a93-83bc-4153-b26a-1d3ee27288bc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:57.559557 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:57.574332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:57.599110 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7ade8-2624-44fd-9923-c23de343f6b1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:57.634893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d128e7f-1544-4122-8f54-389318b3a33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:57.635562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d128e7f-1544-4122-8f54-389318b3a33c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:57.635844 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d128e7f-1544-4122-8f54-389318b3a33c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:57.636124 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d128e7f-1544-4122-8f54-389318b3a33c None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:57.636985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d128e7f-1544-4122-8f54-389318b3a33c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:57.637291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d128e7f-1544-4122-8f54-389318b3a33c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:57.638713 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d128e7f-1544-4122-8f54-389318b3a33c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:57.639332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c42a93-83bc-4153-b26a-1d3ee27288bc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:57.662329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 289/584] 10.222.0.39 () {56 vars in 1137 bytes} [Thu May 26 12:18:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:57.662329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d128e7f-1544-4122-8f54-389318b3a33c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:57.677544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e43bea-a9e4-426f-b9ad-389bfdd97219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:57.678297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e43bea-a9e4-426f-b9ad-389bfdd97219 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:57.678652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e43bea-a9e4-426f-b9ad-389bfdd97219 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:57.679001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e43bea-a9e4-426f-b9ad-389bfdd97219 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:57.679817 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e43bea-a9e4-426f-b9ad-389bfdd97219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:57.680194 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e43bea-a9e4-426f-b9ad-389bfdd97219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:57.681687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e43bea-a9e4-426f-b9ad-389bfdd97219 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:57.694499 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 296/585] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:57.695380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e43bea-a9e4-426f-b9ad-389bfdd97219 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:57.770129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d128e7f-1544-4122-8f54-389318b3a33c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:57.778599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:57.798581 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e43bea-a9e4-426f-b9ad-389bfdd97219 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:57.807779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6226d03-5273-45d1-b47a-8c5769a976f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:57.808576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6226d03-5273-45d1-b47a-8c5769a976f7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:57.808935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6226d03-5273-45d1-b47a-8c5769a976f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:57.809207 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6226d03-5273-45d1-b47a-8c5769a976f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:57.812056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:57.821733 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6226d03-5273-45d1-b47a-8c5769a976f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:57.823183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6226d03-5273-45d1-b47a-8c5769a976f7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:57.838601 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb692f8-1f9d-457f-9ba7-b740915e388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:57.839499 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb692f8-1f9d-457f-9ba7-b740915e388b None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:57.839786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb692f8-1f9d-457f-9ba7-b740915e388b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:57.840066 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb692f8-1f9d-457f-9ba7-b740915e388b None admin] PATH_INFO: `/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/04f5fbbe45ec4dcf8301da8483af2941/roles/11b992de70b244678ed4f0e082d92e7f` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-f6226d03-5273-45d1-b47a-8c5769a976f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:57.841025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:57.841855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:57.842747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:57.842747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:57.842747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:57.842747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:57.842747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 290/586] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:57.843030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6226d03-5273-45d1-b47a-8c5769a976f7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:57.860429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb692f8-1f9d-457f-9ba7-b740915e388b None admin] RBAC: Authorizing `identity:create_grant(project_id=b341d104240e4b4cb61d365e8167f6a8, user_id=04f5fbbe45ec4dcf8301da8483af2941, role_id=11b992de70b244678ed4f0e082d92e7f)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:57.861924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb692f8-1f9d-457f-9ba7-b740915e388b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:57.875495 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 297/587] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:18:57 2022] PUT /identity/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/04f5fbbe45ec4dcf8301da8483af2941/roles/11b992de70b244678ed4f0e082d92e7f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:18:57.886047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb692f8-1f9d-457f-9ba7-b740915e388b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:57.970770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6226d03-5273-45d1-b47a-8c5769a976f7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:58.010811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf7474-6fbf-4f85-becb-e63f58eac9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:58.012026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf7474-6fbf-4f85-becb-e63f58eac9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:58.012026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf7474-6fbf-4f85-becb-e63f58eac9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:58.012352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf7474-6fbf-4f85-becb-e63f58eac9f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:58.024403 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf7474-6fbf-4f85-becb-e63f58eac9f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:58.026330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf7474-6fbf-4f85-becb-e63f58eac9f7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:58.041878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb692f8-1f9d-457f-9ba7-b740915e388b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-e1cf7474-6fbf-4f85-becb-e63f58eac9f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:58.045450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:58.046541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:58.047646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:58.047646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:58.047646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:58.047646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:58.053847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 291/588] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:58.053847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf7474-6fbf-4f85-becb-e63f58eac9f7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:58.083665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:58.091139 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403104a-7259-4ea4-8961-ce714d38e4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:58.092651 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403104a-7259-4ea4-8961-ce714d38e4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:58.092919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403104a-7259-4ea4-8961-ce714d38e4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:58.093200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403104a-7259-4ea4-8961-ce714d38e4d3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:58.104298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403104a-7259-4ea4-8961-ce714d38e4d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:58.105843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403104a-7259-4ea4-8961-ce714d38e4d3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:58.107119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-5403104a-7259-4ea4-8961-ce714d38e4d3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:18:58.124338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:58.125375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:58.126895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:58.126895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:58.126895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:18:58.126895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:18:58.126895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:18:58.126895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:18:58.126895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:18:58.126895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:18:58.126895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:18:58.126895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:58.126895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 298/589] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:18:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:58.126895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403104a-7259-4ea4-8961-ce714d38e4d3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:58.178366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf7474-6fbf-4f85-becb-e63f58eac9f7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:58.215699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7636a1-9ab4-44cc-a6be-c988b9883e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:58.216378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7636a1-9ab4-44cc-a6be-c988b9883e3e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:58.216667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7636a1-9ab4-44cc-a6be-c988b9883e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:58.217026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7636a1-9ab4-44cc-a6be-c988b9883e3e None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:58.217774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7636a1-9ab4-44cc-a6be-c988b9883e3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:58.218136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7636a1-9ab4-44cc-a6be-c988b9883e3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:58.219575 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7636a1-9ab4-44cc-a6be-c988b9883e3e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:58.233660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 292/590] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:58.234539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7636a1-9ab4-44cc-a6be-c988b9883e3e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:58.257990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403104a-7259-4ea4-8961-ce714d38e4d3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:58.301353 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb0299-75fc-4c5e-ae7c-b5ef9860754b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:58.302268 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb0299-75fc-4c5e-ae7c-b5ef9860754b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:58.302761 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb0299-75fc-4c5e-ae7c-b5ef9860754b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:58.302973 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb0299-75fc-4c5e-ae7c-b5ef9860754b None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:58.305614 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb0299-75fc-4c5e-ae7c-b5ef9860754b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:58.305614 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb0299-75fc-4c5e-ae7c-b5ef9860754b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:58.305983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb0299-75fc-4c5e-ae7c-b5ef9860754b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:58.322556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 299/591] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:58.323436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb0299-75fc-4c5e-ae7c-b5ef9860754b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:58.352177 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7636a1-9ab4-44cc-a6be-c988b9883e3e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:58.378751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:58.381889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:58.392066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c917ec0-bca5-4a80-884b-dfa10b0f59d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:58.392774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c917ec0-bca5-4a80-884b-dfa10b0f59d6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:58.393242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c917ec0-bca5-4a80-884b-dfa10b0f59d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:58.393685 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c917ec0-bca5-4a80-884b-dfa10b0f59d6 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:58.394809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c917ec0-bca5-4a80-884b-dfa10b0f59d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:58.395879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c917ec0-bca5-4a80-884b-dfa10b0f59d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:58.397752 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c917ec0-bca5-4a80-884b-dfa10b0f59d6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:58.421558 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 293/592] 10.222.0.39 () {56 vars in 1137 bytes} [Thu May 26 12:18:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:58.422624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c917ec0-bca5-4a80-884b-dfa10b0f59d6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:58.431933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb0299-75fc-4c5e-ae7c-b5ef9860754b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:58.467478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118cb0-227d-419a-8048-f644746b789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:58.468343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118cb0-227d-419a-8048-f644746b789a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:58.468632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118cb0-227d-419a-8048-f644746b789a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:58.468942 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118cb0-227d-419a-8048-f644746b789a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:58.477600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4118cb0-227d-419a-8048-f644746b789a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:58.479057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4118cb0-227d-419a-8048-f644746b789a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b4118cb0-227d-419a-8048-f644746b789a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:18:58.495611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:58.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:58.500171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:58.500171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:58.500171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:18:58.500171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:18:58.500171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:18:58.500171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:18:58.500171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:18:58.500171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:18:58.500171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:18:58.500171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:58.505493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 300/593] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:18:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:58.505493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118cb0-227d-419a-8048-f644746b789a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:58.528331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c917ec0-bca5-4a80-884b-dfa10b0f59d6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:58.579104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86abfb-4e1e-4053-beef-21ca4a616a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:58.581510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86abfb-4e1e-4053-beef-21ca4a616a31 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:58.582244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86abfb-4e1e-4053-beef-21ca4a616a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:58.583226 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86abfb-4e1e-4053-beef-21ca4a616a31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:58.594752 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86abfb-4e1e-4053-beef-21ca4a616a31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:58.596571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86abfb-4e1e-4053-beef-21ca4a616a31 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0c86abfb-4e1e-4053-beef-21ca4a616a31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:18:58.615039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:58.615984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:58.616937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:18:58.616937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:18:58.616937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:18:58.616937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:18:58.616937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:18:58.616937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:18:58.616937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:58.616937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:58.618971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 294/594] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:58.619811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86abfb-4e1e-4053-beef-21ca4a616a31 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:58.639992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118cb0-227d-419a-8048-f644746b789a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:58.648176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:58.659021 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:58.687847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90e098-4b5b-40fa-ad7b-2d0df78b1aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:58.689257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90e098-4b5b-40fa-ad7b-2d0df78b1aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:58.690180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90e098-4b5b-40fa-ad7b-2d0df78b1aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:58.690684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90e098-4b5b-40fa-ad7b-2d0df78b1aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:58.705354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90e098-4b5b-40fa-ad7b-2d0df78b1aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:58.707894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90e098-4b5b-40fa-ad7b-2d0df78b1aa7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8a90e098-4b5b-40fa-ad7b-2d0df78b1aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:58.735012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:58.736126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:58.737312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:58.737312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:58.737312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:58.737312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:58.740214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 301/595] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:58.741233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90e098-4b5b-40fa-ad7b-2d0df78b1aa7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:58.763342 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86abfb-4e1e-4053-beef-21ca4a616a31 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:58.810822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c66c9-9dbc-4e73-bdb2-b2fafe95a515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:58.811990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c66c9-9dbc-4e73-bdb2-b2fafe95a515 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:58.812676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c66c9-9dbc-4e73-bdb2-b2fafe95a515 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:58.813137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c66c9-9dbc-4e73-bdb2-b2fafe95a515 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:58.814849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c66c9-9dbc-4e73-bdb2-b2fafe95a515 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:58.815315 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c66c9-9dbc-4e73-bdb2-b2fafe95a515 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:58.817853 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c66c9-9dbc-4e73-bdb2-b2fafe95a515 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:58.844680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 295/596] 10.222.0.39 () {56 vars in 1139 bytes} [Thu May 26 12:18:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:58.844680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c66c9-9dbc-4e73-bdb2-b2fafe95a515 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:58.866676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90e098-4b5b-40fa-ad7b-2d0df78b1aa7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:58.907350 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc235bb9-8d17-4a99-a0f1-aa205b2d705b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:58.908264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc235bb9-8d17-4a99-a0f1-aa205b2d705b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:58.908703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc235bb9-8d17-4a99-a0f1-aa205b2d705b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:58.909233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc235bb9-8d17-4a99-a0f1-aa205b2d705b None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:58.910177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc235bb9-8d17-4a99-a0f1-aa205b2d705b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:58.910637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc235bb9-8d17-4a99-a0f1-aa205b2d705b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:58.913028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc235bb9-8d17-4a99-a0f1-aa205b2d705b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:58.926321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 302/597] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:18:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:58.927657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc235bb9-8d17-4a99-a0f1-aa205b2d705b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:58.930444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:58.954427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:58.957416 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c66c9-9dbc-4e73-bdb2-b2fafe95a515 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:59.003919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f669f92-291a-4529-b4d2-efc2d9b265c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:59.006145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f669f92-291a-4529-b4d2-efc2d9b265c6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:59.006932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f669f92-291a-4529-b4d2-efc2d9b265c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:59.007680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f669f92-291a-4529-b4d2-efc2d9b265c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:59.009501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f669f92-291a-4529-b4d2-efc2d9b265c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:59.010262 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f669f92-291a-4529-b4d2-efc2d9b265c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:59.012021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f669f92-291a-4529-b4d2-efc2d9b265c6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:59.032007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 296/598] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:59.033304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f669f92-291a-4529-b4d2-efc2d9b265c6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:59.037937 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc235bb9-8d17-4a99-a0f1-aa205b2d705b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:59.074996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7167b1-7155-4417-974c-75f6e630c033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:59.075801 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7167b1-7155-4417-974c-75f6e630c033 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:59.076087 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7167b1-7155-4417-974c-75f6e630c033 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:59.076363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7167b1-7155-4417-974c-75f6e630c033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:59.090282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7167b1-7155-4417-974c-75f6e630c033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:59.091821 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7167b1-7155-4417-974c-75f6e630c033 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-fb7167b1-7155-4417-974c-75f6e630c033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:18:59.112044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:59.113173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:59.114399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:18:59.114399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:18:59.114399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:18:59.114399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:59.119746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 303/599] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:59.120654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7167b1-7155-4417-974c-75f6e630c033 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:59.148389 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f669f92-291a-4529-b4d2-efc2d9b265c6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:59.187239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bb2ee-b5e4-4f99-b4ee-2e0830e361e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:59.188481 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bb2ee-b5e4-4f99-b4ee-2e0830e361e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:59.189064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bb2ee-b5e4-4f99-b4ee-2e0830e361e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:59.189498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bb2ee-b5e4-4f99-b4ee-2e0830e361e1 None admin] PATH_INFO: `/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/64fd1405d96d435faba0c8857009f889/roles/11b992de70b244678ed4f0e082d92e7f` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:59.202255 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:59.207363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:59.224741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bb2ee-b5e4-4f99-b4ee-2e0830e361e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b341d104240e4b4cb61d365e8167f6a8, user_id=64fd1405d96d435faba0c8857009f889, role_id=11b992de70b244678ed4f0e082d92e7f)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:59.224741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bb2ee-b5e4-4f99-b4ee-2e0830e361e1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:59.232916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7167b1-7155-4417-974c-75f6e630c033 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:59.245746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 297/600] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:18:59 2022] PUT /identity/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/64fd1405d96d435faba0c8857009f889/roles/11b992de70b244678ed4f0e082d92e7f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:18:59.248068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bb2ee-b5e4-4f99-b4ee-2e0830e361e1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:59.310400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d43ae8-5e3e-41b9-8c0e-8a14ba7c57e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:59.311475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d43ae8-5e3e-41b9-8c0e-8a14ba7c57e9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:59.312900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d43ae8-5e3e-41b9-8c0e-8a14ba7c57e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:59.313192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d43ae8-5e3e-41b9-8c0e-8a14ba7c57e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:59.329899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d43ae8-5e3e-41b9-8c0e-8a14ba7c57e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:59.334718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d43ae8-5e3e-41b9-8c0e-8a14ba7c57e9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c5d43ae8-5e3e-41b9-8c0e-8a14ba7c57e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:18:59.352613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:59.353597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:59.354477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:18:59.354477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:18:59.354477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:18:59.354477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:18:59.354477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:18:59.354477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:18:59.354477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:59.354477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:18:59.354477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 304/601] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:59.360058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d43ae8-5e3e-41b9-8c0e-8a14ba7c57e9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:59.435887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bb2ee-b5e4-4f99-b4ee-2e0830e361e1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:59.471191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d43ae8-5e3e-41b9-8c0e-8a14ba7c57e9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:59.476613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a559918-6389-4690-9f7c-cc19ef85f08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:59.477331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559918-6389-4690-9f7c-cc19ef85f08e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:59.477613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559918-6389-4690-9f7c-cc19ef85f08e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:59.477887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a559918-6389-4690-9f7c-cc19ef85f08e None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:59.478612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a559918-6389-4690-9f7c-cc19ef85f08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:59.478918 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a559918-6389-4690-9f7c-cc19ef85f08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:59.480275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a559918-6389-4690-9f7c-cc19ef85f08e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:59.493302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 298/602] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:18:59.494515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb828d89-0e08-475d-9cfd-d4dfa765bee4 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:59.494807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb828d89-0e08-475d-9cfd-d4dfa765bee4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:59.495086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb828d89-0e08-475d-9cfd-d4dfa765bee4 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:59.496317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 299/603] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:18:59.501336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb828d89-0e08-475d-9cfd-d4dfa765bee4 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:59.512151 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e02fee-abda-4cad-b3e0-25f9f1596f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:59.512945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02fee-abda-4cad-b3e0-25f9f1596f63 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:59.513235 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02fee-abda-4cad-b3e0-25f9f1596f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:59.513510 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02fee-abda-4cad-b3e0-25f9f1596f63 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:59.514307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e02fee-abda-4cad-b3e0-25f9f1596f63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:18:59.514617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e02fee-abda-4cad-b3e0-25f9f1596f63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:59.516120 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e02fee-abda-4cad-b3e0-25f9f1596f63 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:59.519397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:59.531707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 305/604] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:18:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:18:59.533096 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3df0fc-fcf1-4d3f-9985-cc48bbb02b33 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:59.533382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3df0fc-fcf1-4d3f-9985-cc48bbb02b33 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:59.533657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3df0fc-fcf1-4d3f-9985-cc48bbb02b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:59.552347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-eb3df0fc-fcf1-4d3f-9985-cc48bbb02b33 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:18:59.554223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-eb3df0fc-fcf1-4d3f-9985-cc48bbb02b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:18:59.561891 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:59.634107 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb828d89-0e08-475d-9cfd-d4dfa765bee4 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:59.637245 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 306/605] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:18:59.638303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3df0fc-fcf1-4d3f-9985-cc48bbb02b33 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:59.693623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b2eea-88b3-47d0-a7a2-f66fd322990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:59.694350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b2eea-88b3-47d0-a7a2-f66fd322990f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:59.694629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b2eea-88b3-47d0-a7a2-f66fd322990f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:59.694903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b2eea-88b3-47d0-a7a2-f66fd322990f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:59.702122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b2eea-88b3-47d0-a7a2-f66fd322990f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:59.703599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b2eea-88b3-47d0-a7a2-f66fd322990f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-615b2eea-88b3-47d0-a7a2-f66fd322990f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:18:59.719102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:59.720003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:59.720917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:18:59.720917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:18:59.720917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:18:59.720917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:18:59.720917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:18:59.720917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:18:59.720917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:18:59.720917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:59.720917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 300/606] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:18:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:59.721543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b2eea-88b3-47d0-a7a2-f66fd322990f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:59.758357 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3df0fc-fcf1-4d3f-9985-cc48bbb02b33 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:59.786820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:59.796238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a2760-e80d-43b0-87df-5bafd65eed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:59.798977 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a2760-e80d-43b0-87df-5bafd65eed39 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:59.799417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a2760-e80d-43b0-87df-5bafd65eed39 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:59.799838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a2760-e80d-43b0-87df-5bafd65eed39 None admin] PATH_INFO: `/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/e854100c04be43c78bce1f95ff85bfc6/roles/11b992de70b244678ed4f0e082d92e7f` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:59.815724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a2760-e80d-43b0-87df-5bafd65eed39 None admin] RBAC: Authorizing `identity:create_grant(project_id=b341d104240e4b4cb61d365e8167f6a8, user_id=e854100c04be43c78bce1f95ff85bfc6, role_id=11b992de70b244678ed4f0e082d92e7f)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:18:59.817983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a2760-e80d-43b0-87df-5bafd65eed39 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:18:59.836651 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 307/607] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:18:59 2022] PUT /identity/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/e854100c04be43c78bce1f95ff85bfc6/roles/11b992de70b244678ed4f0e082d92e7f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:18:59.838100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a2760-e80d-43b0-87df-5bafd65eed39 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:18:59.840543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b2eea-88b3-47d0-a7a2-f66fd322990f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:18:59.854214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:18:59.916651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b1d53-3994-4626-9171-abeaf8ccb6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:18:59.918643 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b1d53-3994-4626-9171-abeaf8ccb6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:18:59.919123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b1d53-3994-4626-9171-abeaf8ccb6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:18:59.921676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b1d53-3994-4626-9171-abeaf8ccb6e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:18:59.950670 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b1d53-3994-4626-9171-abeaf8ccb6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-383b1d53-3994-4626-9171-abeaf8ccb6e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:18:59.964005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:18:59.965252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:18:59.966288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:18:59.966288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:18:59.966288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:18:59.966288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:18:59.966288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:18:59.966288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:18:59.966288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:18:59.966288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:18:59.966288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:18:59.966288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:18:59.966288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:18:59.966288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:18:59.977311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 301/608] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:18:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:18:59.983985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b1d53-3994-4626-9171-abeaf8ccb6e6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:00.057172 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a2760-e80d-43b0-87df-5bafd65eed39 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:00.127943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b1d53-3994-4626-9171-abeaf8ccb6e6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:00.171935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d757fa-d3af-4916-aedb-e30121f8343a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:00.172888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d757fa-d3af-4916-aedb-e30121f8343a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:00.173283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d757fa-d3af-4916-aedb-e30121f8343a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:00.173666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d757fa-d3af-4916-aedb-e30121f8343a None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:00.174588 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d757fa-d3af-4916-aedb-e30121f8343a None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:00.175008 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d757fa-d3af-4916-aedb-e30121f8343a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:00.177102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d757fa-d3af-4916-aedb-e30121f8343a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:00.187358 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 302/609] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:18:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:00.198017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d757fa-d3af-4916-aedb-e30121f8343a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:00.230140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1afe59-ca54-4b11-8229-c8350d2d6e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:00.230736 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1afe59-ca54-4b11-8229-c8350d2d6e36 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:00.231024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1afe59-ca54-4b11-8229-c8350d2d6e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:00.231301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1afe59-ca54-4b11-8229-c8350d2d6e36 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:00.232502 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:00.232770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1afe59-ca54-4b11-8229-c8350d2d6e36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:00.233590 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1afe59-ca54-4b11-8229-c8350d2d6e36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:00.235241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1afe59-ca54-4b11-8229-c8350d2d6e36 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:00.249909 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 308/610] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:18:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:00.256310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1afe59-ca54-4b11-8229-c8350d2d6e36 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:00.311887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d757fa-d3af-4916-aedb-e30121f8343a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:00.330059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:00.401307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1afe59-ca54-4b11-8229-c8350d2d6e36 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:00.412554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d472e-5418-48c4-b645-d3d60f2b7917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:00.413755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d472e-5418-48c4-b645-d3d60f2b7917 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:00.414271 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d472e-5418-48c4-b645-d3d60f2b7917 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:00.414751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d472e-5418-48c4-b645-d3d60f2b7917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:00.426079 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d472e-5418-48c4-b645-d3d60f2b7917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:00.427961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d472e-5418-48c4-b645-d3d60f2b7917 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:00.437707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34500a9-e43f-4691-890f-0332d9487a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:00.438603 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34500a9-e43f-4691-890f-0332d9487a89 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:00.438882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34500a9-e43f-4691-890f-0332d9487a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:00.439155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34500a9-e43f-4691-890f-0332d9487a89 None admin] PATH_INFO: `/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/d2ea8fd0ebfd42fdbed9a989d85c8787/roles/11b992de70b244678ed4f0e082d92e7f` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-217d472e-5418-48c4-b645-d3d60f2b7917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:00.447694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:00.448648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:00.450814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:00.450814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:00.450814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:00.450814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:00.454564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 303/611] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:00.457408 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6b1a4-3d87-4675-b70d-de128012f761 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:00.458753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6b1a4-3d87-4675-b70d-de128012f761 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:00.459717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6b1a4-3d87-4675-b70d-de128012f761 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:00.460516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34500a9-e43f-4691-890f-0332d9487a89 None admin] RBAC: Authorizing `identity:create_grant(project_id=b341d104240e4b4cb61d365e8167f6a8, user_id=d2ea8fd0ebfd42fdbed9a989d85c8787, role_id=11b992de70b244678ed4f0e082d92e7f)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:00.465768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34500a9-e43f-4691-890f-0332d9487a89 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:00.466058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 304/612] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:00.467214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6b1a4-3d87-4675-b70d-de128012f761 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:00.479833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 309/613] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:19:00 2022] PUT /identity/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/d2ea8fd0ebfd42fdbed9a989d85c8787/roles/11b992de70b244678ed4f0e082d92e7f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:19:00.481930 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be13b95-57f5-464b-9307-ab478b3daca8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:00.482488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be13b95-57f5-464b-9307-ab478b3daca8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:00.482938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be13b95-57f5-464b-9307-ab478b3daca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:00.502342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0be13b95-57f5-464b-9307-ab478b3daca8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:00.503976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0be13b95-57f5-464b-9307-ab478b3daca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:00.564834 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:00.584622 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 310/614] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:00.610306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6b1a4-3d87-4675-b70d-de128012f761 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:00.623774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be13b95-57f5-464b-9307-ab478b3daca8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:00.659278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:00.681776 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7188a-c59e-4524-be69-df8b877bae5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:00.682462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7188a-c59e-4524-be69-df8b877bae5c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:00.682812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7188a-c59e-4524-be69-df8b877bae5c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:00.683022 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7188a-c59e-4524-be69-df8b877bae5c None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:00.683767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7188a-c59e-4524-be69-df8b877bae5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:00.684076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7188a-c59e-4524-be69-df8b877bae5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:00.685499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7188a-c59e-4524-be69-df8b877bae5c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:00.714328 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 305/615] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:00.719836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7188a-c59e-4524-be69-df8b877bae5c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:00.797928 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be13b95-57f5-464b-9307-ab478b3daca8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:00.837072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb8c33-15c4-4657-8071-70ea818fecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:00.837876 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb8c33-15c4-4657-8071-70ea818fecb0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:00.838163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb8c33-15c4-4657-8071-70ea818fecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:00.838434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb8c33-15c4-4657-8071-70ea818fecb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:00.850171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb8c33-15c4-4657-8071-70ea818fecb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-cffb8c33-15c4-4657-8071-70ea818fecb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:00.858005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:00.858946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:00.859794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:00.859794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:00.859794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:00.859794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:00.859794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:00.859794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:00.859794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:00.859794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:00.859794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:00.859794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:00.859794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:00.859794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:00.863969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 311/616] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:19:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:00.865728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb8c33-15c4-4657-8071-70ea818fecb0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:00.867544 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7188a-c59e-4524-be69-df8b877bae5c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:00.949252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b067c1-8b09-4026-a509-b40b8e7b2ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:00.950115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b067c1-8b09-4026-a509-b40b8e7b2ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:00.950404 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b067c1-8b09-4026-a509-b40b8e7b2ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:00.950681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b067c1-8b09-4026-a509-b40b8e7b2ad4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:00.964019 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b067c1-8b09-4026-a509-b40b8e7b2ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:00.965483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b067c1-8b09-4026-a509-b40b8e7b2ad4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:00.980293 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-69b067c1-8b09-4026-a509-b40b8e7b2ad4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:00.996571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:00.997597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:00.998540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:00.998540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:00.998540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:00.998540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:00.998540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:00.998540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:00.998540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:00.998540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:00.998540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:19:00.998540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:01.002098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 306/617] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:19:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:01.003109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b067c1-8b09-4026-a509-b40b8e7b2ad4 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:01.004208 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:01.042046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb8c33-15c4-4657-8071-70ea818fecb0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:01.104880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fe359-9493-4c32-b27e-7866c6bde07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:01.105477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fe359-9493-4c32-b27e-7866c6bde07a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:01.105759 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fe359-9493-4c32-b27e-7866c6bde07a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:01.106035 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fe359-9493-4c32-b27e-7866c6bde07a None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:01.106791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fe359-9493-4c32-b27e-7866c6bde07a None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:01.107164 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fe359-9493-4c32-b27e-7866c6bde07a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:01.108754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fe359-9493-4c32-b27e-7866c6bde07a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:01.123221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 312/618] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:19:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:01.129790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fe359-9493-4c32-b27e-7866c6bde07a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:01.195750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b067c1-8b09-4026-a509-b40b8e7b2ad4 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:01.259984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5112d-9c35-4c82-8509-daa29a4b5293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:01.260666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5112d-9c35-4c82-8509-daa29a4b5293 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:01.260980 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5112d-9c35-4c82-8509-daa29a4b5293 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:01.261259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5112d-9c35-4c82-8509-daa29a4b5293 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:01.262110 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5112d-9c35-4c82-8509-daa29a4b5293 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:01.262426 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5112d-9c35-4c82-8509-daa29a4b5293 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:01.263860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5112d-9c35-4c82-8509-daa29a4b5293 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:01.297397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 307/619] 10.222.0.39 () {56 vars in 1135 bytes} [Thu May 26 12:19:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:01.301057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5112d-9c35-4c82-8509-daa29a4b5293 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:01.307054 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fe359-9493-4c32-b27e-7866c6bde07a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:01.375097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9472e30-9d36-419e-a30e-473be4702c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:01.375817 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9472e30-9d36-419e-a30e-473be4702c02 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:01.376097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9472e30-9d36-419e-a30e-473be4702c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:01.376370 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9472e30-9d36-419e-a30e-473be4702c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:01.388519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:01.395582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9472e30-9d36-419e-a30e-473be4702c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:01.398153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9472e30-9d36-419e-a30e-473be4702c02 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:01.421361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c9472e30-9d36-419e-a30e-473be4702c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:01.433723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:01.434700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:01.435616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:01.435616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:01.435616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:01.435616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:01.441554 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 313/620] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:01.444678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9472e30-9d36-419e-a30e-473be4702c02 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:01.503409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5112d-9c35-4c82-8509-daa29a4b5293 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:01.561542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69eb98-bcc6-4e79-ac60-75fd468de891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:01.562362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69eb98-bcc6-4e79-ac60-75fd468de891 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:01.562837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69eb98-bcc6-4e79-ac60-75fd468de891 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:01.563120 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69eb98-bcc6-4e79-ac60-75fd468de891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:01.576538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69eb98-bcc6-4e79-ac60-75fd468de891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:01.578512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69eb98-bcc6-4e79-ac60-75fd468de891 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-6d69eb98-bcc6-4e79-ac60-75fd468de891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:01.599791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:01.600882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:01.601766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:01.601766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:01.601766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:01.601766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:01.604850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 308/621] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:01.607922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69eb98-bcc6-4e79-ac60-75fd468de891 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:01.671540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9472e30-9d36-419e-a30e-473be4702c02 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:01.707450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce9c7b-ea65-4fd9-9588-fca10f27fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:01.708892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce9c7b-ea65-4fd9-9588-fca10f27fc8f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:01.709186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce9c7b-ea65-4fd9-9588-fca10f27fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:01.709515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce9c7b-ea65-4fd9-9588-fca10f27fc8f None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:01.710245 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce9c7b-ea65-4fd9-9588-fca10f27fc8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:01.710555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce9c7b-ea65-4fd9-9588-fca10f27fc8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:01.711927 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce9c7b-ea65-4fd9-9588-fca10f27fc8f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:01.728232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 314/622] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:01.729479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce9c7b-ea65-4fd9-9588-fca10f27fc8f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:01.777679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69eb98-bcc6-4e79-ac60-75fd468de891 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:01.791196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:01.821198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:01.822150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97258bbb-a67e-4b49-9825-6e6501d7f1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:01.822828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97258bbb-a67e-4b49-9825-6e6501d7f1af None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:01.823115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97258bbb-a67e-4b49-9825-6e6501d7f1af None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:01.823396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97258bbb-a67e-4b49-9825-6e6501d7f1af None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:01.824131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97258bbb-a67e-4b49-9825-6e6501d7f1af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:01.824441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97258bbb-a67e-4b49-9825-6e6501d7f1af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:01.825858 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97258bbb-a67e-4b49-9825-6e6501d7f1af None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:01.838690 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 309/623] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:01.840009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971f7e7-ce49-4d72-b8b4-0bd01981dec9 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:01.840309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971f7e7-ce49-4d72-b8b4-0bd01981dec9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:01.840600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971f7e7-ce49-4d72-b8b4-0bd01981dec9 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:01.846492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 310/624] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:01.847272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971f7e7-ce49-4d72-b8b4-0bd01981dec9 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:01.876820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce9c7b-ea65-4fd9-9588-fca10f27fc8f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:01.914092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a4006-5157-42f7-8c9c-42f7e5459b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:01.914704 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a4006-5157-42f7-8c9c-42f7e5459b40 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:01.914995 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a4006-5157-42f7-8c9c-42f7e5459b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:01.915275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a4006-5157-42f7-8c9c-42f7e5459b40 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:01.923351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a4006-5157-42f7-8c9c-42f7e5459b40 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:01.924777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a4006-5157-42f7-8c9c-42f7e5459b40 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-943a4006-5157-42f7-8c9c-42f7e5459b40 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:01.939199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:01.940387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:01.941775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:01.941775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:01.941775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:01.941775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:01.941775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:01.941775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:01.941775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:01.941775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:01.941775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:19:01.941775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:01.944823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 315/625] 10.222.0.39 () {56 vars in 1093 bytes} [Thu May 26 12:19:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:01.946071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b1b3f-9509-4304-a661-65aaf0b11d2a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:01.946365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b1b3f-9509-4304-a661-65aaf0b11d2a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:01.946648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b1b3f-9509-4304-a661-65aaf0b11d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:01.966282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b77b1b3f-9509-4304-a661-65aaf0b11d2a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:01.967498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b77b1b3f-9509-4304-a661-65aaf0b11d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:01.999149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971f7e7-ce49-4d72-b8b4-0bd01981dec9 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:02.040805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 316/626] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:02.040805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b1b3f-9509-4304-a661-65aaf0b11d2a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:02.058832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813d708-a879-4420-8035-2aad9742c744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:02.059887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813d708-a879-4420-8035-2aad9742c744 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:02.060322 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813d708-a879-4420-8035-2aad9742c744 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:02.060764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813d708-a879-4420-8035-2aad9742c744 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:02.071820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813d708-a879-4420-8035-2aad9742c744 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:02.073394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813d708-a879-4420-8035-2aad9742c744 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-d813d708-a879-4420-8035-2aad9742c744 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:02.093850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:02.095009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:02.096000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:02.096000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:02.096000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:02.096000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:02.096000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:02.096000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:02.096000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:02.096000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:02.096000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 311/627] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:02.096498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813d708-a879-4420-8035-2aad9742c744 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:02.102494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:02.143892 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:02.180623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b1b3f-9509-4304-a661-65aaf0b11d2a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:02.221313 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585db95f-a9d7-470f-aa02-9d7a879dc75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:02.222295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585db95f-a9d7-470f-aa02-9d7a879dc75c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:02.222763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585db95f-a9d7-470f-aa02-9d7a879dc75c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:02.223219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585db95f-a9d7-470f-aa02-9d7a879dc75c None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:02.224492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585db95f-a9d7-470f-aa02-9d7a879dc75c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:02.225010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585db95f-a9d7-470f-aa02-9d7a879dc75c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:02.226640 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585db95f-a9d7-470f-aa02-9d7a879dc75c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:02.242889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813d708-a879-4420-8035-2aad9742c744 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:02.250602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 317/628] 10.222.0.39 () {56 vars in 1133 bytes} [Thu May 26 12:19:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:02.251794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585db95f-a9d7-470f-aa02-9d7a879dc75c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:02.290619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0bdb8-2c69-4747-8568-fdfacb0a19f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:02.291745 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0bdb8-2c69-4747-8568-fdfacb0a19f2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:02.292212 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0bdb8-2c69-4747-8568-fdfacb0a19f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:02.292672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0bdb8-2c69-4747-8568-fdfacb0a19f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:02.303559 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0bdb8-2c69-4747-8568-fdfacb0a19f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-7fe0bdb8-2c69-4747-8568-fdfacb0a19f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:02.311631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:02.312580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:02.313467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:02.313467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:02.313467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:02.313467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:02.313467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:02.313467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:02.313467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:02.313467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:02.313467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:02.313467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:02.313467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:02.313467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:02.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 312/629] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:19:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:02.317983 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0bdb8-2c69-4747-8568-fdfacb0a19f2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:02.383088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:02.388944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585db95f-a9d7-470f-aa02-9d7a879dc75c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:02.425458 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:02.433261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b522ab-8a0b-44e1-acc1-30a7882e3c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:02.434157 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b522ab-8a0b-44e1-acc1-30a7882e3c1b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:02.434714 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b522ab-8a0b-44e1-acc1-30a7882e3c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:02.435287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b522ab-8a0b-44e1-acc1-30a7882e3c1b None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:02.436284 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b522ab-8a0b-44e1-acc1-30a7882e3c1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:02.436802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b522ab-8a0b-44e1-acc1-30a7882e3c1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:02.438214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0bdb8-2c69-4747-8568-fdfacb0a19f2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:02.438627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b522ab-8a0b-44e1-acc1-30a7882e3c1b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:02.456911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 318/630] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:02.458606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b522ab-8a0b-44e1-acc1-30a7882e3c1b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:02.478522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30221d8c-0006-44e3-b731-8f1f2d27eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:02.479653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30221d8c-0006-44e3-b731-8f1f2d27eda5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:02.480144 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30221d8c-0006-44e3-b731-8f1f2d27eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:02.480835 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30221d8c-0006-44e3-b731-8f1f2d27eda5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:02.556154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30221d8c-0006-44e3-b731-8f1f2d27eda5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:02.557648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30221d8c-0006-44e3-b731-8f1f2d27eda5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:02.582399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b522ab-8a0b-44e1-acc1-30a7882e3c1b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:02.617108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d788dd-0019-4058-8fc8-c73238f6be99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:02.617792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d788dd-0019-4058-8fc8-c73238f6be99 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:02.618078 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d788dd-0019-4058-8fc8-c73238f6be99 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:02.618359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d788dd-0019-4058-8fc8-c73238f6be99 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:02.619110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d788dd-0019-4058-8fc8-c73238f6be99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:02.619421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d788dd-0019-4058-8fc8-c73238f6be99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:02.620820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d788dd-0019-4058-8fc8-c73238f6be99 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:02.629322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 319/631] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:19:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:02.630732 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d788dd-0019-4058-8fc8-c73238f6be99 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:02.657178 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:02.661657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:02.672354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 313/632] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:19:02.678540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b5680-a325-4835-8aaa-227ce4c8dafa None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:02.678831 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b5680-a325-4835-8aaa-227ce4c8dafa None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:02.679101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b5680-a325-4835-8aaa-227ce4c8dafa None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:02.684364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 314/633] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:02.684364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b5680-a325-4835-8aaa-227ce4c8dafa None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:02.746479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d788dd-0019-4058-8fc8-c73238f6be99 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:02.782843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73612a44-3e5b-49fd-a800-26fcaa3ad49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:02.783726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73612a44-3e5b-49fd-a800-26fcaa3ad49f None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:02.784009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73612a44-3e5b-49fd-a800-26fcaa3ad49f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:02.784289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73612a44-3e5b-49fd-a800-26fcaa3ad49f None admin] PATH_INFO: `/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/691c9da310ef42a189bb78183867e46a/roles/11b992de70b244678ed4f0e082d92e7f` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:02.792388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b5680-a325-4835-8aaa-227ce4c8dafa None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:02.800421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73612a44-3e5b-49fd-a800-26fcaa3ad49f None admin] RBAC: Authorizing `identity:create_grant(project_id=b341d104240e4b4cb61d365e8167f6a8, user_id=691c9da310ef42a189bb78183867e46a, role_id=11b992de70b244678ed4f0e082d92e7f)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:02.802474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73612a44-3e5b-49fd-a800-26fcaa3ad49f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:02.816148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 320/634] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:19:02 2022] PUT /identity/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/691c9da310ef42a189bb78183867e46a/roles/11b992de70b244678ed4f0e082d92e7f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:19:02.817067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73612a44-3e5b-49fd-a800-26fcaa3ad49f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:02.842705 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafa623-c814-4404-afae-b9a47d3e4c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:02.844571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafa623-c814-4404-afae-b9a47d3e4c39 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:02.845130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafa623-c814-4404-afae-b9a47d3e4c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:02.845614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafa623-c814-4404-afae-b9a47d3e4c39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:02.863571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafa623-c814-4404-afae-b9a47d3e4c39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:02.869427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafa623-c814-4404-afae-b9a47d3e4c39 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-1fafa623-c814-4404-afae-b9a47d3e4c39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:02.896049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:02.897203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:02.898091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:02.898091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:02.898091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:02.898091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:02.901138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 315/635] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:02.902884 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b43a-107d-475c-bc2b-42798d4d044d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:02.903417 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b43a-107d-475c-bc2b-42798d4d044d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:02.904551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b43a-107d-475c-bc2b-42798d4d044d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:02.925764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:02.934462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9e26b43a-107d-475c-bc2b-42798d4d044d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:02.937890 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9e26b43a-107d-475c-bc2b-42798d4d044d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:02.972329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73612a44-3e5b-49fd-a800-26fcaa3ad49f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:02.989855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:03.020347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb81d6f-aef7-4e33-bd56-3fd773ee6da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:03.021246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb81d6f-aef7-4e33-bd56-3fd773ee6da3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:03.021816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb81d6f-aef7-4e33-bd56-3fd773ee6da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:03.021816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb81d6f-aef7-4e33-bd56-3fd773ee6da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:03.034330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb81d6f-aef7-4e33-bd56-3fd773ee6da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:03.034981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 316/636] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:03.035837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb81d6f-aef7-4e33-bd56-3fd773ee6da3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:03.037151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26b43a-107d-475c-bc2b-42798d4d044d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-efb81d6f-aef7-4e33-bd56-3fd773ee6da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:03.055892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:03.057012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:03.058214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:03.058214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:03.058214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:03.058214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:03.058214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 321/637] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:03.062790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb81d6f-aef7-4e33-bd56-3fd773ee6da3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:03.175634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26b43a-107d-475c-bc2b-42798d4d044d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:03.193005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb81d6f-aef7-4e33-bd56-3fd773ee6da3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:03.215917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828298a-a7d9-4852-b815-c880fd364104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:03.216615 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828298a-a7d9-4852-b815-c880fd364104 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:03.216933 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828298a-a7d9-4852-b815-c880fd364104 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:03.217211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828298a-a7d9-4852-b815-c880fd364104 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:03.217940 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828298a-a7d9-4852-b815-c880fd364104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:03.218289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828298a-a7d9-4852-b815-c880fd364104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:03.218432 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:03.219674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828298a-a7d9-4852-b815-c880fd364104 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:03.231335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca00f7-7e2d-4fc4-ad67-3183df5508a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:03.231845 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 317/638] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:03.232533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca00f7-7e2d-4fc4-ad67-3183df5508a7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:03.232643 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828298a-a7d9-4852-b815-c880fd364104 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:03.233152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca00f7-7e2d-4fc4-ad67-3183df5508a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:03.233532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca00f7-7e2d-4fc4-ad67-3183df5508a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:03.234363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca00f7-7e2d-4fc4-ad67-3183df5508a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:03.234799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca00f7-7e2d-4fc4-ad67-3183df5508a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:03.236273 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca00f7-7e2d-4fc4-ad67-3183df5508a7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:03.252883 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 322/639] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:03.254290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adad6c-90d5-4910-a99a-6d9a55b2f2a4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:03.254577 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adad6c-90d5-4910-a99a-6d9a55b2f2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:03.255450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adad6c-90d5-4910-a99a-6d9a55b2f2a4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:03.256693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 323/640] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:03.257584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adad6c-90d5-4910-a99a-6d9a55b2f2a4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:03.275105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:03.350178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828298a-a7d9-4852-b815-c880fd364104 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:03.365899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adad6c-90d5-4910-a99a-6d9a55b2f2a4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:03.386662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc2164-ed19-4118-9ed0-418d4cbe0d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:03.387461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc2164-ed19-4118-9ed0-418d4cbe0d97 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:03.387745 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc2164-ed19-4118-9ed0-418d4cbe0d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:03.388020 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc2164-ed19-4118-9ed0-418d4cbe0d97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:03.400134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc2164-ed19-4118-9ed0-418d4cbe0d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:03.401105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00771926-cd83-4096-93c9-1edca384f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:03.401897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00771926-cd83-4096-93c9-1edca384f295 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:03.402183 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00771926-cd83-4096-93c9-1edca384f295 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:03.402460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00771926-cd83-4096-93c9-1edca384f295 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-d9bc2164-ed19-4118-9ed0-418d4cbe0d97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:03.408370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:03.409527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:03.410394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:03.410394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:03.410394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:03.410394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:03.410394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:03.410394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:03.410394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:03.410394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:03.410394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:03.410394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:03.410394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:03.410394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:03.410394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 318/641] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:19:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:03.411895 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc2164-ed19-4118-9ed0-418d4cbe0d97 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:03.413786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00771926-cd83-4096-93c9-1edca384f295 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:03.415360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00771926-cd83-4096-93c9-1edca384f295 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-00771926-cd83-4096-93c9-1edca384f295 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:03.430332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:03.431398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:03.432368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:03.432368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:03.432368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:03.432368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:03.432368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:03.432368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:03.432368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:03.432368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:03.432368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:19:03.432368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:03.432368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 324/642] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:19:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:03.433556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72bb76-8979-4c77-92cb-ebd9dd8f1ac2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:03.433556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72bb76-8979-4c77-92cb-ebd9dd8f1ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:03.433726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72bb76-8979-4c77-92cb-ebd9dd8f1ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:03.451009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6e72bb76-8979-4c77-92cb-ebd9dd8f1ac2 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:03.452186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6e72bb76-8979-4c77-92cb-ebd9dd8f1ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:03.492731 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:03.516860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:03.527430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc2164-ed19-4118-9ed0-418d4cbe0d97 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:03.544736 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 325/643] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:03.544736 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72bb76-8979-4c77-92cb-ebd9dd8f1ac2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:03.564427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261ebbd-6f36-4a63-b2ac-98bc217566ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:03.565690 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261ebbd-6f36-4a63-b2ac-98bc217566ab None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:03.566416 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261ebbd-6f36-4a63-b2ac-98bc217566ab None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:03.566871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261ebbd-6f36-4a63-b2ac-98bc217566ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:03.576938 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261ebbd-6f36-4a63-b2ac-98bc217566ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:03.578994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261ebbd-6f36-4a63-b2ac-98bc217566ab None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-c261ebbd-6f36-4a63-b2ac-98bc217566ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:03.595866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:03.597005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:03.602151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:03.602151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:03.602151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:03.602151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:03.602151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:03.602151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:03.602151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:03.602151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:03.602151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 319/644] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:03.602151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261ebbd-6f36-4a63-b2ac-98bc217566ab None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:03.663998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72bb76-8979-4c77-92cb-ebd9dd8f1ac2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:03.701383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61041-3a3b-407f-925b-95874736da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:03.701954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61041-3a3b-407f-925b-95874736da88 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:03.702242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61041-3a3b-407f-925b-95874736da88 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:03.702519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61041-3a3b-407f-925b-95874736da88 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:03.703267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c61041-3a3b-407f-925b-95874736da88 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:03.703576 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c61041-3a3b-407f-925b-95874736da88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:03.704979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c61041-3a3b-407f-925b-95874736da88 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:03.710450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261ebbd-6f36-4a63-b2ac-98bc217566ab None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:03.713290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 326/645] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:19:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:03.714162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61041-3a3b-407f-925b-95874736da88 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:03.749859 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93518c41-a784-4f8c-a8f0-8db0403b5f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:03.750589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:03.750760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93518c41-a784-4f8c-a8f0-8db0403b5f15 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:03.751166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93518c41-a784-4f8c-a8f0-8db0403b5f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:03.751543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93518c41-a784-4f8c-a8f0-8db0403b5f15 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:03.752493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93518c41-a784-4f8c-a8f0-8db0403b5f15 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:03.752944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93518c41-a784-4f8c-a8f0-8db0403b5f15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:03.754470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93518c41-a784-4f8c-a8f0-8db0403b5f15 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:03.777521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 320/646] 10.222.0.39 () {56 vars in 1137 bytes} [Thu May 26 12:19:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:03.778459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93518c41-a784-4f8c-a8f0-8db0403b5f15 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:03.792227 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:03.822149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61041-3a3b-407f-925b-95874736da88 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:03.858007 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d5dd8-5bae-40f7-8dd5-30d5f8cfebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:03.858941 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d5dd8-5bae-40f7-8dd5-30d5f8cfebf8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:03.859337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d5dd8-5bae-40f7-8dd5-30d5f8cfebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:03.859710 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d5dd8-5bae-40f7-8dd5-30d5f8cfebf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:03.871589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d5dd8-5bae-40f7-8dd5-30d5f8cfebf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-975d5dd8-5bae-40f7-8dd5-30d5f8cfebf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:03.879724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:03.880756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:03.881629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:03.881629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:03.881629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:03.881629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:03.881629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:03.881629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:03.881629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:03.881629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:03.881629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:03.881629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:03.881629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:03.881629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:03.886132 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 327/647] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:19:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:03.887089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d5dd8-5bae-40f7-8dd5-30d5f8cfebf8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:03.893289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93518c41-a784-4f8c-a8f0-8db0403b5f15 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:03.931521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285672f-e37b-4189-aa85-3e8ff9cd55de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:03.932304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285672f-e37b-4189-aa85-3e8ff9cd55de None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:03.932585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285672f-e37b-4189-aa85-3e8ff9cd55de None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:03.932888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285672f-e37b-4189-aa85-3e8ff9cd55de None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:03.933806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285672f-e37b-4189-aa85-3e8ff9cd55de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:03.934118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285672f-e37b-4189-aa85-3e8ff9cd55de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:03.935550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285672f-e37b-4189-aa85-3e8ff9cd55de None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:03.953265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 321/648] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:03.954062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285672f-e37b-4189-aa85-3e8ff9cd55de None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:03.989082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:03.997826 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d5dd8-5bae-40f7-8dd5-30d5f8cfebf8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:04.029578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:04.039117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ce65f-b443-4a74-a2ba-6a6d907c1cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:04.039933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ce65f-b443-4a74-a2ba-6a6d907c1cbc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:04.040221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ce65f-b443-4a74-a2ba-6a6d907c1cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:04.040502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ce65f-b443-4a74-a2ba-6a6d907c1cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:04.053156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ce65f-b443-4a74-a2ba-6a6d907c1cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:04.055825 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ce65f-b443-4a74-a2ba-6a6d907c1cbc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:04.063695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285672f-e37b-4189-aa85-3e8ff9cd55de None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-098ce65f-b443-4a74-a2ba-6a6d907c1cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:04.075195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:04.076113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:04.077047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:04.077047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:04.077047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:04.077047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:04.077047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 328/649] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:04.078031 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ce65f-b443-4a74-a2ba-6a6d907c1cbc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:04.106896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6365cd-2112-460f-b1ea-6b04b00218ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:04.107687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6365cd-2112-460f-b1ea-6b04b00218ff None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:04.107961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6365cd-2112-460f-b1ea-6b04b00218ff None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:04.108244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6365cd-2112-460f-b1ea-6b04b00218ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:04.183771 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ce65f-b443-4a74-a2ba-6a6d907c1cbc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:04.184975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6365cd-2112-460f-b1ea-6b04b00218ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:04.186860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6365cd-2112-460f-b1ea-6b04b00218ff None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:04.218600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787ae8-fdba-4048-9c49-ed2fef98fb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:04.219195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787ae8-fdba-4048-9c49-ed2fef98fb7c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:04.219478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787ae8-fdba-4048-9c49-ed2fef98fb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:04.219755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71787ae8-fdba-4048-9c49-ed2fef98fb7c None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:04.220533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71787ae8-fdba-4048-9c49-ed2fef98fb7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:04.220875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71787ae8-fdba-4048-9c49-ed2fef98fb7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:04.222262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71787ae8-fdba-4048-9c49-ed2fef98fb7c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:04.232758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 329/650] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:19:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:04.232758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787ae8-fdba-4048-9c49-ed2fef98fb7c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:04.243763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:04.267656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:04.307995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 322/651] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:19:04.307995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6365cd-2112-460f-b1ea-6b04b00218ff None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:04.343864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71787ae8-fdba-4048-9c49-ed2fef98fb7c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:04.378680 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb662080-5504-41cf-813c-f4db2c9dcaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:04.379334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb662080-5504-41cf-813c-f4db2c9dcaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:04.379619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb662080-5504-41cf-813c-f4db2c9dcaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:04.379925 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb662080-5504-41cf-813c-f4db2c9dcaa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:04.380789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb662080-5504-41cf-813c-f4db2c9dcaa6 None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=04f5fbbe45ec4dcf8301da8483af2941) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:04.381109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb662080-5504-41cf-813c-f4db2c9dcaa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:04.382543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb662080-5504-41cf-813c-f4db2c9dcaa6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:04.388339 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 330/652] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:04 2022] GET /identity/v3/role_assignments?user.id=04f5fbbe45ec4dcf8301da8483af2941&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:04.389155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb662080-5504-41cf-813c-f4db2c9dcaa6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:04.420880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6365cd-2112-460f-b1ea-6b04b00218ff None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:04.471512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ae62d-1c38-4553-bb94-55488168c7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:04.472121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ae62d-1c38-4553-bb94-55488168c7cb None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:04.472406 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ae62d-1c38-4553-bb94-55488168c7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:04.472688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ae62d-1c38-4553-bb94-55488168c7cb None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:04.473999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ae62d-1c38-4553-bb94-55488168c7cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:04.474386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ae62d-1c38-4553-bb94-55488168c7cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:04.476347 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ae62d-1c38-4553-bb94-55488168c7cb None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:04.482102 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:04.496165 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 323/653] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:04.497762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ae62d-1c38-4553-bb94-55488168c7cb None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:04.519071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb662080-5504-41cf-813c-f4db2c9dcaa6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:04.540896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:04.559669 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5779065-7503-4d8b-973d-74084dd4a652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:04.560491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5779065-7503-4d8b-973d-74084dd4a652 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:04.563061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5779065-7503-4d8b-973d-74084dd4a652 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:04.563061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5779065-7503-4d8b-973d-74084dd4a652 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:04.578094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5779065-7503-4d8b-973d-74084dd4a652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:04.580106 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5779065-7503-4d8b-973d-74084dd4a652 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-d5779065-7503-4d8b-973d-74084dd4a652 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:04.604410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:04.605388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:04.606291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:04.606291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:04.606291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:04.606291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:04.606291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 331/654] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:04.606652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5779065-7503-4d8b-973d-74084dd4a652 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:04.634429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ae62d-1c38-4553-bb94-55488168c7cb None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:04.673033 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f8273-a740-4df1-9202-dea852544808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:04.674232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f8273-a740-4df1-9202-dea852544808 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:04.674734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f8273-a740-4df1-9202-dea852544808 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:04.675254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f8273-a740-4df1-9202-dea852544808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:04.688961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f8273-a740-4df1-9202-dea852544808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:04.690685 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f8273-a740-4df1-9202-dea852544808 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-562f8273-a740-4df1-9202-dea852544808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:04.713721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:04.714682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:04.715573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:04.715573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:04.715573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:04.715573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:04.716106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 324/655] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:04.716920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f8273-a740-4df1-9202-dea852544808 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:04.732033 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5779065-7503-4d8b-973d-74084dd4a652 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:04.761768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:04.776318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f43410-69ec-493e-a8e9-3db2525da382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:04.777288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f43410-69ec-493e-a8e9-3db2525da382 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:04.777575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f43410-69ec-493e-a8e9-3db2525da382 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:04.777963 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f43410-69ec-493e-a8e9-3db2525da382 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:04.787736 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f43410-69ec-493e-a8e9-3db2525da382 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:04.789252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f43410-69ec-493e-a8e9-3db2525da382 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f8f43410-69ec-493e-a8e9-3db2525da382 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:04.805358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:04.806347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:04.807262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:04.807262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:04.807262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:04.807262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:04.807262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:04.807262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:04.807262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:04.807262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:04.807262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:19:04.807262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:04.807262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 332/656] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:19:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:04.807864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f43410-69ec-493e-a8e9-3db2525da382 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:04.821762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:04.845214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f8273-a740-4df1-9202-dea852544808 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:04.894806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617711f-8b23-49c5-b8f9-682d3733460c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:04.896380 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617711f-8b23-49c5-b8f9-682d3733460c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:04.897441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617711f-8b23-49c5-b8f9-682d3733460c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:04.897798 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617711f-8b23-49c5-b8f9-682d3733460c None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:04.898621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617711f-8b23-49c5-b8f9-682d3733460c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:04.899003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617711f-8b23-49c5-b8f9-682d3733460c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:04.901207 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617711f-8b23-49c5-b8f9-682d3733460c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:04.924372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 325/657] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:04.926531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617711f-8b23-49c5-b8f9-682d3733460c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:04.934236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f43410-69ec-493e-a8e9-3db2525da382 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:04.984846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9eee0-9341-44cc-a4c6-f3f146e24da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:04.985064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9eee0-9341-44cc-a4c6-f3f146e24da8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:04.985291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9eee0-9341-44cc-a4c6-f3f146e24da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:04.985496 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9eee0-9341-44cc-a4c6-f3f146e24da8 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:04.986224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9eee0-9341-44cc-a4c6-f3f146e24da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:04.986535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9eee0-9341-44cc-a4c6-f3f146e24da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:04.987974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9eee0-9341-44cc-a4c6-f3f146e24da8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:05.006933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 333/658] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:05.007914 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9eee0-9341-44cc-a4c6-f3f146e24da8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:05.057766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:05.069836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617711f-8b23-49c5-b8f9-682d3733460c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:05.109428 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ed5e0-62f0-4e8a-b5d9-cc0577eccc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:05.110538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ed5e0-62f0-4e8a-b5d9-cc0577eccc7b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:05.111061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ed5e0-62f0-4e8a-b5d9-cc0577eccc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:05.111577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ed5e0-62f0-4e8a-b5d9-cc0577eccc7b None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:05.112604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ed5e0-62f0-4e8a-b5d9-cc0577eccc7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:05.113245 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ed5e0-62f0-4e8a-b5d9-cc0577eccc7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:05.115094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ed5e0-62f0-4e8a-b5d9-cc0577eccc7b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:05.117433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9eee0-9341-44cc-a4c6-f3f146e24da8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:05.135188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 326/659] 10.222.0.39 () {56 vars in 1137 bytes} [Thu May 26 12:19:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:05.135467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:05.137287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ed5e0-62f0-4e8a-b5d9-cc0577eccc7b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:05.154981 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7afc23-b121-4c58-be88-d8bcbc78788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:05.155790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7afc23-b121-4c58-be88-d8bcbc78788e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:05.156078 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7afc23-b121-4c58-be88-d8bcbc78788e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:05.156351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7afc23-b121-4c58-be88-d8bcbc78788e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:05.164841 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7afc23-b121-4c58-be88-d8bcbc78788e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:05.166384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7afc23-b121-4c58-be88-d8bcbc78788e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-2d7afc23-b121-4c58-be88-d8bcbc78788e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:05.181664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:05.182805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:05.183951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:05.183951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:05.183951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:05.183951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:05.183951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:05.183951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:05.183951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:05.183951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:05.183951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:19:05.183951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:05.183951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 334/660] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:19:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:05.183951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7afc23-b121-4c58-be88-d8bcbc78788e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:05.246702 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ed5e0-62f0-4e8a-b5d9-cc0577eccc7b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:05.282003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0e4ed-0cdd-469e-845f-75ec879b17d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:05.282875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0e4ed-0cdd-469e-845f-75ec879b17d5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:05.283162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0e4ed-0cdd-469e-845f-75ec879b17d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:05.283440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0e4ed-0cdd-469e-845f-75ec879b17d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:05.290787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0e4ed-0cdd-469e-845f-75ec879b17d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:05.292234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0e4ed-0cdd-469e-845f-75ec879b17d5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:05.297019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7afc23-b121-4c58-be88-d8bcbc78788e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:05.300148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-14a0e4ed-0cdd-469e-845f-75ec879b17d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:05.306699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:05.307623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:05.308538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:05.308538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:05.308538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:05.308538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:05.308538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:05.308538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:05.308538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:05.308538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:05.312406 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 327/661] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:05.313663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70509e-2b5a-4bd2-815a-6f3dff76cdd8 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:05.313956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70509e-2b5a-4bd2-815a-6f3dff76cdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:05.314241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70509e-2b5a-4bd2-815a-6f3dff76cdd8 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:05.315513 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 328/662] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:05.316222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70509e-2b5a-4bd2-815a-6f3dff76cdd8 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:05.341766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58c4bf-f6c6-4c02-8245-369dd2ccb58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:05.342823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58c4bf-f6c6-4c02-8245-369dd2ccb58b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:05.343301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58c4bf-f6c6-4c02-8245-369dd2ccb58b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:05.343648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58c4bf-f6c6-4c02-8245-369dd2ccb58b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:05.379065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:05.419769 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58c4bf-f6c6-4c02-8245-369dd2ccb58b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:05.421273 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58c4bf-f6c6-4c02-8245-369dd2ccb58b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:05.425282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70509e-2b5a-4bd2-815a-6f3dff76cdd8 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:05.461301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97733b29-14d8-43dd-a53d-da51c74301c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:05.461975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97733b29-14d8-43dd-a53d-da51c74301c8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:05.462681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97733b29-14d8-43dd-a53d-da51c74301c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:05.462972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97733b29-14d8-43dd-a53d-da51c74301c8 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:05.463814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97733b29-14d8-43dd-a53d-da51c74301c8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:05.464407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97733b29-14d8-43dd-a53d-da51c74301c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:05.465590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97733b29-14d8-43dd-a53d-da51c74301c8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:05.491403 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 329/663] 10.222.0.39 () {56 vars in 1139 bytes} [Thu May 26 12:19:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:05.492046 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97733b29-14d8-43dd-a53d-da51c74301c8 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:05.527738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 335/664] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:19:05.528985 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276664c-6d3c-4413-91f9-f629d3640203 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:05.529272 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276664c-6d3c-4413-91f9-f629d3640203 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:05.529552 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276664c-6d3c-4413-91f9-f629d3640203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:05.535716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:05.547075 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f276664c-6d3c-4413-91f9-f629d3640203 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:05.548259 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f276664c-6d3c-4413-91f9-f629d3640203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:05.606381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97733b29-14d8-43dd-a53d-da51c74301c8 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:05.620760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 336/665] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:05.620760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276664c-6d3c-4413-91f9-f629d3640203 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:05.629554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:05.649457 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bfa4d-1ca6-4f17-8304-4523c05e5083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:05.650532 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bfa4d-1ca6-4f17-8304-4523c05e5083 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:05.651158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bfa4d-1ca6-4f17-8304-4523c05e5083 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:05.651514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289bfa4d-1ca6-4f17-8304-4523c05e5083 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:05.652321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bfa4d-1ca6-4f17-8304-4523c05e5083 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:05.652639 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bfa4d-1ca6-4f17-8304-4523c05e5083 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:05.654213 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289bfa4d-1ca6-4f17-8304-4523c05e5083 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:05.667960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 330/666] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:05.668605 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bfa4d-1ca6-4f17-8304-4523c05e5083 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:05.741464 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276664c-6d3c-4413-91f9-f629d3640203 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:05.780559 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289bfa4d-1ca6-4f17-8304-4523c05e5083 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:05.782093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edd52b-16b6-4070-bc2b-19f372c75672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:05.782748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edd52b-16b6-4070-bc2b-19f372c75672 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:05.783036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edd52b-16b6-4070-bc2b-19f372c75672 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:05.783976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edd52b-16b6-4070-bc2b-19f372c75672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:05.786838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:05.818941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adb89d-1e0c-4fc3-ace6-9a57cf9bea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:05.819742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb89d-1e0c-4fc3-ace6-9a57cf9bea52 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:05.820033 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb89d-1e0c-4fc3-ace6-9a57cf9bea52 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:05.820313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb89d-1e0c-4fc3-ace6-9a57cf9bea52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:05.831155 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adb89d-1e0c-4fc3-ace6-9a57cf9bea52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:05.832606 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adb89d-1e0c-4fc3-ace6-9a57cf9bea52 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-25adb89d-1e0c-4fc3-ace6-9a57cf9bea52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:05.850505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:05.851451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:05.852355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:05.852355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:05.852355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:05.852355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:05.856253 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 331/667] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:05.857125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adb89d-1e0c-4fc3-ace6-9a57cf9bea52 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:05.867470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edd52b-16b6-4070-bc2b-19f372c75672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:05.868967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edd52b-16b6-4070-bc2b-19f372c75672 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:05.889396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:05.964304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adb89d-1e0c-4fc3-ace6-9a57cf9bea52 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:05.988656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 337/668] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:19:05.988656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edd52b-16b6-4070-bc2b-19f372c75672 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:05.999962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47d607-2546-48dc-b260-0c639a040462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:06.002118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47d607-2546-48dc-b260-0c639a040462 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:06.002118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47d607-2546-48dc-b260-0c639a040462 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:06.002118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47d607-2546-48dc-b260-0c639a040462 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:06.014009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47d607-2546-48dc-b260-0c639a040462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-7a47d607-2546-48dc-b260-0c639a040462 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:06.022935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:06.023849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:06.024696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:06.024696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:06.024696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:06.024696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:06.024696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:06.024696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:06.024696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:06.024696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:06.024696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:06.024696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:06.024696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:06.024696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:06.024696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 332/669] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:19:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:06.025418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47d607-2546-48dc-b260-0c639a040462 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:06.032186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:06.104180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edd52b-16b6-4070-bc2b-19f372c75672 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:06.122844 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:06.133960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47d607-2546-48dc-b260-0c639a040462 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:06.140967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46770309-ee42-427b-a3af-71c5405e9a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:06.141628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46770309-ee42-427b-a3af-71c5405e9a7c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:06.141916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46770309-ee42-427b-a3af-71c5405e9a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:06.142446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46770309-ee42-427b-a3af-71c5405e9a7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:06.143280 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46770309-ee42-427b-a3af-71c5405e9a7c None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=64fd1405d96d435faba0c8857009f889) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:06.143604 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46770309-ee42-427b-a3af-71c5405e9a7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:06.145073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46770309-ee42-427b-a3af-71c5405e9a7c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:06.152330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 338/670] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:05 2022] GET /identity/v3/role_assignments?user.id=64fd1405d96d435faba0c8857009f889&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:06.153143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46770309-ee42-427b-a3af-71c5405e9a7c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:06.181478 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f010df3-44e7-4afd-a76c-fd84e6e79460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:06.182578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f010df3-44e7-4afd-a76c-fd84e6e79460 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:06.183073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f010df3-44e7-4afd-a76c-fd84e6e79460 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:06.183528 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f010df3-44e7-4afd-a76c-fd84e6e79460 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:06.184469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f010df3-44e7-4afd-a76c-fd84e6e79460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:06.185160 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f010df3-44e7-4afd-a76c-fd84e6e79460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:06.186660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f010df3-44e7-4afd-a76c-fd84e6e79460 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:06.204530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 333/671] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:06.205868 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f010df3-44e7-4afd-a76c-fd84e6e79460 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:06.292334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:06.299913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46770309-ee42-427b-a3af-71c5405e9a7c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:06.341019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c1417-c911-4b3d-a17e-f1485fa44bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:06.341829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1417-c911-4b3d-a17e-f1485fa44bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:06.342115 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1417-c911-4b3d-a17e-f1485fa44bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:06.342393 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c1417-c911-4b3d-a17e-f1485fa44bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:06.356810 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c1417-c911-4b3d-a17e-f1485fa44bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:06.358492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c1417-c911-4b3d-a17e-f1485fa44bf2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:06.364937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f010df3-44e7-4afd-a76c-fd84e6e79460 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8d6c1417-c911-4b3d-a17e-f1485fa44bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:06.377182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:06.378140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:06.379170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:06.379170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:06.379170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:06.379170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:06.379528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 339/672] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:06.380235 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c1417-c911-4b3d-a17e-f1485fa44bf2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:06.412703 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150eae5-e33e-41e0-80fb-5dee26651a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:06.413395 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150eae5-e33e-41e0-80fb-5dee26651a87 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:06.413784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150eae5-e33e-41e0-80fb-5dee26651a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:06.414071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150eae5-e33e-41e0-80fb-5dee26651a87 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:06.414844 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150eae5-e33e-41e0-80fb-5dee26651a87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:06.415150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150eae5-e33e-41e0-80fb-5dee26651a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:06.416623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150eae5-e33e-41e0-80fb-5dee26651a87 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:06.429030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 334/673] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:19:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:06.429924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150eae5-e33e-41e0-80fb-5dee26651a87 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:06.446130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:06.503535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c1417-c911-4b3d-a17e-f1485fa44bf2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:06.540086 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c387b3-4f04-4323-9eb1-12a88d412de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:06.540635 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c387b3-4f04-4323-9eb1-12a88d412de8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:06.540955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c387b3-4f04-4323-9eb1-12a88d412de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:06.541272 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c387b3-4f04-4323-9eb1-12a88d412de8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:06.544244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150eae5-e33e-41e0-80fb-5dee26651a87 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:06.548665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c387b3-4f04-4323-9eb1-12a88d412de8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:06.550166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c387b3-4f04-4323-9eb1-12a88d412de8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-d3c387b3-4f04-4323-9eb1-12a88d412de8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:06.565871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:06.567059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:06.568782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:06.568782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:06.568782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:06.568782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:06.568782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:06.568782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:06.568782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:06.568782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:06.568782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 340/674] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:06.569685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c387b3-4f04-4323-9eb1-12a88d412de8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:06.581942 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:06.595025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cc838-bd3c-4772-96cf-c315fa946401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:06.596261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cc838-bd3c-4772-96cf-c315fa946401 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:06.596771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cc838-bd3c-4772-96cf-c315fa946401 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:06.597648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cc838-bd3c-4772-96cf-c315fa946401 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:06.599379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cc838-bd3c-4772-96cf-c315fa946401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:06.600164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cc838-bd3c-4772-96cf-c315fa946401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:06.602512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cc838-bd3c-4772-96cf-c315fa946401 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:06.622062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 335/675] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:06.623318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cc838-bd3c-4772-96cf-c315fa946401 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:06.695487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c387b3-4f04-4323-9eb1-12a88d412de8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:06.725687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:06.735814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d70989-9a6a-468c-ad0c-68297f8d65b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:06.736951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d70989-9a6a-468c-ad0c-68297f8d65b9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:06.737181 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d70989-9a6a-468c-ad0c-68297f8d65b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:06.737530 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d70989-9a6a-468c-ad0c-68297f8d65b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:06.749960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d70989-9a6a-468c-ad0c-68297f8d65b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:06.751504 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d70989-9a6a-468c-ad0c-68297f8d65b9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:06.765802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cc838-bd3c-4772-96cf-c315fa946401 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-51d70989-9a6a-468c-ad0c-68297f8d65b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:06.773239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:06.774150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:06.775038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:06.775038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:06.775038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:06.775038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:06.779051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 341/676] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:06.779960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d70989-9a6a-468c-ad0c-68297f8d65b9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:06.812359 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96617125-6926-4778-87ef-ab890c79979b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:06.813902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96617125-6926-4778-87ef-ab890c79979b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:06.814401 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96617125-6926-4778-87ef-ab890c79979b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:06.814860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96617125-6926-4778-87ef-ab890c79979b None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:06.816034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96617125-6926-4778-87ef-ab890c79979b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:06.816534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96617125-6926-4778-87ef-ab890c79979b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:06.819519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96617125-6926-4778-87ef-ab890c79979b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:06.835684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 336/677] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:06.836883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96617125-6926-4778-87ef-ab890c79979b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:06.855165 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:06.908820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d70989-9a6a-468c-ad0c-68297f8d65b9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:06.948572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96617125-6926-4778-87ef-ab890c79979b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:06.949199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471dc29-2c0a-4353-8560-04e538bca2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:06.950131 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471dc29-2c0a-4353-8560-04e538bca2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:06.950419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471dc29-2c0a-4353-8560-04e538bca2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:06.951502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471dc29-2c0a-4353-8560-04e538bca2d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:06.958260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471dc29-2c0a-4353-8560-04e538bca2d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:06.959850 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471dc29-2c0a-4353-8560-04e538bca2d3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-3471dc29-2c0a-4353-8560-04e538bca2d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:06.975720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:06.976621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:06.977548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:06.977548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:06.977548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:06.977548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:06.977548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:06.977548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:06.977548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:06.977548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:06.977548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 342/678] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:06.978642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471dc29-2c0a-4353-8560-04e538bca2d3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:06.982926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:06.989870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbab27d-cb88-4c4a-8654-885bc8570c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:06.990685 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab27d-cb88-4c4a-8654-885bc8570c44 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:06.990970 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab27d-cb88-4c4a-8654-885bc8570c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:06.991258 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbab27d-cb88-4c4a-8654-885bc8570c44 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:06.992061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbab27d-cb88-4c4a-8654-885bc8570c44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:06.992373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbab27d-cb88-4c4a-8654-885bc8570c44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:06.994586 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbab27d-cb88-4c4a-8654-885bc8570c44 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:07.010558 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 337/679] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:07.011892 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287c163-37a9-4aae-af49-153848f3ec4a None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:07.012185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287c163-37a9-4aae-af49-153848f3ec4a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:07.012462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287c163-37a9-4aae-af49-153848f3ec4a None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:07.018000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 338/680] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:07.018625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287c163-37a9-4aae-af49-153848f3ec4a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:07.091275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471dc29-2c0a-4353-8560-04e538bca2d3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:07.115275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:07.128348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded86a4-53b2-45a6-85a1-6646e20f3846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:07.128781 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287c163-37a9-4aae-af49-153848f3ec4a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:07.129049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded86a4-53b2-45a6-85a1-6646e20f3846 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:07.129333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded86a4-53b2-45a6-85a1-6646e20f3846 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:07.129612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded86a4-53b2-45a6-85a1-6646e20f3846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:07.130491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded86a4-53b2-45a6-85a1-6646e20f3846 None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=e854100c04be43c78bce1f95ff85bfc6) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:07.130808 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded86a4-53b2-45a6-85a1-6646e20f3846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:07.132251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded86a4-53b2-45a6-85a1-6646e20f3846 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:07.148751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 343/681] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:06 2022] GET /identity/v3/role_assignments?user.id=e854100c04be43c78bce1f95ff85bfc6&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:07.148751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded86a4-53b2-45a6-85a1-6646e20f3846 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:07.166687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47486adc-30ef-4f02-a9b1-7578092056b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:07.167484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47486adc-30ef-4f02-a9b1-7578092056b5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:07.167819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47486adc-30ef-4f02-a9b1-7578092056b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:07.168105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47486adc-30ef-4f02-a9b1-7578092056b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:07.168958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47486adc-30ef-4f02-a9b1-7578092056b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:07.169300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47486adc-30ef-4f02-a9b1-7578092056b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:07.170832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47486adc-30ef-4f02-a9b1-7578092056b5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:07.186234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 339/682] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:07.187684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3264-3d3d-4f8c-a7b1-d2db4227a414 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:07.187980 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3264-3d3d-4f8c-a7b1-d2db4227a414 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:07.188263 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c3264-3d3d-4f8c-a7b1-d2db4227a414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:07.207507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-218c3264-3d3d-4f8c-a7b1-d2db4227a414 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:07.208807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-218c3264-3d3d-4f8c-a7b1-d2db4227a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:07.269063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:07.298852 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded86a4-53b2-45a6-85a1-6646e20f3846 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:07.301260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 340/683] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:07.303570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c3264-3d3d-4f8c-a7b1-d2db4227a414 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:07.342748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775644-93e4-4422-9405-abd4c1dfc0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:07.343409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775644-93e4-4422-9405-abd4c1dfc0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:07.343695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775644-93e4-4422-9405-abd4c1dfc0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:07.343971 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775644-93e4-4422-9405-abd4c1dfc0d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:07.353811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1775644-93e4-4422-9405-abd4c1dfc0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:07.354373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1775644-93e4-4422-9405-abd4c1dfc0d2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-d1775644-93e4-4422-9405-abd4c1dfc0d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:07.369913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:07.370953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:07.373022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:07.373022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:07.373022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:07.373022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:07.373022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:07.373022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:07.373022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:07.373022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:07.373022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:19:07.373022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:07.373022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 344/684] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:19:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:07.373022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775644-93e4-4422-9405-abd4c1dfc0d2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:07.430571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:07.463969 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c3264-3d3d-4f8c-a7b1-d2db4227a414 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:07.502979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0760e-7eda-4d10-b293-a903b135c76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:07.503485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775644-93e4-4422-9405-abd4c1dfc0d2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:07.503670 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0760e-7eda-4d10-b293-a903b135c76c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:07.503924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0760e-7eda-4d10-b293-a903b135c76c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:07.504202 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0760e-7eda-4d10-b293-a903b135c76c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:07.505672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0760e-7eda-4d10-b293-a903b135c76c None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=d2ea8fd0ebfd42fdbed9a989d85c8787) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:07.505986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0760e-7eda-4d10-b293-a903b135c76c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:07.507440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0760e-7eda-4d10-b293-a903b135c76c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:07.514029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 341/685] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:07 2022] GET /identity/v3/role_assignments?user.id=d2ea8fd0ebfd42fdbed9a989d85c8787&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:07.514964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0760e-7eda-4d10-b293-a903b135c76c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:07.558257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4be3f-178e-4f9a-9d5f-f2d2dd110492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:07.559490 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4be3f-178e-4f9a-9d5f-f2d2dd110492 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:07.559979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4be3f-178e-4f9a-9d5f-f2d2dd110492 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:07.560429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4be3f-178e-4f9a-9d5f-f2d2dd110492 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:07.579631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:07.584994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4be3f-178e-4f9a-9d5f-f2d2dd110492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-30e4be3f-178e-4f9a-9d5f-f2d2dd110492 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:07.594666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:07.595631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:07.596485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:07.596485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:07.596485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:07.596485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:07.596485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:07.596485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:07.596485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:07.596485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:07.596485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:07.596485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:07.596485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:07.596485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:07.600080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 345/686] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:19:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:07.608257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4be3f-178e-4f9a-9d5f-f2d2dd110492 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:07.711488 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0760e-7eda-4d10-b293-a903b135c76c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:07.766333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b296e4-81f4-4e2a-8334-98c1c0cfb706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:07.768230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b296e4-81f4-4e2a-8334-98c1c0cfb706 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:07.769025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b296e4-81f4-4e2a-8334-98c1c0cfb706 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:07.769513 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b296e4-81f4-4e2a-8334-98c1c0cfb706 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:07.771293 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b296e4-81f4-4e2a-8334-98c1c0cfb706 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:07.771857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b296e4-81f4-4e2a-8334-98c1c0cfb706 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:07.773805 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b296e4-81f4-4e2a-8334-98c1c0cfb706 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:07.796854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4be3f-178e-4f9a-9d5f-f2d2dd110492 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:07.802305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 342/687] 10.222.0.39 () {56 vars in 1135 bytes} [Thu May 26 12:19:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:07.807504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b296e4-81f4-4e2a-8334-98c1c0cfb706 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:07.809004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:07.850851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb19a0-22fe-4d8d-8e77-01db0824c135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:07.851449 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb19a0-22fe-4d8d-8e77-01db0824c135 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:07.851740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb19a0-22fe-4d8d-8e77-01db0824c135 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:07.852175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb19a0-22fe-4d8d-8e77-01db0824c135 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:07.854369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb19a0-22fe-4d8d-8e77-01db0824c135 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:07.854483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb19a0-22fe-4d8d-8e77-01db0824c135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:07.856555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb19a0-22fe-4d8d-8e77-01db0824c135 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:07.868871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 346/688] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:19:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:07.873815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb19a0-22fe-4d8d-8e77-01db0824c135 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:07.940784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b296e4-81f4-4e2a-8334-98c1c0cfb706 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:07.944469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:07.982914 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5d931-9b0f-438a-94c9-cb9b923c7ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:07.983655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d931-9b0f-438a-94c9-cb9b923c7ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:07.984067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d931-9b0f-438a-94c9-cb9b923c7ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:07.984345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d931-9b0f-438a-94c9-cb9b923c7ab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:07.986727 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb19a0-22fe-4d8d-8e77-01db0824c135 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:08.026498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb29e2b-463a-4ea1-b563-d0174bfe62df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:08.027304 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb29e2b-463a-4ea1-b563-d0174bfe62df None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:08.027699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb29e2b-463a-4ea1-b563-d0174bfe62df None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:08.027982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb29e2b-463a-4ea1-b563-d0174bfe62df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:08.048278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb29e2b-463a-4ea1-b563-d0174bfe62df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:08.057880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb29e2b-463a-4ea1-b563-d0174bfe62df None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:08.059192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5d931-9b0f-438a-94c9-cb9b923c7ab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:08.060882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5d931-9b0f-438a-94c9-cb9b923c7ab6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-eeb29e2b-463a-4ea1-b563-d0174bfe62df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:08.090564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:08.091933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:08.093310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:08.093310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:08.093310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:08.093310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:08.093310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 347/689] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:08.097305 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb29e2b-463a-4ea1-b563-d0174bfe62df None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:08.141335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:08.208920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 343/690] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:19:08.214593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5d931-9b0f-438a-94c9-cb9b923c7ab6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:08.230063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:08.283039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb29e2b-463a-4ea1-b563-d0174bfe62df None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:08.327141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7941e-3488-4e50-bd42-488657fda43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:08.327820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7941e-3488-4e50-bd42-488657fda43f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:08.328112 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7941e-3488-4e50-bd42-488657fda43f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:08.328395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7941e-3488-4e50-bd42-488657fda43f None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:08.329221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7941e-3488-4e50-bd42-488657fda43f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:08.329534 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7941e-3488-4e50-bd42-488657fda43f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:08.331003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7941e-3488-4e50-bd42-488657fda43f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:08.344494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 348/691] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:08.353667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7941e-3488-4e50-bd42-488657fda43f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:08.445207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:08.464751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5d931-9b0f-438a-94c9-cb9b923c7ab6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:08.464970 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7941e-3488-4e50-bd42-488657fda43f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:08.493674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22357-dab1-42d8-a446-1c8ebfe0bc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:08.494645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22357-dab1-42d8-a446-1c8ebfe0bc35 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:08.495033 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22357-dab1-42d8-a446-1c8ebfe0bc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:08.495410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc22357-dab1-42d8-a446-1c8ebfe0bc35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:08.504187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc22357-dab1-42d8-a446-1c8ebfe0bc35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:08.506123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc22357-dab1-42d8-a446-1c8ebfe0bc35 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-cbc22357-dab1-42d8-a446-1c8ebfe0bc35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:08.523645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:08.524695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:08.525747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:08.525747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:08.525747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:08.525747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:08.525747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:08.525747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:08.525747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:08.525747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:08.525747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:19:08.525747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:08.528877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 349/692] 10.222.0.39 () {56 vars in 1093 bytes} [Thu May 26 12:19:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:08.531302 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22357-dab1-42d8-a446-1c8ebfe0bc35 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:08.585434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6257d94-e230-42b8-a522-e0d044eb8d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:08.586254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6257d94-e230-42b8-a522-e0d044eb8d3b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:08.586536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6257d94-e230-42b8-a522-e0d044eb8d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:08.586813 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6257d94-e230-42b8-a522-e0d044eb8d3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:08.621288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6257d94-e230-42b8-a522-e0d044eb8d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:08.622747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6257d94-e230-42b8-a522-e0d044eb8d3b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:08.639835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc22357-dab1-42d8-a446-1c8ebfe0bc35 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b6257d94-e230-42b8-a522-e0d044eb8d3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:08.665195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:08.667279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:08.669432 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:08.669432 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:08.669432 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:08.669432 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:08.673161 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 344/693] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:08.676432 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0fba63-8682-4ea7-8204-71810208445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:08.678289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fba63-8682-4ea7-8204-71810208445f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:08.678600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fba63-8682-4ea7-8204-71810208445f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:08.678880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0fba63-8682-4ea7-8204-71810208445f None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:08.679743 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fba63-8682-4ea7-8204-71810208445f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:08.680060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fba63-8682-4ea7-8204-71810208445f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:08.681702 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6257d94-e230-42b8-a522-e0d044eb8d3b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:08.681890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0fba63-8682-4ea7-8204-71810208445f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:08.701219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:08.703872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 350/694] 10.222.0.39 () {56 vars in 1133 bytes} [Thu May 26 12:19:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:08.705397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995677-023a-49f9-8fcd-915591724757 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:08.705758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995677-023a-49f9-8fcd-915591724757 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:08.706045 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c995677-023a-49f9-8fcd-915591724757 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:08.709799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 351/695] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:08.710701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c995677-023a-49f9-8fcd-915591724757 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:08.777162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:08.800373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6257d94-e230-42b8-a522-e0d044eb8d3b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:08.824316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c995677-023a-49f9-8fcd-915591724757 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:08.839669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22ceaf-e4b9-490c-b27d-0adc0e20f055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:08.840743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22ceaf-e4b9-490c-b27d-0adc0e20f055 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:08.841177 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22ceaf-e4b9-490c-b27d-0adc0e20f055 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:08.841599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22ceaf-e4b9-490c-b27d-0adc0e20f055 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:08.842472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22ceaf-e4b9-490c-b27d-0adc0e20f055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:08.842932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22ceaf-e4b9-490c-b27d-0adc0e20f055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:08.844549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22ceaf-e4b9-490c-b27d-0adc0e20f055 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:08.859694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 345/696] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:08.862413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcd947-fcd1-4ef6-aad8-10a7c626066a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:08.863362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcd947-fcd1-4ef6-aad8-10a7c626066a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:08.864102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcd947-fcd1-4ef6-aad8-10a7c626066a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:08.872121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939a8f2-f853-41ef-ae99-5ea5d6fdd80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:08.873521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939a8f2-f853-41ef-ae99-5ea5d6fdd80b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:08.873915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939a8f2-f853-41ef-ae99-5ea5d6fdd80b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:08.874300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939a8f2-f853-41ef-ae99-5ea5d6fdd80b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:08.891261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c5fcd947-fcd1-4ef6-aad8-10a7c626066a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:08.892586 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c5fcd947-fcd1-4ef6-aad8-10a7c626066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:08.962641 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:08.965916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 346/697] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:08.966768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcd947-fcd1-4ef6-aad8-10a7c626066a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:08.969161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939a8f2-f853-41ef-ae99-5ea5d6fdd80b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:08.970842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939a8f2-f853-41ef-ae99-5ea5d6fdd80b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:09.021751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:09.093812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcd947-fcd1-4ef6-aad8-10a7c626066a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:09.100018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 352/698] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:19:09.100992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939a8f2-f853-41ef-ae99-5ea5d6fdd80b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:09.134486 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0bbb4-445f-442a-88b2-de6c365d7936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:09.135326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0bbb4-445f-442a-88b2-de6c365d7936 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:09.135612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0bbb4-445f-442a-88b2-de6c365d7936 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:09.135891 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0bbb4-445f-442a-88b2-de6c365d7936 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:09.144049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0bbb4-445f-442a-88b2-de6c365d7936 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:09.146301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0bbb4-445f-442a-88b2-de6c365d7936 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-35c0bbb4-445f-442a-88b2-de6c365d7936 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:09.161897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:09.162843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:09.163734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:09.163734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:09.163734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:09.163734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:09.163734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:09.163734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:09.163734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:09.163734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:09.163734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 347/699] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:09.164673 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0bbb4-445f-442a-88b2-de6c365d7936 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:09.218830 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:09.225050 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939a8f2-f853-41ef-ae99-5ea5d6fdd80b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:09.261005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac4e4-65d5-445e-aea8-fb7eebc38570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:09.261834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac4e4-65d5-445e-aea8-fb7eebc38570 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:09.262123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac4e4-65d5-445e-aea8-fb7eebc38570 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:09.262404 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac4e4-65d5-445e-aea8-fb7eebc38570 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:09.263132 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cac4e4-65d5-445e-aea8-fb7eebc38570 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:09.264531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cac4e4-65d5-445e-aea8-fb7eebc38570 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b2cac4e4-65d5-445e-aea8-fb7eebc38570 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:09.280262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:09.281444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:09.282299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 353/700] 10.222.0.39 () {56 vars in 1129 bytes} [Thu May 26 12:19:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:09.283137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac4e4-65d5-445e-aea8-fb7eebc38570 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:09.312258 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0bbb4-445f-442a-88b2-de6c365d7936 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:09.323937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:09.362820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c6aa4-1cf8-4d8f-87c9-838a8dafa0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:09.364038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c6aa4-1cf8-4d8f-87c9-838a8dafa0dc None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:09.365286 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c6aa4-1cf8-4d8f-87c9-838a8dafa0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:09.365768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c6aa4-1cf8-4d8f-87c9-838a8dafa0dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:09.380600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c6aa4-1cf8-4d8f-87c9-838a8dafa0dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:09.382942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c6aa4-1cf8-4d8f-87c9-838a8dafa0dc None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:09.403563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac4e4-65d5-445e-aea8-fb7eebc38570 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-159c6aa4-1cf8-4d8f-87c9-838a8dafa0dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:09.405497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:09.406461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:09.407392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:09.407392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:09.407392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:09.407392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:09.411257 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 348/701] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:09.412158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c6aa4-1cf8-4d8f-87c9-838a8dafa0dc None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:09.445655 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f502aaf-b3de-4b9e-b495-64bbe6c3b734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:09.446326 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f502aaf-b3de-4b9e-b495-64bbe6c3b734 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:09.446613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f502aaf-b3de-4b9e-b495-64bbe6c3b734 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:09.447197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f502aaf-b3de-4b9e-b495-64bbe6c3b734 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:09.447978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f502aaf-b3de-4b9e-b495-64bbe6c3b734 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:09.448300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f502aaf-b3de-4b9e-b495-64bbe6c3b734 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:09.449886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f502aaf-b3de-4b9e-b495-64bbe6c3b734 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:09.463522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 354/702] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:09.464460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f502aaf-b3de-4b9e-b495-64bbe6c3b734 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:09.498124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:09.531574 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c6aa4-1cf8-4d8f-87c9-838a8dafa0dc None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:09.569649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a719461-0418-4eec-98b6-0701af30081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:09.570477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a719461-0418-4eec-98b6-0701af30081c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:09.570882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a719461-0418-4eec-98b6-0701af30081c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:09.571346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a719461-0418-4eec-98b6-0701af30081c None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:09.572083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a719461-0418-4eec-98b6-0701af30081c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:09.572498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a719461-0418-4eec-98b6-0701af30081c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:09.574090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a719461-0418-4eec-98b6-0701af30081c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:09.579653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 349/703] 10.222.0.39 () {56 vars in 1124 bytes} [Thu May 26 12:19:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:09.580954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a719461-0418-4eec-98b6-0701af30081c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:09.597911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f502aaf-b3de-4b9e-b495-64bbe6c3b734 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:09.610271 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:09.642327 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e8a41-c3b4-4339-9c74-93b1f4eb53ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:09.643624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e8a41-c3b4-4339-9c74-93b1f4eb53ae None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:09.644053 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e8a41-c3b4-4339-9c74-93b1f4eb53ae None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:09.644486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e8a41-c3b4-4339-9c74-93b1f4eb53ae None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:09.645395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e8a41-c3b4-4339-9c74-93b1f4eb53ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:09.645882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e8a41-c3b4-4339-9c74-93b1f4eb53ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:09.647590 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e8a41-c3b4-4339-9c74-93b1f4eb53ae None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:09.660795 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 355/704] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:09.662355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e8a41-c3b4-4339-9c74-93b1f4eb53ae None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:09.702952 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a719461-0418-4eec-98b6-0701af30081c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:09.740425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440452-1b66-4b46-97e9-49b5a21a07d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:09.741361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440452-1b66-4b46-97e9-49b5a21a07d7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:09.741645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440452-1b66-4b46-97e9-49b5a21a07d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:09.742027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440452-1b66-4b46-97e9-49b5a21a07d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:09.743049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67440452-1b66-4b46-97e9-49b5a21a07d7 None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=691c9da310ef42a189bb78183867e46a) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:09.743472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67440452-1b66-4b46-97e9-49b5a21a07d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:09.745231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67440452-1b66-4b46-97e9-49b5a21a07d7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:09.752468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 350/705] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:09 2022] GET /identity/v3/role_assignments?user.id=691c9da310ef42a189bb78183867e46a&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:09.753512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440452-1b66-4b46-97e9-49b5a21a07d7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:09.760634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:09.784291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e8a41-c3b4-4339-9c74-93b1f4eb53ae None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:09.825068 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115cd2e-e7ae-485b-a5e3-fce645384923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:09.826131 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115cd2e-e7ae-485b-a5e3-fce645384923 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:09.826593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115cd2e-e7ae-485b-a5e3-fce645384923 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:09.827019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115cd2e-e7ae-485b-a5e3-fce645384923 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:09.828447 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115cd2e-e7ae-485b-a5e3-fce645384923 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:09.829124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115cd2e-e7ae-485b-a5e3-fce645384923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:09.831191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115cd2e-e7ae-485b-a5e3-fce645384923 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:09.840437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 356/706] 10.222.0.39 () {56 vars in 1124 bytes} [Thu May 26 12:19:09 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:09.842407 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7954b-8362-42bc-b8d3-432e27fef44f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:09.842847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7954b-8362-42bc-b8d3-432e27fef44f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:09.843296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7954b-8362-42bc-b8d3-432e27fef44f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:09.845017 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 357/707] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:09.850735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cfe39-1d6e-402e-8871-84e53ed9f4fb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:09.851371 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cfe39-1d6e-402e-8871-84e53ed9f4fb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:09.851850 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cfe39-1d6e-402e-8871-84e53ed9f4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:09.876907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:09.916210 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0a8cfe39-1d6e-402e-8871-84e53ed9f4fb None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:09.920851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0a8cfe39-1d6e-402e-8871-84e53ed9f4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:09.950779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440452-1b66-4b46-97e9-49b5a21a07d7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:10.019196 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 358/708] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:10.031857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a977e1-8864-47c9-9d19-fad8dcd18fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:10.032861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a977e1-8864-47c9-9d19-fad8dcd18fca None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:10.035022 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a977e1-8864-47c9-9d19-fad8dcd18fca None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:10.035307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a977e1-8864-47c9-9d19-fad8dcd18fca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:10.045717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a977e1-8864-47c9-9d19-fad8dcd18fca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:10.047190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a977e1-8864-47c9-9d19-fad8dcd18fca None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:10.056861 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cfe39-1d6e-402e-8871-84e53ed9f4fb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b5a977e1-8864-47c9-9d19-fad8dcd18fca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:10.063372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:10.064434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:10.065363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:10.065363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:10.065363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:10.065363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:10.065363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:10.065363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:10.065363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:10.065363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:10.069741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 351/709] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:10.071139 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a977e1-8864-47c9-9d19-fad8dcd18fca None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:10.165690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:10.197318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cfe39-1d6e-402e-8871-84e53ed9f4fb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:10.226419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a977e1-8864-47c9-9d19-fad8dcd18fca None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:10.241353 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d2029-a4bb-4b05-97e1-cbffb18ee0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:10.242154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d2029-a4bb-4b05-97e1-cbffb18ee0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:10.242439 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d2029-a4bb-4b05-97e1-cbffb18ee0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:10.242713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d2029-a4bb-4b05-97e1-cbffb18ee0d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:10.257080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d2029-a4bb-4b05-97e1-cbffb18ee0d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:10.258541 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d2029-a4bb-4b05-97e1-cbffb18ee0d5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:10.273404 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67635b-7ba4-4078-b457-44b02fe5f357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:10.274365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67635b-7ba4-4078-b457-44b02fe5f357 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:10.274898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67635b-7ba4-4078-b457-44b02fe5f357 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:10.275374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67635b-7ba4-4078-b457-44b02fe5f357 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:10.276427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67635b-7ba4-4078-b457-44b02fe5f357 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-184d2029-a4bb-4b05-97e1-cbffb18ee0d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:10.276939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:10.277807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:10.278730 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:10.278730 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:10.278730 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:10.278730 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:10.278730 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 359/710] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:10.279493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67635b-7ba4-4078-b457-44b02fe5f357 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:10.279700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07abfe-e0c9-456b-b2d1-0243f6d4fbf0 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:10.279983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07abfe-e0c9-456b-b2d1-0243f6d4fbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:10.280255 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07abfe-e0c9-456b-b2d1-0243f6d4fbf0 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:10.281956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67635b-7ba4-4078-b457-44b02fe5f357 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:10.286637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 360/711] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:10.287767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07abfe-e0c9-456b-b2d1-0243f6d4fbf0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:10.297747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 352/712] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:10.299520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdee3a-0652-4282-8e6c-c240cbf595a0 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:10.300013 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdee3a-0652-4282-8e6c-c240cbf595a0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:10.300493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdee3a-0652-4282-8e6c-c240cbf595a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:10.325090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:10.327232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5fbdee3a-0652-4282-8e6c-c240cbf595a0 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:10.328752 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5fbdee3a-0652-4282-8e6c-c240cbf595a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:10.407931 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07abfe-e0c9-456b-b2d1-0243f6d4fbf0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:10.414962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 353/713] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:10.415993 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdee3a-0652-4282-8e6c-c240cbf595a0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:10.447247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:10.458974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49244b-01d4-4518-b2c4-6d2215423e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:10.460221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49244b-01d4-4518-b2c4-6d2215423e67 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:10.460628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49244b-01d4-4518-b2c4-6d2215423e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:10.461053 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49244b-01d4-4518-b2c4-6d2215423e67 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:10.462188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49244b-01d4-4518-b2c4-6d2215423e67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:10.462573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49244b-01d4-4518-b2c4-6d2215423e67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:10.464400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49244b-01d4-4518-b2c4-6d2215423e67 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:10.479631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 361/714] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:10.480785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49244b-01d4-4518-b2c4-6d2215423e67 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:10.541347 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdee3a-0652-4282-8e6c-c240cbf595a0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:10.579408 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19625ae5-d4fd-4a32-b3b0-e7b82374e4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:10.580170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19625ae5-d4fd-4a32-b3b0-e7b82374e4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:10.580536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19625ae5-d4fd-4a32-b3b0-e7b82374e4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:10.581040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19625ae5-d4fd-4a32-b3b0-e7b82374e4c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:10.582295 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19625ae5-d4fd-4a32-b3b0-e7b82374e4c6 None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=04f5fbbe45ec4dcf8301da8483af2941) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:10.582295 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19625ae5-d4fd-4a32-b3b0-e7b82374e4c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:10.584026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19625ae5-d4fd-4a32-b3b0-e7b82374e4c6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:10.593126 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:10.594525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 354/715] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:10 2022] GET /identity/v3/role_assignments?user.id=04f5fbbe45ec4dcf8301da8483af2941&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:10.595247 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19625ae5-d4fd-4a32-b3b0-e7b82374e4c6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:10.613421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49244b-01d4-4518-b2c4-6d2215423e67 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:10.664546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f24955-e7f9-4147-9985-a61368d060cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:10.666014 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f24955-e7f9-4147-9985-a61368d060cb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:10.666918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f24955-e7f9-4147-9985-a61368d060cb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:10.667402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f24955-e7f9-4147-9985-a61368d060cb None admin] PATH_INFO: `/v3/services/network` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:10.668286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f24955-e7f9-4147-9985-a61368d060cb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:10.674377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f24955-e7f9-4147-9985-a61368d060cb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-81f24955-e7f9-4147-9985-a61368d060cb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:10.705197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:10.706263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:19:10.707093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:10.713212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 362/716] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:10 2022] GET /identity/v3/services/network => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:10.718808 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f24955-e7f9-4147-9985-a61368d060cb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:10.775636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19625ae5-d4fd-4a32-b3b0-e7b82374e4c6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:10.845739 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:10.847459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451023b-ae7f-4f8d-a858-dd5930bbb63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:10.848460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451023b-ae7f-4f8d-a858-dd5930bbb63c None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:10.849547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451023b-ae7f-4f8d-a858-dd5930bbb63c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:10.850118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451023b-ae7f-4f8d-a858-dd5930bbb63c None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:10.852321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451023b-ae7f-4f8d-a858-dd5930bbb63c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:10.854574 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4451023b-ae7f-4f8d-a858-dd5930bbb63c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:10.900812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 355/717] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:19:10 2022] POST /identity/v3/users => generated 254 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:10.922340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f24955-e7f9-4147-9985-a61368d060cb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:10.968579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607dc18-d403-435a-b4ae-ed274da549fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:10.969351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607dc18-d403-435a-b4ae-ed274da549fd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:10.969645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607dc18-d403-435a-b4ae-ed274da549fd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:10.969923 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607dc18-d403-435a-b4ae-ed274da549fd None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:10.970707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607dc18-d403-435a-b4ae-ed274da549fd None admin] RBAC: Adding query filter params (name=network) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:10.971027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607dc18-d403-435a-b4ae-ed274da549fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:10.972423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607dc18-d403-435a-b4ae-ed274da549fd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:10.982771 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 363/718] 10.222.0.39 () {56 vars in 1112 bytes} [Thu May 26 12:19:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:10.983990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451023b-ae7f-4f8d-a858-dd5930bbb63c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:11.067694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:11.123261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451023b-ae7f-4f8d-a858-dd5930bbb63c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:11.160800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5bd2f-affd-4af8-bf55-7a037e9b94bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:11.162117 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5bd2f-affd-4af8-bf55-7a037e9b94bf None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:11.162410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5bd2f-affd-4af8-bf55-7a037e9b94bf None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:11.162690 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5bd2f-affd-4af8-bf55-7a037e9b94bf None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:11.163570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5bd2f-affd-4af8-bf55-7a037e9b94bf None admin] RBAC: Adding query filter params (type=network) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:11.163885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5bd2f-affd-4af8-bf55-7a037e9b94bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:11.165331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5bd2f-affd-4af8-bf55-7a037e9b94bf None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:11.172138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 356/719] 10.222.0.39 () {56 vars in 1112 bytes} [Thu May 26 12:19:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:12.480223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52649ba-06a9-4add-b320-5c15353ed758 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:12.480775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52649ba-06a9-4add-b320-5c15353ed758 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:12.481210 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52649ba-06a9-4add-b320-5c15353ed758 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:12.483006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 364/720] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:12.488148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5c816-ae34-491e-a72f-09d7c4c67e55 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:12.488556 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5c816-ae34-491e-a72f-09d7c4c67e55 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:12.488925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5c816-ae34-491e-a72f-09d7c4c67e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:12.507716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb30c7-0bed-4038-831f-8432c29afbda None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:12.508365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb30c7-0bed-4038-831f-8432c29afbda None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:12.508885 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb30c7-0bed-4038-831f-8432c29afbda None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:12.510803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 365/721] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:12.512148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6dc5c816-ae34-491e-a72f-09d7c4c67e55 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:12.514183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6dc5c816-ae34-491e-a72f-09d7c4c67e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:12.516584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210ad39-4ba6-4fc3-ac42-f30a06ea3f34 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:12.517109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210ad39-4ba6-4fc3-ac42-f30a06ea3f34 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:12.517837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210ad39-4ba6-4fc3-ac42-f30a06ea3f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:12.564112 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f210ad39-4ba6-4fc3-ac42-f30a06ea3f34 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:12.565368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f210ad39-4ba6-4fc3-ac42-f30a06ea3f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:12.631731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 357/722] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:12.664700 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5c816-ae34-491e-a72f-09d7c4c67e55 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:12.665772 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 366/723] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:19:12.709779 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210ad39-4ba6-4fc3-ac42-f30a06ea3f34 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:12.755920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:12.812433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:12.853101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5c816-ae34-491e-a72f-09d7c4c67e55 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:12.893436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210ad39-4ba6-4fc3-ac42-f30a06ea3f34 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:12.930829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06539240-db24-41ce-8ac4-2d179e0eca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:12.931867 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06539240-db24-41ce-8ac4-2d179e0eca59 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:12.932352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06539240-db24-41ce-8ac4-2d179e0eca59 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:12.932881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06539240-db24-41ce-8ac4-2d179e0eca59 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:12.934026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06539240-db24-41ce-8ac4-2d179e0eca59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:12.935779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06539240-db24-41ce-8ac4-2d179e0eca59 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:12.936159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871b5a1-b5c2-4c4c-93ed-759d92481066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:12.937026 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871b5a1-b5c2-4c4c-93ed-759d92481066 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:12.937316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871b5a1-b5c2-4c4c-93ed-759d92481066 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:12.937592 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871b5a1-b5c2-4c4c-93ed-759d92481066 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:12.955533 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 358/724] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:19:12 2022] POST /identity/v3/services => generated 251 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:19:12.966467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871b5a1-b5c2-4c4c-93ed-759d92481066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-1871b5a1-b5c2-4c4c-93ed-759d92481066 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:12.985662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:12.986734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:12.987578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:12.987578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:12.987578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:12.987578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:12.987578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:12.987578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:12.987578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:12.987578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:12.987578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:12.987578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:12.987578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:12.987578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:12.991249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 367/725] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:19:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:12.997715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06539240-db24-41ce-8ac4-2d179e0eca59 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:13.132762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06539240-db24-41ce-8ac4-2d179e0eca59 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:13.141777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:13.177318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46e1a9-f894-4ba1-b4a9-b3cb05b59f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:13.178587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46e1a9-f894-4ba1-b4a9-b3cb05b59f55 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:13.179075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46e1a9-f894-4ba1-b4a9-b3cb05b59f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:13.179549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46e1a9-f894-4ba1-b4a9-b3cb05b59f55 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:13.180537 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46e1a9-f894-4ba1-b4a9-b3cb05b59f55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:13.181068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46e1a9-f894-4ba1-b4a9-b3cb05b59f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:13.182666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46e1a9-f894-4ba1-b4a9-b3cb05b59f55 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:13.192667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 359/726] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:19:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:13.198832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871b5a1-b5c2-4c4c-93ed-759d92481066 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:13.318872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871b5a1-b5c2-4c4c-93ed-759d92481066 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:13.331296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:13.364325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7390b7a-fc9e-4e83-ae31-8b484ebf1654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:13.365550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7390b7a-fc9e-4e83-ae31-8b484ebf1654 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:13.366038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7390b7a-fc9e-4e83-ae31-8b484ebf1654 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:13.366514 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7390b7a-fc9e-4e83-ae31-8b484ebf1654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:13.378724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7390b7a-fc9e-4e83-ae31-8b484ebf1654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:13.381249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7390b7a-fc9e-4e83-ae31-8b484ebf1654 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b7390b7a-fc9e-4e83-ae31-8b484ebf1654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:13.400282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:13.401252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:13.402141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:13.402141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:13.402141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:13.402141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:13.404457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 368/727] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:13.410395 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46e1a9-f894-4ba1-b4a9-b3cb05b59f55 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:13.524282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46e1a9-f894-4ba1-b4a9-b3cb05b59f55 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:13.568558 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af823623-3dab-4de4-b02a-cbadde6924ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:13.569794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af823623-3dab-4de4-b02a-cbadde6924ad None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:13.570428 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af823623-3dab-4de4-b02a-cbadde6924ad None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:13.570943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af823623-3dab-4de4-b02a-cbadde6924ad None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:13.571953 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af823623-3dab-4de4-b02a-cbadde6924ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:13.572497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af823623-3dab-4de4-b02a-cbadde6924ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:13.574270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af823623-3dab-4de4-b02a-cbadde6924ad None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:13.590428 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 360/728] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:13.596444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7390b7a-fc9e-4e83-ae31-8b484ebf1654 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:13.631417 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb412c52-9662-489a-b414-b27fb85afe15 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:13.632039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb412c52-9662-489a-b414-b27fb85afe15 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:13.632515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb412c52-9662-489a-b414-b27fb85afe15 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:13.635129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 361/729] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:13.646244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16f874-ec78-4bfa-931e-68409f22b0d9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:13.647087 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16f874-ec78-4bfa-931e-68409f22b0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:13.647570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16f874-ec78-4bfa-931e-68409f22b0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:13.666512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7f16f874-ec78-4bfa-931e-68409f22b0d9 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:13.668256 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7f16f874-ec78-4bfa-931e-68409f22b0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:13.694858 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:13.754511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7390b7a-fc9e-4e83-ae31-8b484ebf1654 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:13.799489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d7298-0ddb-4b28-9a88-0c8bef73169e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:13.800306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d7298-0ddb-4b28-9a88-0c8bef73169e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:13.800586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d7298-0ddb-4b28-9a88-0c8bef73169e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:13.800888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d7298-0ddb-4b28-9a88-0c8bef73169e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:13.810179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d7298-0ddb-4b28-9a88-0c8bef73169e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:13.811669 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d7298-0ddb-4b28-9a88-0c8bef73169e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b83d7298-0ddb-4b28-9a88-0c8bef73169e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:13.827898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:13.828935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:13.829873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:13.829873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:13.829873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:13.829873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:13.829873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:13.829873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:13.829873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:13.829873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:13.829873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:19:13.829873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:13.829873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 369/730] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:19:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:13.831022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc27e7-d1b6-4005-b77c-247fa4e1adbb None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:13.831022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc27e7-d1b6-4005-b77c-247fa4e1adbb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:13.831287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc27e7-d1b6-4005-b77c-247fa4e1adbb None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:13.836810 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 370/731] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:13.836810 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36164275-51f6-4644-8eb4-7d66a0eb5926 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:13.836810 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36164275-51f6-4644-8eb4-7d66a0eb5926 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:13.836810 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36164275-51f6-4644-8eb4-7d66a0eb5926 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:13.840841 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 371/732] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:13.841584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36164275-51f6-4644-8eb4-7d66a0eb5926 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:13.865534 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:13.876434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 362/733] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:13.878086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0df4a-a24d-4121-99f0-9e1de73a25ce None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:13.878554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0df4a-a24d-4121-99f0-9e1de73a25ce None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:13.879044 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0df4a-a24d-4121-99f0-9e1de73a25ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:13.906048 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-27f0df4a-a24d-4121-99f0-9e1de73a25ce None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:13.907255 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-27f0df4a-a24d-4121-99f0-9e1de73a25ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:13.980548 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 363/734] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:13.983113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82489294-f8f7-449b-bb58-5e77b1ab8b64 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:13.983665 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82489294-f8f7-449b-bb58-5e77b1ab8b64 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:13.983863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36164275-51f6-4644-8eb4-7d66a0eb5926 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:13.984999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82489294-f8f7-449b-bb58-5e77b1ab8b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:14.007353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-82489294-f8f7-449b-bb58-5e77b1ab8b64 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:14.008546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-82489294-f8f7-449b-bb58-5e77b1ab8b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:14.023628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dda64-2924-498e-b026-3807762f1fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:14.024303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dda64-2924-498e-b026-3807762f1fdf None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:14.024582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dda64-2924-498e-b026-3807762f1fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:14.024882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dda64-2924-498e-b026-3807762f1fdf None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:14.025730 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dda64-2924-498e-b026-3807762f1fdf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:14.026041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dda64-2924-498e-b026-3807762f1fdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:14.027474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dda64-2924-498e-b026-3807762f1fdf None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:14.055942 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 372/735] 10.222.0.39 () {56 vars in 1135 bytes} [Thu May 26 12:19:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:14.057446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dda64-2924-498e-b026-3807762f1fdf None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:14.081269 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 364/736] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:19:14.082300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82489294-f8f7-449b-bb58-5e77b1ab8b64 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:14.110143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:14.152505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:14.178969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dda64-2924-498e-b026-3807762f1fdf None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:14.201974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82489294-f8f7-449b-bb58-5e77b1ab8b64 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:14.220533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d116e08-f881-4865-8029-d3434317b528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:14.221373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d116e08-f881-4865-8029-d3434317b528 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:14.221655 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d116e08-f881-4865-8029-d3434317b528 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:14.221931 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d116e08-f881-4865-8029-d3434317b528 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:14.233239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d116e08-f881-4865-8029-d3434317b528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:14.240519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92505b8a-c43a-47b5-bd0d-1c7c8062ab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:14.241517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92505b8a-c43a-47b5-bd0d-1c7c8062ab6d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-3d116e08-f881-4865-8029-d3434317b528 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:14.241654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:14.242734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:14.243646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:14.243646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:14.243646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:14.243646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:14.243646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:14.243646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:14.243646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:14.243646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:14.243646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:14.243646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:14.243646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:14.243646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:14.243646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 373/737] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:19:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:14.244380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d116e08-f881-4865-8029-d3434317b528 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:14.244849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92505b8a-c43a-47b5-bd0d-1c7c8062ab6d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:14.245128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92505b8a-c43a-47b5-bd0d-1c7c8062ab6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:14.261586 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92505b8a-c43a-47b5-bd0d-1c7c8062ab6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-92505b8a-c43a-47b5-bd0d-1c7c8062ab6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:14.270661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:14.271664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:14.272545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:14.272545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:14.272545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:14.272545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:14.272545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:14.272545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:14.272545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:14.272545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:14.272545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:14.272545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:14.272545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:14.272545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:14.272545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 365/738] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:19:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:14.273388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92505b8a-c43a-47b5-bd0d-1c7c8062ab6d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:14.355695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:14.365171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d116e08-f881-4865-8029-d3434317b528 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:14.378459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92505b8a-c43a-47b5-bd0d-1c7c8062ab6d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:14.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9de05-7bbe-4594-8a45-306ac0b3baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:14.404275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9de05-7bbe-4594-8a45-306ac0b3baba None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:14.404907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9de05-7bbe-4594-8a45-306ac0b3baba None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:14.405380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9de05-7bbe-4594-8a45-306ac0b3baba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:14.409288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:14.414274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2bb80-0b7c-4c31-be4d-1e8c12cec354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:14.415121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2bb80-0b7c-4c31-be4d-1e8c12cec354 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:14.415578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2bb80-0b7c-4c31-be4d-1e8c12cec354 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:14.416014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2bb80-0b7c-4c31-be4d-1e8c12cec354 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:14.416942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2bb80-0b7c-4c31-be4d-1e8c12cec354 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:14.418481 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2bb80-0b7c-4c31-be4d-1e8c12cec354 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:14.434636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 366/739] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:19:14 2022] POST /identity/v3/services => generated 240 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:14.435498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2bb80-0b7c-4c31-be4d-1e8c12cec354 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:14.495734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9de05-7bbe-4594-8a45-306ac0b3baba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:14.497300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9de05-7bbe-4594-8a45-306ac0b3baba None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:14.585018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2bb80-0b7c-4c31-be4d-1e8c12cec354 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:14.636578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 374/740] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:14 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:19:14.637651 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9de05-7bbe-4594-8a45-306ac0b3baba None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:14.642659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425c5af-2c30-4993-9d4d-e7aa318f6146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:14.643598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425c5af-2c30-4993-9d4d-e7aa318f6146 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:14.643887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425c5af-2c30-4993-9d4d-e7aa318f6146 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:14.644166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425c5af-2c30-4993-9d4d-e7aa318f6146 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:14.646133 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425c5af-2c30-4993-9d4d-e7aa318f6146 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:14.646133 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425c5af-2c30-4993-9d4d-e7aa318f6146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:14.647316 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425c5af-2c30-4993-9d4d-e7aa318f6146 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:14.654537 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:14.663398 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 367/741] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:19:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:14.664760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425c5af-2c30-4993-9d4d-e7aa318f6146 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:14.688079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:14.771110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9de05-7bbe-4594-8a45-306ac0b3baba None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:14.793551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425c5af-2c30-4993-9d4d-e7aa318f6146 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:14.813549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8971b23-7cd2-4755-bbda-dff1b1157084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:14.814787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8971b23-7cd2-4755-bbda-dff1b1157084 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:14.815074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8971b23-7cd2-4755-bbda-dff1b1157084 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:14.815355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8971b23-7cd2-4755-bbda-dff1b1157084 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:14.816119 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8971b23-7cd2-4755-bbda-dff1b1157084 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:14.816429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8971b23-7cd2-4755-bbda-dff1b1157084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:14.818457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8971b23-7cd2-4755-bbda-dff1b1157084 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:14.835347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 375/742] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:19:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:14.835347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8971b23-7cd2-4755-bbda-dff1b1157084 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:14.839049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6c46b-ad2d-427e-94db-1aa44a2c3b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:14.840856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6c46b-ad2d-427e-94db-1aa44a2c3b98 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:14.841146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6c46b-ad2d-427e-94db-1aa44a2c3b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:14.841427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6c46b-ad2d-427e-94db-1aa44a2c3b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:14.855656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6c46b-ad2d-427e-94db-1aa44a2c3b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:14.857413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6c46b-ad2d-427e-94db-1aa44a2c3b98 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-a4b6c46b-ad2d-427e-94db-1aa44a2c3b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:14.883579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:14.884550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:14.885801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:14.885801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:14.885801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:14.885801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:14.890864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 368/743] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:14.891695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6c46b-ad2d-427e-94db-1aa44a2c3b98 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:14.952067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:14.956360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8971b23-7cd2-4755-bbda-dff1b1157084 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:14.964612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:14.996919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca5c7a-bb97-4575-900e-9ddbf4ffea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:14.997738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca5c7a-bb97-4575-900e-9ddbf4ffea23 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:14.998004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca5c7a-bb97-4575-900e-9ddbf4ffea23 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:14.998285 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca5c7a-bb97-4575-900e-9ddbf4ffea23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:15.011874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca5c7a-bb97-4575-900e-9ddbf4ffea23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:15.013533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca5c7a-bb97-4575-900e-9ddbf4ffea23 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:15.025675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6c46b-ad2d-427e-94db-1aa44a2c3b98 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-48ca5c7a-bb97-4575-900e-9ddbf4ffea23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:15.033451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:15.034352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:15.035238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:15.035238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:15.035238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:15.035238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:15.039141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 376/744] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:15.040014 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca5c7a-bb97-4575-900e-9ddbf4ffea23 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:15.067356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb4e4-3af2-44b0-bdb2-b1b716576d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:15.069188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb4e4-3af2-44b0-bdb2-b1b716576d5f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:15.069719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb4e4-3af2-44b0-bdb2-b1b716576d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:15.070196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb4e4-3af2-44b0-bdb2-b1b716576d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:15.082134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedb4e4-3af2-44b0-bdb2-b1b716576d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:15.084589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedb4e4-3af2-44b0-bdb2-b1b716576d5f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-7dedb4e4-3af2-44b0-bdb2-b1b716576d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:15.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:15.103669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:15.104568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:15.104568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:15.104568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:15.104568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:15.111059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 369/745] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:15.112139 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb4e4-3af2-44b0-bdb2-b1b716576d5f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:15.156693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca5c7a-bb97-4575-900e-9ddbf4ffea23 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:15.194052 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb06960-2416-4474-bb20-3142662c3190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:15.194731 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb06960-2416-4474-bb20-3142662c3190 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:15.195020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb06960-2416-4474-bb20-3142662c3190 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:15.195301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb06960-2416-4474-bb20-3142662c3190 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:15.196039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb06960-2416-4474-bb20-3142662c3190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:15.196351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb06960-2416-4474-bb20-3142662c3190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:15.197838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb06960-2416-4474-bb20-3142662c3190 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:15.212139 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 377/746] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:15.213682 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb06960-2416-4474-bb20-3142662c3190 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:15.223548 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:15.228195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb4e4-3af2-44b0-bdb2-b1b716576d5f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:15.229817 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:15.266167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b03cc7-0845-45b3-a64f-872665a9c580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:15.267201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b03cc7-0845-45b3-a64f-872665a9c580 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:15.267689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b03cc7-0845-45b3-a64f-872665a9c580 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:15.268415 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b03cc7-0845-45b3-a64f-872665a9c580 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:15.269403 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b03cc7-0845-45b3-a64f-872665a9c580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:15.269935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b03cc7-0845-45b3-a64f-872665a9c580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:15.272023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b03cc7-0845-45b3-a64f-872665a9c580 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:15.289041 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 370/747] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:15.289846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b03cc7-0845-45b3-a64f-872665a9c580 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:15.340784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb06960-2416-4474-bb20-3142662c3190 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:15.377971 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb2835-78af-4e2d-b102-f0629a69bced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:15.378747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb2835-78af-4e2d-b102-f0629a69bced None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:15.379038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb2835-78af-4e2d-b102-f0629a69bced None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:15.379318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb2835-78af-4e2d-b102-f0629a69bced None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:15.380242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb2835-78af-4e2d-b102-f0629a69bced None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:15.380474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb2835-78af-4e2d-b102-f0629a69bced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:15.382110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb2835-78af-4e2d-b102-f0629a69bced None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:15.394928 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 378/748] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:15.396532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb2835-78af-4e2d-b102-f0629a69bced None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:15.426589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b03cc7-0845-45b3-a64f-872665a9c580 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:15.473536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddc42e-ac16-481c-99ed-c2f2789665f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:15.474717 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:15.476735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddc42e-ac16-481c-99ed-c2f2789665f9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:15.477293 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddc42e-ac16-481c-99ed-c2f2789665f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:15.477753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddc42e-ac16-481c-99ed-c2f2789665f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:15.487340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddc42e-ac16-481c-99ed-c2f2789665f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:15.489329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddc42e-ac16-481c-99ed-c2f2789665f9 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-01ddc42e-ac16-481c-99ed-c2f2789665f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:15.509829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:15.510960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:15.512071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:15.512071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:15.512071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:15.512071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:15.512071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:15.512071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:15.512071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:15.512071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:15.512604 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb2835-78af-4e2d-b102-f0629a69bced None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:15.514265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 371/749] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:15.516092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddc42e-ac16-481c-99ed-c2f2789665f9 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:15.547572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:15.562614 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6b051-5017-4b73-8508-863a6f7a3b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:15.563420 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6b051-5017-4b73-8508-863a6f7a3b7f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:15.563706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6b051-5017-4b73-8508-863a6f7a3b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:15.563981 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6b051-5017-4b73-8508-863a6f7a3b7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:15.575494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6b051-5017-4b73-8508-863a6f7a3b7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:15.576987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6b051-5017-4b73-8508-863a6f7a3b7f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f3d6b051-5017-4b73-8508-863a6f7a3b7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:15.592100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:15.593212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:15.594149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:15.594149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:15.594149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:15.594149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:15.594149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:15.594149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:15.594149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:15.594149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:15.594149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:19:15.594149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:15.598219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 379/750] 10.222.0.39 () {56 vars in 1093 bytes} [Thu May 26 12:19:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:15.599890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6b051-5017-4b73-8508-863a6f7a3b7f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:15.664933 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddc42e-ac16-481c-99ed-c2f2789665f9 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:15.713850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d92a00-614e-4f75-b743-57cd071a7a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:15.715249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d92a00-614e-4f75-b743-57cd071a7a0f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:15.716097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d92a00-614e-4f75-b743-57cd071a7a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:15.717021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d92a00-614e-4f75-b743-57cd071a7a0f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:15.722396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6b051-5017-4b73-8508-863a6f7a3b7f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:15.729229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d92a00-614e-4f75-b743-57cd071a7a0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:15.731644 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d92a00-614e-4f75-b743-57cd071a7a0f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b1d92a00-614e-4f75-b743-57cd071a7a0f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:15.753275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:15.754280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:15.755305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:15.755305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:15.755305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:15.755305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:15.755305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:15.755305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:15.755305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:15.755305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:15.755305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:19:15.755305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:15.755305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 372/751] 10.222.0.39 () {56 vars in 1117 bytes} [Thu May 26 12:19:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:15.755896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d92a00-614e-4f75-b743-57cd071a7a0f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:15.763028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:15.772389 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337c813-50ea-45bc-a86c-6c26603ec47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:15.773775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337c813-50ea-45bc-a86c-6c26603ec47d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:15.774788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337c813-50ea-45bc-a86c-6c26603ec47d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:15.775278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337c813-50ea-45bc-a86c-6c26603ec47d None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:15.776531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337c813-50ea-45bc-a86c-6c26603ec47d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:15.777319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337c813-50ea-45bc-a86c-6c26603ec47d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:15.779411 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337c813-50ea-45bc-a86c-6c26603ec47d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:15.798863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 380/752] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:15.800005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337c813-50ea-45bc-a86c-6c26603ec47d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:15.843377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:15.864363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d92a00-614e-4f75-b743-57cd071a7a0f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:15.905921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496bbf8-0eb9-4ed0-a560-4b1eb3f71a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:15.906602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496bbf8-0eb9-4ed0-a560-4b1eb3f71a4d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:15.906890 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496bbf8-0eb9-4ed0-a560-4b1eb3f71a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:15.907169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496bbf8-0eb9-4ed0-a560-4b1eb3f71a4d None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:15.908014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496bbf8-0eb9-4ed0-a560-4b1eb3f71a4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:15.908331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496bbf8-0eb9-4ed0-a560-4b1eb3f71a4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:15.909794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496bbf8-0eb9-4ed0-a560-4b1eb3f71a4d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:15.913003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337c813-50ea-45bc-a86c-6c26603ec47d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:15.928365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 373/753] 10.222.0.39 () {56 vars in 1133 bytes} [Thu May 26 12:19:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:15.929598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1fea-1b1f-4811-8623-d3a255e603b3 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:15.929896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1fea-1b1f-4811-8623-d3a255e603b3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:15.930177 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1fea-1b1f-4811-8623-d3a255e603b3 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:15.931552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 374/754] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:15.932101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e1fea-1b1f-4811-8623-d3a255e603b3 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:15.962291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246eab-0403-4163-b924-240533b85aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:15.963241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246eab-0403-4163-b924-240533b85aef None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:15.963529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246eab-0403-4163-b924-240533b85aef None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:15.963809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246eab-0403-4163-b924-240533b85aef None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:15.965339 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67246eab-0403-4163-b924-240533b85aef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:15.965800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67246eab-0403-4163-b924-240533b85aef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:15.967367 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67246eab-0403-4163-b924-240533b85aef None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:15.996882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 381/755] 10.222.0.39 () {56 vars in 1149 bytes} [Thu May 26 12:19:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:15.997770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246eab-0403-4163-b924-240533b85aef None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:16.050431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:16.051897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e1fea-1b1f-4811-8623-d3a255e603b3 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:16.089575 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6a531-0cb0-46df-9c17-c1a0a25e0c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:16.090240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a531-0cb0-46df-9c17-c1a0a25e0c8d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:16.090522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a531-0cb0-46df-9c17-c1a0a25e0c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:16.090802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6a531-0cb0-46df-9c17-c1a0a25e0c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:16.091711 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6a531-0cb0-46df-9c17-c1a0a25e0c8d None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=691c9da310ef42a189bb78183867e46a) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:16.091949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6a531-0cb0-46df-9c17-c1a0a25e0c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:16.093411 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6a531-0cb0-46df-9c17-c1a0a25e0c8d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:16.108756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 375/756] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:15 2022] GET /identity/v3/role_assignments?user.id=691c9da310ef42a189bb78183867e46a&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:16.108756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486d95a-db20-487c-8423-b6baed2a65da None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:16.108756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486d95a-db20-487c-8423-b6baed2a65da None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:16.108756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486d95a-db20-487c-8423-b6baed2a65da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:16.109209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246eab-0403-4163-b924-240533b85aef None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:16.115152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:16.132296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8486d95a-db20-487c-8423-b6baed2a65da None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:16.133577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8486d95a-db20-487c-8423-b6baed2a65da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:16.151770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c22eea-790f-4590-b51b-a1e9400c0bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:16.152584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c22eea-790f-4590-b51b-a1e9400c0bdb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:16.153024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c22eea-790f-4590-b51b-a1e9400c0bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:16.153306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c22eea-790f-4590-b51b-a1e9400c0bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:16.168102 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c22eea-790f-4590-b51b-a1e9400c0bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:16.169643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c22eea-790f-4590-b51b-a1e9400c0bdb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f8c22eea-790f-4590-b51b-a1e9400c0bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:16.191787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:16.193344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:16.194351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:16.194351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:16.194351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:16.194351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:16.198821 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 382/757] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:16.199571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c22eea-790f-4590-b51b-a1e9400c0bdb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:16.235326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 376/758] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:16.237238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486d95a-db20-487c-8423-b6baed2a65da None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:16.316934 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:16.321343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c22eea-790f-4590-b51b-a1e9400c0bdb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:16.361632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f6b86-b2e3-4945-9925-ed503d0fbfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:16.362451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f6b86-b2e3-4945-9925-ed503d0fbfbc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:16.362845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f6b86-b2e3-4945-9925-ed503d0fbfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:16.363229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f6b86-b2e3-4945-9925-ed503d0fbfbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:16.374109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486d95a-db20-487c-8423-b6baed2a65da None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:16.421405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cdebf-00b1-4585-9dfa-0a3850baa05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:16.422589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cdebf-00b1-4585-9dfa-0a3850baa05b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:16.422877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cdebf-00b1-4585-9dfa-0a3850baa05b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:16.424892 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:16.426453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cdebf-00b1-4585-9dfa-0a3850baa05b None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:16.427576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cdebf-00b1-4585-9dfa-0a3850baa05b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:16.428436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cdebf-00b1-4585-9dfa-0a3850baa05b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:16.431683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1cdebf-00b1-4585-9dfa-0a3850baa05b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:16.443313 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f6b86-b2e3-4945-9925-ed503d0fbfbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:16.445348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f6b86-b2e3-4945-9925-ed503d0fbfbc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:16.446279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 377/759] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:16.447205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cdebf-00b1-4585-9dfa-0a3850baa05b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:16.558153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:16.567298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 383/760] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:19:16.567298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f6b86-b2e3-4945-9925-ed503d0fbfbc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:16.582944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cdebf-00b1-4585-9dfa-0a3850baa05b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:16.627127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920cf05-285a-4262-93bf-b9256b1c9ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:16.628164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920cf05-285a-4262-93bf-b9256b1c9ccb None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:16.628548 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920cf05-285a-4262-93bf-b9256b1c9ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:16.628968 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920cf05-285a-4262-93bf-b9256b1c9ccb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:16.629823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920cf05-285a-4262-93bf-b9256b1c9ccb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:16.631296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920cf05-285a-4262-93bf-b9256b1c9ccb None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b920cf05-285a-4262-93bf-b9256b1c9ccb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:16.647170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:16.648361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:19:16.649462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:16.656246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 378/761] 10.222.0.39 () {56 vars in 1129 bytes} [Thu May 26 12:19:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:16.656246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920cf05-285a-4262-93bf-b9256b1c9ccb None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:16.711738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f6b86-b2e3-4945-9925-ed503d0fbfbc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:16.713631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:16.764814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920cf05-285a-4262-93bf-b9256b1c9ccb None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:16.765653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9249a19-b707-4c64-ba59-0c621c9d5696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:16.767234 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9249a19-b707-4c64-ba59-0c621c9d5696 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:16.768818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9249a19-b707-4c64-ba59-0c621c9d5696 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:16.769249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9249a19-b707-4c64-ba59-0c621c9d5696 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:16.778532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9249a19-b707-4c64-ba59-0c621c9d5696 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:16.779996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9249a19-b707-4c64-ba59-0c621c9d5696 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b9249a19-b707-4c64-ba59-0c621c9d5696 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:16.794802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:16.795737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:16.796627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:16.796627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:16.796627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:16.796627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:16.796627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:16.796627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:16.796627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:16.796627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:16.796627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 384/762] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:16.797158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9249a19-b707-4c64-ba59-0c621c9d5696 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:16.811193 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92944d-8290-441c-8da9-5cbb26daa7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:16.813018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92944d-8290-441c-8da9-5cbb26daa7cd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:16.813573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92944d-8290-441c-8da9-5cbb26daa7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:16.814289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92944d-8290-441c-8da9-5cbb26daa7cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:16.827840 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92944d-8290-441c-8da9-5cbb26daa7cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:16.829379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92944d-8290-441c-8da9-5cbb26daa7cd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0c92944d-8290-441c-8da9-5cbb26daa7cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:16.847774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:16.848877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:16.849973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:16.849973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:16.849973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:16.849973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:16.849973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 379/763] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:16.850327 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5ad2e-bd1c-41cc-9f5a-3b57e0e2de7f None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:16.850618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5ad2e-bd1c-41cc-9f5a-3b57e0e2de7f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:16.850901 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5ad2e-bd1c-41cc-9f5a-3b57e0e2de7f None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:16.856164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 380/764] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:16.856164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5ad2e-bd1c-41cc-9f5a-3b57e0e2de7f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:16.867036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:16.912028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9249a19-b707-4c64-ba59-0c621c9d5696 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:16.949107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f7091-6c64-4acc-bf19-c60ad0d4b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:16.949782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f7091-6c64-4acc-bf19-c60ad0d4b99d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:16.950071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f7091-6c64-4acc-bf19-c60ad0d4b99d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:16.950349 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f7091-6c64-4acc-bf19-c60ad0d4b99d None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:16.951059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f7091-6c64-4acc-bf19-c60ad0d4b99d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:16.951369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f7091-6c64-4acc-bf19-c60ad0d4b99d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:16.952767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f7091-6c64-4acc-bf19-c60ad0d4b99d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:16.961990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 385/765] 10.222.0.39 () {56 vars in 1124 bytes} [Thu May 26 12:19:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:16.961990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f7091-6c64-4acc-bf19-c60ad0d4b99d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:16.983129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5ad2e-bd1c-41cc-9f5a-3b57e0e2de7f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:16.993148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:17.021817 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60ddf0-e7c3-4060-ab94-168e1ac3359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:17.022489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ddf0-e7c3-4060-ab94-168e1ac3359a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:17.022767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ddf0-e7c3-4060-ab94-168e1ac3359a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:17.023067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ddf0-e7c3-4060-ab94-168e1ac3359a None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:17.023834 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60ddf0-e7c3-4060-ab94-168e1ac3359a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:17.024148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60ddf0-e7c3-4060-ab94-168e1ac3359a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:17.025610 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60ddf0-e7c3-4060-ab94-168e1ac3359a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:17.038922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 381/766] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:17.040073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde5b0d-2ed1-403a-9a5c-2b5f22c82467 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:17.040461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde5b0d-2ed1-403a-9a5c-2b5f22c82467 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:17.040771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde5b0d-2ed1-403a-9a5c-2b5f22c82467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:17.059137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0dde5b0d-2ed1-403a-9a5c-2b5f22c82467 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:17.060340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0dde5b0d-2ed1-403a-9a5c-2b5f22c82467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:17.079701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f7091-6c64-4acc-bf19-c60ad0d4b99d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:17.107253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:17.120128 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f57bda-baa1-4b13-8639-9d153b9c9cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:17.120933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f57bda-baa1-4b13-8639-9d153b9c9cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:17.121222 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f57bda-baa1-4b13-8639-9d153b9c9cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:17.121505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f57bda-baa1-4b13-8639-9d153b9c9cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:17.122237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f57bda-baa1-4b13-8639-9d153b9c9cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:17.122553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f57bda-baa1-4b13-8639-9d153b9c9cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:17.123927 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f57bda-baa1-4b13-8639-9d153b9c9cd7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:17.131489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 382/767] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:17.132326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde5b0d-2ed1-403a-9a5c-2b5f22c82467 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:17.148804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 386/768] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:17.149991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f57bda-baa1-4b13-8639-9d153b9c9cd7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:17.250784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:17.256799 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde5b0d-2ed1-403a-9a5c-2b5f22c82467 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:17.261575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f57bda-baa1-4b13-8639-9d153b9c9cd7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:17.295626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11695f-9607-43c1-9d30-985659f4d8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:17.296277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11695f-9607-43c1-9d30-985659f4d8fa None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:17.296562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11695f-9607-43c1-9d30-985659f4d8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:17.296867 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11695f-9607-43c1-9d30-985659f4d8fa None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:17.297583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11695f-9607-43c1-9d30-985659f4d8fa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:17.297888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11695f-9607-43c1-9d30-985659f4d8fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:17.299263 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11695f-9607-43c1-9d30-985659f4d8fa None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:17.301683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545b8bd-9f03-4aea-9f19-6fddfcc224c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:17.302846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545b8bd-9f03-4aea-9f19-6fddfcc224c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:17.303300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545b8bd-9f03-4aea-9f19-6fddfcc224c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:17.303581 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545b8bd-9f03-4aea-9f19-6fddfcc224c1 None admin] PATH_INFO: `/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/04f5fbbe45ec4dcf8301da8483af2941/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:17.306109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545b8bd-9f03-4aea-9f19-6fddfcc224c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b341d104240e4b4cb61d365e8167f6a8, user_id=04f5fbbe45ec4dcf8301da8483af2941, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:17.307564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545b8bd-9f03-4aea-9f19-6fddfcc224c1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:17.308617 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 383/769] 10.222.0.39 () {56 vars in 1124 bytes} [Thu May 26 12:19:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:17.310228 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11695f-9607-43c1-9d30-985659f4d8fa None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:17.326633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 387/770] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:19:17 2022] PUT /identity/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/04f5fbbe45ec4dcf8301da8483af2941/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:19:17.328149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545b8bd-9f03-4aea-9f19-6fddfcc224c1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:17.403784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:17.437671 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11695f-9607-43c1-9d30-985659f4d8fa None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:17.476097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c734b-7690-4477-90c2-7984b5aa3651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:17.476959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c734b-7690-4477-90c2-7984b5aa3651 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:17.477239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c734b-7690-4477-90c2-7984b5aa3651 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:17.477585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c734b-7690-4477-90c2-7984b5aa3651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:17.485422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c734b-7690-4477-90c2-7984b5aa3651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:17.485606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545b8bd-9f03-4aea-9f19-6fddfcc224c1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:17.486925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c734b-7690-4477-90c2-7984b5aa3651 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-fd2c734b-7690-4477-90c2-7984b5aa3651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:17.503619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:17.504590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:17.505971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:17.505971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:17.505971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:17.505971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:17.505971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:17.505971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:17.505971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:17.505971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:17.505971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 384/771] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:17.506770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c734b-7690-4477-90c2-7984b5aa3651 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:17.534438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48e479-1718-459c-ac53-768227b3b745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:17.536240 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48e479-1718-459c-ac53-768227b3b745 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:17.536936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48e479-1718-459c-ac53-768227b3b745 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:17.537587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48e479-1718-459c-ac53-768227b3b745 None admin] PATH_INFO: `/v3/services/network` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:17.539132 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48e479-1718-459c-ac53-768227b3b745 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:17.541447 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48e479-1718-459c-ac53-768227b3b745 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:17.557597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8e48e479-1718-459c-ac53-768227b3b745 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:17.557949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:17.558907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:17.559723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 388/772] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:17 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:17.561542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48e479-1718-459c-ac53-768227b3b745 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:17.640549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c734b-7690-4477-90c2-7984b5aa3651 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:17.685990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48e479-1718-459c-ac53-768227b3b745 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:17.686166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e251f-2f7a-4dd6-8296-547edb06378d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:17.686855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e251f-2f7a-4dd6-8296-547edb06378d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:17.687142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e251f-2f7a-4dd6-8296-547edb06378d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:17.687426 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e251f-2f7a-4dd6-8296-547edb06378d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:17.688234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e251f-2f7a-4dd6-8296-547edb06378d None admin] RBAC: Adding query filter params (interface=public, service_id=5cc5242623f644f38bbedb44278196b5, region_id=RegionOne) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:17.688759 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e251f-2f7a-4dd6-8296-547edb06378d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:17.690139 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e251f-2f7a-4dd6-8296-547edb06378d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:17.699518 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 385/773] 10.222.0.39 () {56 vars in 1251 bytes} [Thu May 26 12:19:17 2022] GET /identity/v3/endpoints?service_id=5cc5242623f644f38bbedb44278196b5&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:17.704367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e251f-2f7a-4dd6-8296-547edb06378d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:17.705074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:17.731653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da6851-40f1-422d-afa2-f64b9d6d529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:17.732699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da6851-40f1-422d-afa2-f64b9d6d529d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:17.733294 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da6851-40f1-422d-afa2-f64b9d6d529d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:17.733763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da6851-40f1-422d-afa2-f64b9d6d529d None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:17.734841 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da6851-40f1-422d-afa2-f64b9d6d529d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:17.735345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da6851-40f1-422d-afa2-f64b9d6d529d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:17.737222 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da6851-40f1-422d-afa2-f64b9d6d529d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:17.759330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 389/774] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:17.760176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da6851-40f1-422d-afa2-f64b9d6d529d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:17.816168 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:17.836837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e251f-2f7a-4dd6-8296-547edb06378d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:17.878045 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da6851-40f1-422d-afa2-f64b9d6d529d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:17.896945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfc908-1db3-4ce0-a341-ef2f24b29e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:17.898311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfc908-1db3-4ce0-a341-ef2f24b29e13 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:17.898311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfc908-1db3-4ce0-a341-ef2f24b29e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:17.898311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfc908-1db3-4ce0-a341-ef2f24b29e13 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:17.899062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfc908-1db3-4ce0-a341-ef2f24b29e13 None admin] RBAC: Adding query filter params (name=network) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:17.899377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfc908-1db3-4ce0-a341-ef2f24b29e13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:17.900779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbfc908-1db3-4ce0-a341-ef2f24b29e13 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:17.916573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 386/775] 10.222.0.39 () {56 vars in 1112 bytes} [Thu May 26 12:19:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:17.916573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfc908-1db3-4ce0-a341-ef2f24b29e13 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:17.926714 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1103765-d996-44f7-af0b-71ebb1be7f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:17.927500 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1103765-d996-44f7-af0b-71ebb1be7f72 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:17.927793 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1103765-d996-44f7-af0b-71ebb1be7f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:17.928058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1103765-d996-44f7-af0b-71ebb1be7f72 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:17.928776 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1103765-d996-44f7-af0b-71ebb1be7f72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:17.930480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1103765-d996-44f7-af0b-71ebb1be7f72 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:17.941116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 390/776] 10.222.0.39 () {56 vars in 1087 bytes} [Thu May 26 12:19:17 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:17.942006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1103765-d996-44f7-af0b-71ebb1be7f72 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:18.032279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:18.076778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfc908-1db3-4ce0-a341-ef2f24b29e13 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:18.169697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1103765-d996-44f7-af0b-71ebb1be7f72 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:18.177632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cb06b-f4ba-491c-8511-88923b802c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:18.178749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cb06b-f4ba-491c-8511-88923b802c2c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:18.179162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cb06b-f4ba-491c-8511-88923b802c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:18.179550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cb06b-f4ba-491c-8511-88923b802c2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:18.180516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cb06b-f4ba-491c-8511-88923b802c2c None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=bc48f3a3998b4c5ab199181005f9a5d7) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:18.180981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cb06b-f4ba-491c-8511-88923b802c2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:18.182660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cb06b-f4ba-491c-8511-88923b802c2c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:18.191073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 387/777] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:17 2022] GET /identity/v3/role_assignments?user.id=bc48f3a3998b4c5ab199181005f9a5d7&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:18.213217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b2b7e-cd3b-448d-a9de-99a5fd816803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:18.214238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b2b7e-cd3b-448d-a9de-99a5fd816803 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:18.214676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b2b7e-cd3b-448d-a9de-99a5fd816803 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:18.215139 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b2b7e-cd3b-448d-a9de-99a5fd816803 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:18.216084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b2b7e-cd3b-448d-a9de-99a5fd816803 None admin] RBAC: Adding query filter params (type=network) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:18.216581 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b2b7e-cd3b-448d-a9de-99a5fd816803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:18.218206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b2b7e-cd3b-448d-a9de-99a5fd816803 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:18.225502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 391/778] 10.222.0.39 () {56 vars in 1112 bytes} [Thu May 26 12:19:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:18.231274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cb06b-f4ba-491c-8511-88923b802c2c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:18.259323 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:18.358338 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cb06b-f4ba-491c-8511-88923b802c2c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:18.397469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27df33-c314-4bf0-bef7-0937e13ff783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:18.398140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27df33-c314-4bf0-bef7-0937e13ff783 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:18.398427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27df33-c314-4bf0-bef7-0937e13ff783 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:18.398704 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27df33-c314-4bf0-bef7-0937e13ff783 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:18.399514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27df33-c314-4bf0-bef7-0937e13ff783 None admin] RBAC: Adding query filter params (interface=public, service_id=de37ce265d73405eb818dbc9b9238bfe, region_id=RegionOne) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:18.399833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27df33-c314-4bf0-bef7-0937e13ff783 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:18.401261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27df33-c314-4bf0-bef7-0937e13ff783 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:18.407812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 388/779] 10.222.0.39 () {56 vars in 1251 bytes} [Thu May 26 12:19:18 2022] GET /identity/v3/endpoints?service_id=de37ce265d73405eb818dbc9b9238bfe&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:18.413592 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b2b7e-cd3b-448d-a9de-99a5fd816803 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:18.458088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4c758-423c-4121-ba78-5adcfe6a39ae None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:18.458972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4c758-423c-4121-ba78-5adcfe6a39ae None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:18.459272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4c758-423c-4121-ba78-5adcfe6a39ae None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:18.460679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 389/780] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:18.466206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331c00b-1a96-4ff5-91aa-9f714745d388 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:18.466719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331c00b-1a96-4ff5-91aa-9f714745d388 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:18.467229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331c00b-1a96-4ff5-91aa-9f714745d388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:18.487578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6331c00b-1a96-4ff5-91aa-9f714745d388 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:18.489093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6331c00b-1a96-4ff5-91aa-9f714745d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:18.544329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:18.562083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b2b7e-cd3b-448d-a9de-99a5fd816803 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:18.570234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 390/781] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:18.622149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836bcf9-859e-4084-ba53-f923b054b2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:18.622356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331c00b-1a96-4ff5-91aa-9f714745d388 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:18.622819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836bcf9-859e-4084-ba53-f923b054b2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:18.623101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836bcf9-859e-4084-ba53-f923b054b2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:18.623376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836bcf9-859e-4084-ba53-f923b054b2b4 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:18.624064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836bcf9-859e-4084-ba53-f923b054b2b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:18.625460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836bcf9-859e-4084-ba53-f923b054b2b4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:18.640752 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 392/782] 10.222.0.39 () {56 vars in 1087 bytes} [Thu May 26 12:19:18 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:18.647936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:18.802247 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331c00b-1a96-4ff5-91aa-9f714745d388 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:18.854515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dc1f4-05a7-4b2d-82e4-116897d005fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:18.855317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dc1f4-05a7-4b2d-82e4-116897d005fa None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:18.855598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dc1f4-05a7-4b2d-82e4-116897d005fa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:18.855868 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dc1f4-05a7-4b2d-82e4-116897d005fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:18.868562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dc1f4-05a7-4b2d-82e4-116897d005fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-e26dc1f4-05a7-4b2d-82e4-116897d005fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:18.876274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:18.877283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:18.878162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:18.878162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:18.878162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:18.878162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:18.878162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:18.878162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:18.878162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:18.878162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:18.878162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:18.878162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:18.878162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:18.878162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:18.878162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 391/783] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:19:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:18.889853 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836bcf9-859e-4084-ba53-f923b054b2b4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:19.009553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836bcf9-859e-4084-ba53-f923b054b2b4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:19.054176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b796666-92a1-4005-a42a-ff8a9ca3b449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:19.055529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b796666-92a1-4005-a42a-ff8a9ca3b449 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:19.056024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b796666-92a1-4005-a42a-ff8a9ca3b449 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:19.056768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b796666-92a1-4005-a42a-ff8a9ca3b449 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:19.057860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b796666-92a1-4005-a42a-ff8a9ca3b449 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:19.058549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b796666-92a1-4005-a42a-ff8a9ca3b449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:19.060867 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b796666-92a1-4005-a42a-ff8a9ca3b449 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:19.073452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 393/784] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:19:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:19.079213 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dc1f4-05a7-4b2d-82e4-116897d005fa None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:19.198717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:19.257108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dc1f4-05a7-4b2d-82e4-116897d005fa None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:19.312681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5397b2-ee7c-483d-9716-cbd07c669663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:19.313435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5397b2-ee7c-483d-9716-cbd07c669663 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:19.313722 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5397b2-ee7c-483d-9716-cbd07c669663 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:19.314002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5397b2-ee7c-483d-9716-cbd07c669663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:19.332371 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5397b2-ee7c-483d-9716-cbd07c669663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:19.334046 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5397b2-ee7c-483d-9716-cbd07c669663 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-3e5397b2-ee7c-483d-9716-cbd07c669663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:19.360106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:19.361099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:19.362407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:19.362407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:19.362407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:19.362407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:19.362407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 392/785] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:19.368924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b796666-92a1-4005-a42a-ff8a9ca3b449 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:19.414506 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:19.527188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b796666-92a1-4005-a42a-ff8a9ca3b449 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:19.571828 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401a98f-7153-4dfc-81cd-c67d259a7762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:19.572431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401a98f-7153-4dfc-81cd-c67d259a7762 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:19.572737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401a98f-7153-4dfc-81cd-c67d259a7762 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:19.573023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401a98f-7153-4dfc-81cd-c67d259a7762 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:19.573762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401a98f-7153-4dfc-81cd-c67d259a7762 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:19.574077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401a98f-7153-4dfc-81cd-c67d259a7762 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:19.575464 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401a98f-7153-4dfc-81cd-c67d259a7762 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:19.594375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 394/786] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:19.600232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5397b2-ee7c-483d-9716-cbd07c669663 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:19.766901 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5397b2-ee7c-483d-9716-cbd07c669663 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:19.799501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:19.821143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad72970-c5be-4254-98b4-040b2d75b633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:19.822010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad72970-c5be-4254-98b4-040b2d75b633 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:19.822241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad72970-c5be-4254-98b4-040b2d75b633 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:19.822523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad72970-c5be-4254-98b4-040b2d75b633 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:19.835663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad72970-c5be-4254-98b4-040b2d75b633 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:19.837144 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad72970-c5be-4254-98b4-040b2d75b633 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-5ad72970-c5be-4254-98b4-040b2d75b633 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:19.857811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:19.859197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:19.860471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:19.860471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:19.860471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:19.860471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:19.860471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:19.860471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:19.860471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:19.860471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:19.860471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:19:19.860471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:19.860471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 393/787] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:19:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:19.867643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401a98f-7153-4dfc-81cd-c67d259a7762 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:20.006434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9a517-2ea1-43be-afc0-e04d02f8f246 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:20.006759 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9a517-2ea1-43be-afc0-e04d02f8f246 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:20.007005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9a517-2ea1-43be-afc0-e04d02f8f246 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:20.008518 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 394/788] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:20.013720 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab824b5a-7d90-4812-a1e5-547d7be5009d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:20.014229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab824b5a-7d90-4812-a1e5-547d7be5009d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:20.014711 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab824b5a-7d90-4812-a1e5-547d7be5009d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:20.032590 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:20.039688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ab824b5a-7d90-4812-a1e5-547d7be5009d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:20.040916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ab824b5a-7d90-4812-a1e5-547d7be5009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:20.064969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401a98f-7153-4dfc-81cd-c67d259a7762 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:20.121536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eb1c6-1a62-485d-a387-b2c2ddd4bf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:20.122149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eb1c6-1a62-485d-a387-b2c2ddd4bf14 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:20.122441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eb1c6-1a62-485d-a387-b2c2ddd4bf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:20.122725 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eb1c6-1a62-485d-a387-b2c2ddd4bf14 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:20.123583 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eb1c6-1a62-485d-a387-b2c2ddd4bf14 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:20.123901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eb1c6-1a62-485d-a387-b2c2ddd4bf14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:20.125391 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eb1c6-1a62-485d-a387-b2c2ddd4bf14 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:20.132365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 395/789] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:20.156906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab824b5a-7d90-4812-a1e5-547d7be5009d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:20.160624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 395/790] 10.222.0.39 () {56 vars in 1135 bytes} [Thu May 26 12:19:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:20.166297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eb1c6-1a62-485d-a387-b2c2ddd4bf14 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:20.272653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eb1c6-1a62-485d-a387-b2c2ddd4bf14 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:20.310223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d8762-1cce-4257-83ac-0d14448abdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:20.311200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d8762-1cce-4257-83ac-0d14448abdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:20.311581 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d8762-1cce-4257-83ac-0d14448abdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:20.311695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab824b5a-7d90-4812-a1e5-547d7be5009d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:20.312029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d8762-1cce-4257-83ac-0d14448abdd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:20.322186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:20.324644 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:20.326357 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d8762-1cce-4257-83ac-0d14448abdd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:20.328057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d8762-1cce-4257-83ac-0d14448abdd4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ec2d8762-1cce-4257-83ac-0d14448abdd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:20.349755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:20.350746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:20.351648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:20.351648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:20.351648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:20.351648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:20.351648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 396/791] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:20.355208 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580a89-d027-47c2-a5c5-6e0dc10fbc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:20.356311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580a89-d027-47c2-a5c5-6e0dc10fbc63 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:20.356822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580a89-d027-47c2-a5c5-6e0dc10fbc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:20.356930 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d8762-1cce-4257-83ac-0d14448abdd4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:20.357401 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec580a89-d027-47c2-a5c5-6e0dc10fbc63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:20.370297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec580a89-d027-47c2-a5c5-6e0dc10fbc63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ec580a89-d027-47c2-a5c5-6e0dc10fbc63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:20.379089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:20.380049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:20.381029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:20.381029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:20.381029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:20.381029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:20.381029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:20.381029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:20.381029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:20.381029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:20.381029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:20.381029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:20.381029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:20.381029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:20.383771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 396/792] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:20.393977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580a89-d027-47c2-a5c5-6e0dc10fbc63 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:20.500782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec580a89-d027-47c2-a5c5-6e0dc10fbc63 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:20.532199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d8762-1cce-4257-83ac-0d14448abdd4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:20.568436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842372f5-168c-4e27-a8ae-813d2f089855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:20.569231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842372f5-168c-4e27-a8ae-813d2f089855 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:20.569517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842372f5-168c-4e27-a8ae-813d2f089855 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:20.569792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842372f5-168c-4e27-a8ae-813d2f089855 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:20.570552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842372f5-168c-4e27-a8ae-813d2f089855 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:20.570859 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842372f5-168c-4e27-a8ae-813d2f089855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:20.572223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842372f5-168c-4e27-a8ae-813d2f089855 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:20.590316 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 397/793] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:19:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:20.595916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842372f5-168c-4e27-a8ae-813d2f089855 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:20.610020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c96c4-8ac8-4b10-9f0f-1eb6cc5bea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:20.610703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c96c4-8ac8-4b10-9f0f-1eb6cc5bea4d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:20.610986 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c96c4-8ac8-4b10-9f0f-1eb6cc5bea4d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:20.611257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c96c4-8ac8-4b10-9f0f-1eb6cc5bea4d None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:20.611987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c96c4-8ac8-4b10-9f0f-1eb6cc5bea4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:20.612292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c96c4-8ac8-4b10-9f0f-1eb6cc5bea4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:20.613699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c96c4-8ac8-4b10-9f0f-1eb6cc5bea4d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:20.632500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:20.640159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 397/794] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:20.645423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c96c4-8ac8-4b10-9f0f-1eb6cc5bea4d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:20.714893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842372f5-168c-4e27-a8ae-813d2f089855 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:20.758456 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446e600-1938-4c92-a47e-871b49b8aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:20.760287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446e600-1938-4c92-a47e-871b49b8aac8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:20.760847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446e600-1938-4c92-a47e-871b49b8aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:20.761311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446e600-1938-4c92-a47e-871b49b8aac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:20.776322 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446e600-1938-4c92-a47e-871b49b8aac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:20.778417 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446e600-1938-4c92-a47e-871b49b8aac8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:20.785638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-6446e600-1938-4c92-a47e-871b49b8aac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:20.801179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:20.802240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:20.803179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:20.803179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:20.803179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:20.803179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:20.810281 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 398/795] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:20.812173 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446e600-1938-4c92-a47e-871b49b8aac8 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:20.908751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c96c4-8ac8-4b10-9f0f-1eb6cc5bea4d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:20.950246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:20.964632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ac588-5c7c-4e79-af13-213853f48d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:20.965478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac588-5c7c-4e79-af13-213853f48d38 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:20.965765 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac588-5c7c-4e79-af13-213853f48d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:20.966041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ac588-5c7c-4e79-af13-213853f48d38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:20.967308 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446e600-1938-4c92-a47e-871b49b8aac8 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:20.973232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ac588-5c7c-4e79-af13-213853f48d38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:20.975493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ac588-5c7c-4e79-af13-213853f48d38 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-215ac588-5c7c-4e79-af13-213853f48d38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:20.992401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:20.993555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:20.994735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:20.994735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:20.994735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:20.994735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:20.994735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:20.994735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:20.994735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:20.994735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:20.994735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 398/796] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:20.995424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b560da-7a5b-49fb-82b8-845d342c3b43 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:20.997404 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b560da-7a5b-49fb-82b8-845d342c3b43 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:20.997404 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b560da-7a5b-49fb-82b8-845d342c3b43 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.001294 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 399/797] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:21.002159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b560da-7a5b-49fb-82b8-845d342c3b43 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:21.008296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a448f9-7e2b-43f1-b4b4-cf70c97c2e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:21.009003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a448f9-7e2b-43f1-b4b4-cf70c97c2e63 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.009294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a448f9-7e2b-43f1-b4b4-cf70c97c2e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.009578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a448f9-7e2b-43f1-b4b4-cf70c97c2e63 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.010320 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a448f9-7e2b-43f1-b4b4-cf70c97c2e63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:21.010635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a448f9-7e2b-43f1-b4b4-cf70c97c2e63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:21.012013 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a448f9-7e2b-43f1-b4b4-cf70c97c2e63 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:21.025330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 399/798] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:21.026614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d8c08-3782-49fc-8c7f-ffbeb54b54ed None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.026910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d8c08-3782-49fc-8c7f-ffbeb54b54ed None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.027190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d8c08-3782-49fc-8c7f-ffbeb54b54ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.044314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a91d8c08-3782-49fc-8c7f-ffbeb54b54ed None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:21.045542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a91d8c08-3782-49fc-8c7f-ffbeb54b54ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:21.114437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b560da-7a5b-49fb-82b8-845d342c3b43 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:21.125036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 400/799] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:21.125036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d8c08-3782-49fc-8c7f-ffbeb54b54ed None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:21.140522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:21.164182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975c982-f79f-47ba-914e-59fc5bdaa0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:21.164887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975c982-f79f-47ba-914e-59fc5bdaa0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.165172 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975c982-f79f-47ba-914e-59fc5bdaa0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.165957 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975c982-f79f-47ba-914e-59fc5bdaa0d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.166766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975c982-f79f-47ba-914e-59fc5bdaa0d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:21.167080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975c982-f79f-47ba-914e-59fc5bdaa0d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:21.169281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975c982-f79f-47ba-914e-59fc5bdaa0d1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:21.187147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 400/800] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:21.187147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d408f-c57d-4366-bbe9-abb38a91b9c9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.187147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d408f-c57d-4366-bbe9-abb38a91b9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.187147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d408f-c57d-4366-bbe9-abb38a91b9c9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.187147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 401/801] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:21.187147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d408f-c57d-4366-bbe9-abb38a91b9c9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:21.213794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:21.241461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d8c08-3782-49fc-8c7f-ffbeb54b54ed None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:21.279775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3835d-5aef-44fc-85a3-70d65cc8ffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:21.280570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3835d-5aef-44fc-85a3-70d65cc8ffb1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.281265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3835d-5aef-44fc-85a3-70d65cc8ffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.281386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3835d-5aef-44fc-85a3-70d65cc8ffb1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.289054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3835d-5aef-44fc-85a3-70d65cc8ffb1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:21.290484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3835d-5aef-44fc-85a3-70d65cc8ffb1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:21.298266 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d408f-c57d-4366-bbe9-abb38a91b9c9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-d0f3835d-5aef-44fc-85a3-70d65cc8ffb1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:21.306365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:21.307310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:21.308239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:21.308239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:21.308239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:21.308239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:21.308239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:21.308239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:21.308239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:21.308239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:21.308239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:19:21.308239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:21.308239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 401/802] 10.222.0.39 () {56 vars in 1093 bytes} [Thu May 26 12:19:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:21.308877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3835d-5aef-44fc-85a3-70d65cc8ffb1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:21.341005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a390cb-540b-4eae-813e-0e658ce425b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:21.341792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a390cb-540b-4eae-813e-0e658ce425b8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.342080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a390cb-540b-4eae-813e-0e658ce425b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.342355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a390cb-540b-4eae-813e-0e658ce425b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.354649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a390cb-540b-4eae-813e-0e658ce425b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-33a390cb-540b-4eae-813e-0e658ce425b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:21.362729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:21.363754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:21.364794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:21.364794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:21.364794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:21.364794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:21.364794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:21.364794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:21.364794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:21.364794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:21.364794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:21.364794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:21.364794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:21.364794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:21.364794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 402/803] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:19:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:21.370486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223807d-3fd2-4d49-b0f8-92a39c110f58 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.370771 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223807d-3fd2-4d49-b0f8-92a39c110f58 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.371036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223807d-3fd2-4d49-b0f8-92a39c110f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.388808 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5223807d-3fd2-4d49-b0f8-92a39c110f58 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:21.390003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5223807d-3fd2-4d49-b0f8-92a39c110f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:21.419073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:21.427092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3835d-5aef-44fc-85a3-70d65cc8ffb1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:21.465018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 403/804] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:21.466169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223807d-3fd2-4d49-b0f8-92a39c110f58 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:21.469885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022dcf0-2937-4cf3-9aa8-833ef19591f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:21.470784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022dcf0-2937-4cf3-9aa8-833ef19591f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.471065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022dcf0-2937-4cf3-9aa8-833ef19591f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.471342 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022dcf0-2937-4cf3-9aa8-833ef19591f2 None admin] PATH_INFO: `/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/691c9da310ef42a189bb78183867e46a/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.473340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022dcf0-2937-4cf3-9aa8-833ef19591f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b341d104240e4b4cb61d365e8167f6a8, user_id=691c9da310ef42a189bb78183867e46a, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:21.474936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022dcf0-2937-4cf3-9aa8-833ef19591f2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:21.477411 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:21.491677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 402/805] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:19:21 2022] PUT /identity/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/691c9da310ef42a189bb78183867e46a/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:19:21.492494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022dcf0-2937-4cf3-9aa8-833ef19591f2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:21.591011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223807d-3fd2-4d49-b0f8-92a39c110f58 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:21.612787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022dcf0-2937-4cf3-9aa8-833ef19591f2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:21.627658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b6406-fd9b-44ea-9471-72f5a0fbb10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:21.628352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b6406-fd9b-44ea-9471-72f5a0fbb10a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.628639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b6406-fd9b-44ea-9471-72f5a0fbb10a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.629006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b6406-fd9b-44ea-9471-72f5a0fbb10a None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.629902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b6406-fd9b-44ea-9471-72f5a0fbb10a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:21.630736 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b6406-fd9b-44ea-9471-72f5a0fbb10a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:21.632233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b6406-fd9b-44ea-9471-72f5a0fbb10a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:21.651339 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 404/806] 10.222.0.39 () {56 vars in 1133 bytes} [Thu May 26 12:19:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:21.652318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b6406-fd9b-44ea-9471-72f5a0fbb10a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:21.656928 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9f633-36ac-4e83-aa1e-d32814e48c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:21.657662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9f633-36ac-4e83-aa1e-d32814e48c76 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.658066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9f633-36ac-4e83-aa1e-d32814e48c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.658369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9f633-36ac-4e83-aa1e-d32814e48c76 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.659138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9f633-36ac-4e83-aa1e-d32814e48c76 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:21.659456 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9f633-36ac-4e83-aa1e-d32814e48c76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:21.660968 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9f633-36ac-4e83-aa1e-d32814e48c76 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:21.670565 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 403/807] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:19:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:21.671839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef34e7c-91bd-40d1-90d0-455361c8de2e None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.672131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef34e7c-91bd-40d1-90d0-455361c8de2e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.672408 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef34e7c-91bd-40d1-90d0-455361c8de2e None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.676921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 404/808] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:21.676921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef34e7c-91bd-40d1-90d0-455361c8de2e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:21.686176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:21.752731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:21.785219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b6406-fd9b-44ea-9471-72f5a0fbb10a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:21.803996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef34e7c-91bd-40d1-90d0-455361c8de2e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:21.825232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc80b5-dd09-4bda-9fc7-17cd45cc85d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:21.826044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc80b5-dd09-4bda-9fc7-17cd45cc85d8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.826338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc80b5-dd09-4bda-9fc7-17cd45cc85d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.826618 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc80b5-dd09-4bda-9fc7-17cd45cc85d8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.827281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc80b5-dd09-4bda-9fc7-17cd45cc85d8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:21.828656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc80b5-dd09-4bda-9fc7-17cd45cc85d8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:21.840409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faded66b-a893-4604-baec-b2d34b3b9ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:21.841095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faded66b-a893-4604-baec-b2d34b3b9ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.841381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faded66b-a893-4604-baec-b2d34b3b9ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.841658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faded66b-a893-4604-baec-b2d34b3b9ad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f4cc80b5-dd09-4bda-9fc7-17cd45cc85d8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:21.841974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:21.842918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:21.843768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 405/809] 10.222.0.39 () {56 vars in 1129 bytes} [Thu May 26 12:19:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:21.844622 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc80b5-dd09-4bda-9fc7-17cd45cc85d8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:21.929594 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faded66b-a893-4604-baec-b2d34b3b9ad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:21.931409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faded66b-a893-4604-baec-b2d34b3b9ad8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:21.938012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:21.956276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc80b5-dd09-4bda-9fc7-17cd45cc85d8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:21.993006 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:21.996457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665deab-cc4e-4cb8-9bbd-831fc159a9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:21.997297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665deab-cc4e-4cb8-9bbd-831fc159a9ea None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:21.997564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665deab-cc4e-4cb8-9bbd-831fc159a9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:21.997842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665deab-cc4e-4cb8-9bbd-831fc159a9ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:22.009944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665deab-cc4e-4cb8-9bbd-831fc159a9ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:22.011400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665deab-cc4e-4cb8-9bbd-831fc159a9ea None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8665deab-cc4e-4cb8-9bbd-831fc159a9ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:22.029369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:22.030377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:22.031278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:22.031278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:22.031278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:22.031278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:22.031278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 406/810] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:22.032090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7708b-a9fb-433b-ad9a-00324d139240 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:22.032368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7708b-a9fb-433b-ad9a-00324d139240 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:22.032645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7708b-a9fb-433b-ad9a-00324d139240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:22.048334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 405/811] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:19:22.049774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faded66b-a893-4604-baec-b2d34b3b9ad8 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:22.049884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fcb7708b-a9fb-433b-ad9a-00324d139240 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:22.051019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fcb7708b-a9fb-433b-ad9a-00324d139240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:22.130454 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 407/812] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:22.131319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7708b-a9fb-433b-ad9a-00324d139240 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:22.171528 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faded66b-a893-4604-baec-b2d34b3b9ad8 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:22.209148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b4710-d17c-4cfe-bcf9-9e018b4c9dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:22.209837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b4710-d17c-4cfe-bcf9-9e018b4c9dfc None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:22.210123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b4710-d17c-4cfe-bcf9-9e018b4c9dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:22.210402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b4710-d17c-4cfe-bcf9-9e018b4c9dfc None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:22.211115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b4710-d17c-4cfe-bcf9-9e018b4c9dfc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:22.211426 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b4710-d17c-4cfe-bcf9-9e018b4c9dfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:22.212415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:22.212821 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b4710-d17c-4cfe-bcf9-9e018b4c9dfc None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:22.221955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 406/813] 10.222.0.39 () {56 vars in 1124 bytes} [Thu May 26 12:19:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:22.221955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b4710-d17c-4cfe-bcf9-9e018b4c9dfc None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:22.241706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:22.255953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7708b-a9fb-433b-ad9a-00324d139240 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:22.294041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fb906-bed4-44ba-bcba-fff95b760288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:22.295199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb906-bed4-44ba-bcba-fff95b760288 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:22.295493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb906-bed4-44ba-bcba-fff95b760288 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:22.295770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fb906-bed4-44ba-bcba-fff95b760288 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:22.296657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fb906-bed4-44ba-bcba-fff95b760288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:22.297015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fb906-bed4-44ba-bcba-fff95b760288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:22.298401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fb906-bed4-44ba-bcba-fff95b760288 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:22.315777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 408/814] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:22.315777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fb906-bed4-44ba-bcba-fff95b760288 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:22.335490 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b4710-d17c-4cfe-bcf9-9e018b4c9dfc None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:22.376450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b1a14-fc9d-4224-88bc-f82fe4a9a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:22.377275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b1a14-fc9d-4224-88bc-f82fe4a9a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:22.377560 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b1a14-fc9d-4224-88bc-f82fe4a9a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:22.377833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b1a14-fc9d-4224-88bc-f82fe4a9a7c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:22.389149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b1a14-fc9d-4224-88bc-f82fe4a9a7c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:22.390611 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b1a14-fc9d-4224-88bc-f82fe4a9a7c6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-401b1a14-fc9d-4224-88bc-f82fe4a9a7c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:22.409465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:22.410382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:22.411292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:22.411292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:22.411292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:22.411292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:22.411292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 407/815] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:22.411621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b1a14-fc9d-4224-88bc-f82fe4a9a7c6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:22.431089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fb906-bed4-44ba-bcba-fff95b760288 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:22.460516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:22.470542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122997a-1745-457f-8306-1d30e5594171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:22.471342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122997a-1745-457f-8306-1d30e5594171 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:22.471631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122997a-1745-457f-8306-1d30e5594171 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:22.471906 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122997a-1745-457f-8306-1d30e5594171 None admin] PATH_INFO: `/v3/services/network` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:22.472565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122997a-1745-457f-8306-1d30e5594171 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:22.473991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122997a-1745-457f-8306-1d30e5594171 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e122997a-1745-457f-8306-1d30e5594171 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:22.486005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:22.486992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:22.488591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 409/816] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:22 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:22.489423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122997a-1745-457f-8306-1d30e5594171 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:22.493877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:22.530223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b1a14-fc9d-4224-88bc-f82fe4a9a7c6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:22.566585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4d6e1-0421-411a-9bc7-fbe723cd477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:22.567262 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4d6e1-0421-411a-9bc7-fbe723cd477e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:22.567546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4d6e1-0421-411a-9bc7-fbe723cd477e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:22.568352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4d6e1-0421-411a-9bc7-fbe723cd477e None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:22.569100 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4d6e1-0421-411a-9bc7-fbe723cd477e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:22.569440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4d6e1-0421-411a-9bc7-fbe723cd477e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:22.570815 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4d6e1-0421-411a-9bc7-fbe723cd477e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:22.575937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 408/817] 10.222.0.39 () {56 vars in 1124 bytes} [Thu May 26 12:19:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:22.580598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4d6e1-0421-411a-9bc7-fbe723cd477e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:22.604133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122997a-1745-457f-8306-1d30e5594171 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:22.642709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1718958-ec3c-4217-98ed-e26b7a73561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:22.643774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1718958-ec3c-4217-98ed-e26b7a73561a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:22.644055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1718958-ec3c-4217-98ed-e26b7a73561a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:22.644328 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1718958-ec3c-4217-98ed-e26b7a73561a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:22.653020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1718958-ec3c-4217-98ed-e26b7a73561a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:22.654479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1718958-ec3c-4217-98ed-e26b7a73561a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f1718958-ec3c-4217-98ed-e26b7a73561a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:22.669220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:22.670250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:22.671199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:22.671199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:22.671199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:22.671199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:22.671199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:22.671199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:22.671199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:22.671199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:22.671199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:19:22.671199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:22.675625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 410/818] 10.222.0.39 () {56 vars in 1117 bytes} [Thu May 26 12:19:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:22.676575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1718958-ec3c-4217-98ed-e26b7a73561a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:22.701233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4d6e1-0421-411a-9bc7-fbe723cd477e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:22.729782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:22.738959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a660f32-58e8-4043-ac21-2d5ce85be5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:22.740576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a660f32-58e8-4043-ac21-2d5ce85be5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:22.740898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a660f32-58e8-4043-ac21-2d5ce85be5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:22.741182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a660f32-58e8-4043-ac21-2d5ce85be5a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:22.741916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a660f32-58e8-4043-ac21-2d5ce85be5a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:22.742230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a660f32-58e8-4043-ac21-2d5ce85be5a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:22.743685 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a660f32-58e8-4043-ac21-2d5ce85be5a3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:22.746706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:22.759046 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 409/819] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:22.760169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a660f32-58e8-4043-ac21-2d5ce85be5a3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:22.788461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1718958-ec3c-4217-98ed-e26b7a73561a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:22.826568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a62752-5ac6-41a8-8d07-91c32ab8cbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:22.827401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a62752-5ac6-41a8-8d07-91c32ab8cbfe None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:22.827515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a62752-5ac6-41a8-8d07-91c32ab8cbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:22.827768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a62752-5ac6-41a8-8d07-91c32ab8cbfe None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:22.828469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a62752-5ac6-41a8-8d07-91c32ab8cbfe None admin] RBAC: Adding query filter params (name=network) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:22.828801 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a62752-5ac6-41a8-8d07-91c32ab8cbfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:22.830177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a62752-5ac6-41a8-8d07-91c32ab8cbfe None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:22.834946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 411/820] 10.222.0.39 () {56 vars in 1112 bytes} [Thu May 26 12:19:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:22.835646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a62752-5ac6-41a8-8d07-91c32ab8cbfe None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:22.871955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a660f32-58e8-4043-ac21-2d5ce85be5a3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:22.913807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a68af-5804-443a-8a6f-82e8d39cf425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:22.917386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a68af-5804-443a-8a6f-82e8d39cf425 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:22.917685 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a68af-5804-443a-8a6f-82e8d39cf425 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:22.917974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a68af-5804-443a-8a6f-82e8d39cf425 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:22.919136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a68af-5804-443a-8a6f-82e8d39cf425 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:22.920919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a68af-5804-443a-8a6f-82e8d39cf425 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:22.944747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 410/821] 10.222.0.39 () {60 vars in 1144 bytes} [Thu May 26 12:19:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:22.945923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a68af-5804-443a-8a6f-82e8d39cf425 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:22.955295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a62752-5ac6-41a8-8d07-91c32ab8cbfe None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:22.971655 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:23.002687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6238d-68fc-4a04-a039-1d8458ab9115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:23.003701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6238d-68fc-4a04-a039-1d8458ab9115 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:23.004254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6238d-68fc-4a04-a039-1d8458ab9115 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:23.004737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6238d-68fc-4a04-a039-1d8458ab9115 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:23.006467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6238d-68fc-4a04-a039-1d8458ab9115 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:23.006994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6238d-68fc-4a04-a039-1d8458ab9115 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:23.008886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6238d-68fc-4a04-a039-1d8458ab9115 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:23.023294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:23.032214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 412/822] 10.222.0.39 () {56 vars in 1149 bytes} [Thu May 26 12:19:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:23.033435 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6238d-68fc-4a04-a039-1d8458ab9115 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:23.086405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a68af-5804-443a-8a6f-82e8d39cf425 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:23.133432 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec92189-72bc-44ce-8f49-afa38fc93cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:23.135498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92189-72bc-44ce-8f49-afa38fc93cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:23.135969 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92189-72bc-44ce-8f49-afa38fc93cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:23.137228 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92189-72bc-44ce-8f49-afa38fc93cc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:23.149889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec92189-72bc-44ce-8f49-afa38fc93cc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:23.152199 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec92189-72bc-44ce-8f49-afa38fc93cc9 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:23.159167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6238d-68fc-4a04-a039-1d8458ab9115 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-3ec92189-72bc-44ce-8f49-afa38fc93cc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:23.170106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:23.171043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:23.171934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:23.171934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:23.171934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:23.171934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:23.171934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:23.171934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:23.171934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:23.171934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:23.178324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 411/823] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:23.178324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec92189-72bc-44ce-8f49-afa38fc93cc9 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:23.202786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1f56-9fbd-4f80-9a59-3ba3be81c404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:23.203845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1f56-9fbd-4f80-9a59-3ba3be81c404 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:23.204286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1f56-9fbd-4f80-9a59-3ba3be81c404 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:23.204739 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1f56-9fbd-4f80-9a59-3ba3be81c404 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:23.205718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe1f56-9fbd-4f80-9a59-3ba3be81c404 None admin] RBAC: Adding query filter params (type=network) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:23.206302 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe1f56-9fbd-4f80-9a59-3ba3be81c404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:23.207691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe1f56-9fbd-4f80-9a59-3ba3be81c404 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:23.214487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 413/824] 10.222.0.39 () {56 vars in 1112 bytes} [Thu May 26 12:19:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:23.215288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1f56-9fbd-4f80-9a59-3ba3be81c404 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:23.262108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:23.294726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec92189-72bc-44ce-8f49-afa38fc93cc9 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:23.310735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:23.336048 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d366f99-a175-41b0-b0df-578eacdb9051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:23.337410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d366f99-a175-41b0-b0df-578eacdb9051 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:23.337898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d366f99-a175-41b0-b0df-578eacdb9051 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:23.338373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d366f99-a175-41b0-b0df-578eacdb9051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:23.350192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d366f99-a175-41b0-b0df-578eacdb9051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:23.352135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d366f99-a175-41b0-b0df-578eacdb9051 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:23.354518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1f56-9fbd-4f80-9a59-3ba3be81c404 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-7d366f99-a175-41b0-b0df-578eacdb9051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:23.372264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:23.373265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:23.374180 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:23.374180 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:23.374180 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:23.374180 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:23.376686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 412/825] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:23.377812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d366f99-a175-41b0-b0df-578eacdb9051 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:23.395525 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b536b0-93ef-46eb-8723-200203e5836a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:23.396788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b536b0-93ef-46eb-8723-200203e5836a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:23.397081 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b536b0-93ef-46eb-8723-200203e5836a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:23.397369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b536b0-93ef-46eb-8723-200203e5836a None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:23.398528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b536b0-93ef-46eb-8723-200203e5836a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:23.398847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b536b0-93ef-46eb-8723-200203e5836a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:23.400323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b536b0-93ef-46eb-8723-200203e5836a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:23.419661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 414/826] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:23.420760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b536b0-93ef-46eb-8723-200203e5836a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:23.499893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d366f99-a175-41b0-b0df-578eacdb9051 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:23.539659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c34b6a-9db2-440c-9523-3c31cb7e806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:23.540656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c34b6a-9db2-440c-9523-3c31cb7e806a None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:23.541200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c34b6a-9db2-440c-9523-3c31cb7e806a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:23.541693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c34b6a-9db2-440c-9523-3c31cb7e806a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:23.542709 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c34b6a-9db2-440c-9523-3c31cb7e806a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:23.544311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c34b6a-9db2-440c-9523-3c31cb7e806a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:23.550991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:23.565248 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b536b0-93ef-46eb-8723-200203e5836a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:23.576753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 413/827] 10.222.0.39 () {60 vars in 1144 bytes} [Thu May 26 12:19:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:23.576753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c34b6a-9db2-440c-9523-3c31cb7e806a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:23.629053 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:23.665465 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f83a83-9cf3-4187-b82b-d6b673d47af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:23.666164 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f83a83-9cf3-4187-b82b-d6b673d47af4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:23.666452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f83a83-9cf3-4187-b82b-d6b673d47af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:23.667021 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f83a83-9cf3-4187-b82b-d6b673d47af4 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:23.667474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f83a83-9cf3-4187-b82b-d6b673d47af4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:23.667785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f83a83-9cf3-4187-b82b-d6b673d47af4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:23.669296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f83a83-9cf3-4187-b82b-d6b673d47af4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:23.707199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 415/828] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:23.712785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f83a83-9cf3-4187-b82b-d6b673d47af4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:23.748745 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c34b6a-9db2-440c-9523-3c31cb7e806a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:23.796207 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62ba1c-569e-4ce4-a869-c1fcb7abc0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:23.797433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62ba1c-569e-4ce4-a869-c1fcb7abc0ab None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:23.798357 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62ba1c-569e-4ce4-a869-c1fcb7abc0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:23.799145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62ba1c-569e-4ce4-a869-c1fcb7abc0ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:23.800373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62ba1c-569e-4ce4-a869-c1fcb7abc0ab None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=04f5fbbe45ec4dcf8301da8483af2941) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:23.800957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62ba1c-569e-4ce4-a869-c1fcb7abc0ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:23.803022 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62ba1c-569e-4ce4-a869-c1fcb7abc0ab None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:23.812749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 414/829] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:23 2022] GET /identity/v3/role_assignments?user.id=04f5fbbe45ec4dcf8301da8483af2941&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:23.814977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5105-5574-4210-911e-195768351367 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:23.815510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5105-5574-4210-911e-195768351367 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:23.816400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc5105-5574-4210-911e-195768351367 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:23.819284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 415/830] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:23.826244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9bb53-52c2-4aba-b5a9-db7be842cea7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:23.826244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9bb53-52c2-4aba-b5a9-db7be842cea7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:23.826535 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9bb53-52c2-4aba-b5a9-db7be842cea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:23.846236 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-67e9bb53-52c2-4aba-b5a9-db7be842cea7 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:23.847691 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-67e9bb53-52c2-4aba-b5a9-db7be842cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:23.875573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f83a83-9cf3-4187-b82b-d6b673d47af4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:23.941676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c4b2c-3cd6-48dd-808b-bd718b6e927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:23.943435 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c4b2c-3cd6-48dd-808b-bd718b6e927d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:23.943736 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c4b2c-3cd6-48dd-808b-bd718b6e927d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:23.944016 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c4b2c-3cd6-48dd-808b-bd718b6e927d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:23.956776 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c4b2c-3cd6-48dd-808b-bd718b6e927d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:23.958269 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c4b2c-3cd6-48dd-808b-bd718b6e927d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:23.961026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 416/831] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6e4c4b2c-3cd6-48dd-808b-bd718b6e927d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:23.978685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:23.979953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:23.981061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:23.981061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:23.981061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:23.981061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:23.981061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:23.981061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:23.981061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:23.981061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:23.981061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 416/832] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:23.985965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9bb53-52c2-4aba-b5a9-db7be842cea7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:23.990604 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c4b2c-3cd6-48dd-808b-bd718b6e927d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:24.011640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:24.012563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:24.126468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9bb53-52c2-4aba-b5a9-db7be842cea7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:24.134939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c4b2c-3cd6-48dd-808b-bd718b6e927d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:24.165816 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d403f-32ba-4c29-908b-b9d4196cab12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:24.166498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d403f-32ba-4c29-908b-b9d4196cab12 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:24.166778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d403f-32ba-4c29-908b-b9d4196cab12 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:24.167058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d403f-32ba-4c29-908b-b9d4196cab12 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:24.168003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d403f-32ba-4c29-908b-b9d4196cab12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:24.168170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d403f-32ba-4c29-908b-b9d4196cab12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:24.169638 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d403f-32ba-4c29-908b-b9d4196cab12 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:24.181554 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588be695-af4a-4407-a9b0-6f6471c5f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:24.182933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588be695-af4a-4407-a9b0-6f6471c5f879 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:24.183093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 417/833] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:24.183545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588be695-af4a-4407-a9b0-6f6471c5f879 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:24.184037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588be695-af4a-4407-a9b0-6f6471c5f879 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:24.189625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d403f-32ba-4c29-908b-b9d4196cab12 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:24.199141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588be695-af4a-4407-a9b0-6f6471c5f879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-588be695-af4a-4407-a9b0-6f6471c5f879 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:24.206975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:24.207994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:24.209481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:24.209481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:24.209481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:24.209481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:24.209481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:24.209481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:24.209481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:24.209481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:24.209481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:24.209481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:24.209481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:24.209481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:24.213024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 417/834] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:19:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:24.218039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588be695-af4a-4407-a9b0-6f6471c5f879 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:24.296619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:24.304856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:24.338132 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d403f-32ba-4c29-908b-b9d4196cab12 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:24.343562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588be695-af4a-4407-a9b0-6f6471c5f879 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:24.383955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe7b42-e676-4530-8cd9-bd2810a12f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:24.385345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe7b42-e676-4530-8cd9-bd2810a12f65 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:24.385889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe7b42-e676-4530-8cd9-bd2810a12f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:24.386428 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe7b42-e676-4530-8cd9-bd2810a12f65 None admin] PATH_INFO: `/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/bc48f3a3998b4c5ab199181005f9a5d7/roles/11b992de70b244678ed4f0e082d92e7f` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:24.387908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3d433-bb6e-4a96-88d7-48b4748c0faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:24.388658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3d433-bb6e-4a96-88d7-48b4748c0faa None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:24.389065 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3d433-bb6e-4a96-88d7-48b4748c0faa None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:24.389421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3d433-bb6e-4a96-88d7-48b4748c0faa None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:24.390538 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3d433-bb6e-4a96-88d7-48b4748c0faa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:24.390923 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3d433-bb6e-4a96-88d7-48b4748c0faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:24.393354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3d433-bb6e-4a96-88d7-48b4748c0faa None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:24.408236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 418/835] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:19:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:24.409669 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3d433-bb6e-4a96-88d7-48b4748c0faa None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:24.411795 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe7b42-e676-4530-8cd9-bd2810a12f65 None admin] RBAC: Authorizing `identity:create_grant(project_id=b341d104240e4b4cb61d365e8167f6a8, user_id=bc48f3a3998b4c5ab199181005f9a5d7, role_id=11b992de70b244678ed4f0e082d92e7f)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:24.413368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe7b42-e676-4530-8cd9-bd2810a12f65 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:24.430361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 418/836] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:19:24 2022] PUT /identity/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/bc48f3a3998b4c5ab199181005f9a5d7/roles/11b992de70b244678ed4f0e082d92e7f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:19:24.525100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3d433-bb6e-4a96-88d7-48b4748c0faa None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:24.558475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:24.564912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e010b-bcc3-4ff0-8585-02cb14f6e08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:24.566097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e010b-bcc3-4ff0-8585-02cb14f6e08f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:24.566575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e010b-bcc3-4ff0-8585-02cb14f6e08f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:24.567041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e010b-bcc3-4ff0-8585-02cb14f6e08f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:24.581153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e010b-bcc3-4ff0-8585-02cb14f6e08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:24.583457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e010b-bcc3-4ff0-8585-02cb14f6e08f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ce5e010b-bcc3-4ff0-8585-02cb14f6e08f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:24.604301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:24.605511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:24.606612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:24.606612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:24.606612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:24.606612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:24.608764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 419/837] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:24.616266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe7b42-e676-4530-8cd9-bd2810a12f65 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:24.734438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe7b42-e676-4530-8cd9-bd2810a12f65 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:24.765284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:24.778205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765dbfc-b374-4269-8dd1-cecdd15f6240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:24.779258 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765dbfc-b374-4269-8dd1-cecdd15f6240 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:24.779749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765dbfc-b374-4269-8dd1-cecdd15f6240 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:24.780245 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765dbfc-b374-4269-8dd1-cecdd15f6240 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:24.781248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765dbfc-b374-4269-8dd1-cecdd15f6240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:24.781779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765dbfc-b374-4269-8dd1-cecdd15f6240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:24.783370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765dbfc-b374-4269-8dd1-cecdd15f6240 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:24.800931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 419/838] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:24.802863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e010b-bcc3-4ff0-8585-02cb14f6e08f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:24.910446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e010b-bcc3-4ff0-8585-02cb14f6e08f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:24.946562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c922b63-bf26-4d2a-8fe5-b468f71b0195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:24.947373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c922b63-bf26-4d2a-8fe5-b468f71b0195 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:24.947659 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c922b63-bf26-4d2a-8fe5-b468f71b0195 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:24.947936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c922b63-bf26-4d2a-8fe5-b468f71b0195 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:24.956476 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c922b63-bf26-4d2a-8fe5-b468f71b0195 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:24.957964 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c922b63-bf26-4d2a-8fe5-b468f71b0195 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-2c922b63-bf26-4d2a-8fe5-b468f71b0195 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:24.972948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:24.973919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:24.975219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:24.975219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:24.975219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:24.975219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:24.975219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:24.975219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:24.975219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:24.975219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:24.975219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:19:24.975219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:24.975219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 420/839] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:19:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:24.980482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765dbfc-b374-4269-8dd1-cecdd15f6240 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:25.085541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765dbfc-b374-4269-8dd1-cecdd15f6240 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:25.127543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b7508-80f3-427d-9055-41e0149949d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:25.128676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b7508-80f3-427d-9055-41e0149949d4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:25.129192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b7508-80f3-427d-9055-41e0149949d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:25.129485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b7508-80f3-427d-9055-41e0149949d4 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:25.130397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b7508-80f3-427d-9055-41e0149949d4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:25.130722 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b7508-80f3-427d-9055-41e0149949d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:25.132184 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b7508-80f3-427d-9055-41e0149949d4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:25.153285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 420/840] 10.222.0.39 () {56 vars in 1135 bytes} [Thu May 26 12:19:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:25.159808 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c922b63-bf26-4d2a-8fe5-b468f71b0195 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:25.208593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:25.274521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c922b63-bf26-4d2a-8fe5-b468f71b0195 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:25.309523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0970a-2f66-4882-8b4a-49061f1d71b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:25.310183 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0970a-2f66-4882-8b4a-49061f1d71b0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:25.310474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0970a-2f66-4882-8b4a-49061f1d71b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:25.310750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0970a-2f66-4882-8b4a-49061f1d71b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:25.379874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0970a-2f66-4882-8b4a-49061f1d71b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:25.381844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0970a-2f66-4882-8b4a-49061f1d71b0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:25.423899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395310b6-dadb-47ba-9cac-ff06f0e9f887 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:25.424534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395310b6-dadb-47ba-9cac-ff06f0e9f887 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:25.425066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395310b6-dadb-47ba-9cac-ff06f0e9f887 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:25.426894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 421/841] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:25.432825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649fc5c-f2d3-41c9-8ac9-049e1950e548 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:25.433372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649fc5c-f2d3-41c9-8ac9-049e1950e548 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:25.433853 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649fc5c-f2d3-41c9-8ac9-049e1950e548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:25.439434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:25.453584 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e649fc5c-f2d3-41c9-8ac9-049e1950e548 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:25.455183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e649fc5c-f2d3-41c9-8ac9-049e1950e548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:25.493119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:25.496335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 421/842] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:25 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:19:25.502733 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0970a-2f66-4882-8b4a-49061f1d71b0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:25.540825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 422/843] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:25.558955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649fc5c-f2d3-41c9-8ac9-049e1950e548 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:25.631468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0970a-2f66-4882-8b4a-49061f1d71b0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:25.676043 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af894cf0-0b30-41d9-a722-d5d1afa2b01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:25.677324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af894cf0-0b30-41d9-a722-d5d1afa2b01f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:25.677990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af894cf0-0b30-41d9-a722-d5d1afa2b01f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:25.678754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af894cf0-0b30-41d9-a722-d5d1afa2b01f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:25.684781 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649fc5c-f2d3-41c9-8ac9-049e1950e548 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:25.692058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af894cf0-0b30-41d9-a722-d5d1afa2b01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:25.693862 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af894cf0-0b30-41d9-a722-d5d1afa2b01f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:25.696634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-af894cf0-0b30-41d9-a722-d5d1afa2b01f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:25.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:25.719419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:25.720489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:25.720489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:25.720489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:25.720489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:25.727239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 422/844] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:25.728253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af894cf0-0b30-41d9-a722-d5d1afa2b01f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:25.736899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d40e9-0d31-443d-87c5-ee6f9c9edf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:25.737713 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d40e9-0d31-443d-87c5-ee6f9c9edf20 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:25.737995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d40e9-0d31-443d-87c5-ee6f9c9edf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:25.738271 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d40e9-0d31-443d-87c5-ee6f9c9edf20 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:25.738932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d40e9-0d31-443d-87c5-ee6f9c9edf20 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:25.740498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d40e9-0d31-443d-87c5-ee6f9c9edf20 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-588d40e9-0d31-443d-87c5-ee6f9c9edf20 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:25.758135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:25.759229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:19:25.760075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:25.764429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 423/845] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:19:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:25.766163 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d40e9-0d31-443d-87c5-ee6f9c9edf20 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:25.813723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:25.866402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af894cf0-0b30-41d9-a722-d5d1afa2b01f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:25.905741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d40e9-0d31-443d-87c5-ee6f9c9edf20 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:25.908472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44cc5a-9e6d-4062-a124-9119fc52a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:25.909887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44cc5a-9e6d-4062-a124-9119fc52a089 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:25.909887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44cc5a-9e6d-4062-a124-9119fc52a089 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:25.909887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44cc5a-9e6d-4062-a124-9119fc52a089 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:25.910423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44cc5a-9e6d-4062-a124-9119fc52a089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:25.910731 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44cc5a-9e6d-4062-a124-9119fc52a089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:25.912384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44cc5a-9e6d-4062-a124-9119fc52a089 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:25.928900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 423/846] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:25.930195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44cc5a-9e6d-4062-a124-9119fc52a089 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:25.951584 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41a537-7e67-43f7-93ef-ce1ab6c5d591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:25.952621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41a537-7e67-43f7-93ef-ce1ab6c5d591 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:25.953225 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41a537-7e67-43f7-93ef-ce1ab6c5d591 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:25.953721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41a537-7e67-43f7-93ef-ce1ab6c5d591 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:25.954629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41a537-7e67-43f7-93ef-ce1ab6c5d591 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:25.955132 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41a537-7e67-43f7-93ef-ce1ab6c5d591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:25.956937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41a537-7e67-43f7-93ef-ce1ab6c5d591 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:25.962855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 424/847] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:19:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:25.968689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41a537-7e67-43f7-93ef-ce1ab6c5d591 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:26.001071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:26.066734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44cc5a-9e6d-4062-a124-9119fc52a089 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:26.098813 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:26.103358 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41a537-7e67-43f7-93ef-ce1ab6c5d591 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:26.105626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6a391-97bf-47dc-a8b7-627fa03e749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:26.106698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6a391-97bf-47dc-a8b7-627fa03e749c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:26.107198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6a391-97bf-47dc-a8b7-627fa03e749c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:26.107679 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6a391-97bf-47dc-a8b7-627fa03e749c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:26.115192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6a391-97bf-47dc-a8b7-627fa03e749c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:26.116966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6a391-97bf-47dc-a8b7-627fa03e749c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-35d6a391-97bf-47dc-a8b7-627fa03e749c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:26.132627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:26.133755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:26.134713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:26.134713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:26.134713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:26.134713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:26.134713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:26.134713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:26.134713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:26.134713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:26.137267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 424/848] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:26.142847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6a391-97bf-47dc-a8b7-627fa03e749c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:26.147995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16459b-82c1-49bd-a946-bf9cc041cbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:26.149332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16459b-82c1-49bd-a946-bf9cc041cbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:26.149850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16459b-82c1-49bd-a946-bf9cc041cbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:26.150368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16459b-82c1-49bd-a946-bf9cc041cbd2 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:26.151313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16459b-82c1-49bd-a946-bf9cc041cbd2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:26.151830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16459b-82c1-49bd-a946-bf9cc041cbd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:26.153920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16459b-82c1-49bd-a946-bf9cc041cbd2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:26.168764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 425/849] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:19:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:26.245977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ec2b9-d50c-4c43-be81-bd5f86ea9fce None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:26.246326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ec2b9-d50c-4c43-be81-bd5f86ea9fce None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:26.246609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ec2b9-d50c-4c43-be81-bd5f86ea9fce None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:26.248197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 426/850] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:26.253666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a94a81-9c4c-4939-943a-12aaf3b10f58 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:26.253960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a94a81-9c4c-4939-943a-12aaf3b10f58 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:26.254244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a94a81-9c4c-4939-943a-12aaf3b10f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:26.271693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6a391-97bf-47dc-a8b7-627fa03e749c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:26.272312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-31a94a81-9c4c-4939-943a-12aaf3b10f58 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:26.273602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-31a94a81-9c4c-4939-943a-12aaf3b10f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:26.293873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:26.322738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd21029-ad19-47f2-9a3f-951cd08abc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:26.323426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd21029-ad19-47f2-9a3f-951cd08abc7e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:26.323713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd21029-ad19-47f2-9a3f-951cd08abc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:26.323996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd21029-ad19-47f2-9a3f-951cd08abc7e None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:26.324837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd21029-ad19-47f2-9a3f-951cd08abc7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:26.325154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd21029-ad19-47f2-9a3f-951cd08abc7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:26.326636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd21029-ad19-47f2-9a3f-951cd08abc7e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:26.345309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 425/851] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:26.346299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd21029-ad19-47f2-9a3f-951cd08abc7e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:26.365821 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 427/852] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:26.388338 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a94a81-9c4c-4939-943a-12aaf3b10f58 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:26.473296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd21029-ad19-47f2-9a3f-951cd08abc7e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:26.502783 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:26.513822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a94a81-9c4c-4939-943a-12aaf3b10f58 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:26.523391 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5607b6-27ae-4f76-a8fe-6bf1fe6f6ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:26.524402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5607b6-27ae-4f76-a8fe-6bf1fe6f6ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:26.525004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5607b6-27ae-4f76-a8fe-6bf1fe6f6ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:26.525493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5607b6-27ae-4f76-a8fe-6bf1fe6f6ad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:26.526562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5607b6-27ae-4f76-a8fe-6bf1fe6f6ad1 None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=691c9da310ef42a189bb78183867e46a) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:26.527231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5607b6-27ae-4f76-a8fe-6bf1fe6f6ad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:26.529127 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5607b6-27ae-4f76-a8fe-6bf1fe6f6ad1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:26.542579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 426/853] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:26 2022] GET /identity/v3/role_assignments?user.id=691c9da310ef42a189bb78183867e46a&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:26.556288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554a5e5-b9f0-47df-8f7b-18f4c2c75ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:26.557344 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554a5e5-b9f0-47df-8f7b-18f4c2c75ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:26.557637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554a5e5-b9f0-47df-8f7b-18f4c2c75ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:26.560316 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554a5e5-b9f0-47df-8f7b-18f4c2c75ea4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:26.560316 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554a5e5-b9f0-47df-8f7b-18f4c2c75ea4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:26.560316 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554a5e5-b9f0-47df-8f7b-18f4c2c75ea4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-e554a5e5-b9f0-47df-8f7b-18f4c2c75ea4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:26.575244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:26.576283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:26.577152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 428/854] 10.222.0.39 () {56 vars in 1132 bytes} [Thu May 26 12:19:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:26.582953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5607b6-27ae-4f76-a8fe-6bf1fe6f6ad1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:26.630330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:26.698525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f9ee-db6c-4f20-af60-6d97d36d98cd None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:26.698729 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f9ee-db6c-4f20-af60-6d97d36d98cd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:26.698990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f9ee-db6c-4f20-af60-6d97d36d98cd None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:26.700553 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 429/855] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:26.706349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22875e5e-444b-40d2-977d-d4eac554fbdf None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:26.706979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22875e5e-444b-40d2-977d-d4eac554fbdf None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:26.707489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22875e5e-444b-40d2-977d-d4eac554fbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:26.710451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5607b6-27ae-4f76-a8fe-6bf1fe6f6ad1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:26.726626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-22875e5e-444b-40d2-977d-d4eac554fbdf None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:26.728228 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-22875e5e-444b-40d2-977d-d4eac554fbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:26.758214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7804f-8433-4390-bf08-42b70505ba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:26.758214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7804f-8433-4390-bf08-42b70505ba4c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:26.758214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7804f-8433-4390-bf08-42b70505ba4c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:26.758590 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7804f-8433-4390-bf08-42b70505ba4c None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:26.759204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7804f-8433-4390-bf08-42b70505ba4c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:26.759516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7804f-8433-4390-bf08-42b70505ba4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:26.760936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7804f-8433-4390-bf08-42b70505ba4c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:26.766513 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 427/856] 10.222.0.39 () {56 vars in 1126 bytes} [Thu May 26 12:19:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:26.773047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7804f-8433-4390-bf08-42b70505ba4c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:26.823721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 430/857] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:26.847366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22875e5e-444b-40d2-977d-d4eac554fbdf None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:26.929790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7804f-8433-4390-bf08-42b70505ba4c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:26.932478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:26.959189 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:26.974073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22875e5e-444b-40d2-977d-d4eac554fbdf None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:26.980232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5199c5-7c40-41e3-a3b4-f20629dae9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:26.981023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5199c5-7c40-41e3-a3b4-f20629dae9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:26.981381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5199c5-7c40-41e3-a3b4-f20629dae9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:26.981728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5199c5-7c40-41e3-a3b4-f20629dae9b7 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:26.982519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5199c5-7c40-41e3-a3b4-f20629dae9b7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:26.982901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5199c5-7c40-41e3-a3b4-f20629dae9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:26.985011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5199c5-7c40-41e3-a3b4-f20629dae9b7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:26.992417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 428/858] 10.222.0.39 () {56 vars in 1126 bytes} [Thu May 26 12:19:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:27.025170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3224e6-3173-4af1-b6d3-682cdbaab5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:27.026009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3224e6-3173-4af1-b6d3-682cdbaab5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:27.026297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3224e6-3173-4af1-b6d3-682cdbaab5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:27.026577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3224e6-3173-4af1-b6d3-682cdbaab5a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:27.039895 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3224e6-3173-4af1-b6d3-682cdbaab5a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ab3224e6-3173-4af1-b6d3-682cdbaab5a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:27.048104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:27.049153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:27.049976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:27.049976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:27.049976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:27.049976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:27.049976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:27.049976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:27.049976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:27.049976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:27.049976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:27.049976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:27.049976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:19:27.049976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:27.049976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 431/859] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:19:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:27.056193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5199c5-7c40-41e3-a3b4-f20629dae9b7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:27.174341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5199c5-7c40-41e3-a3b4-f20629dae9b7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:27.211420 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe705a4-b766-46ca-ba36-777ce8e50a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:27.212025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe705a4-b766-46ca-ba36-777ce8e50a0c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:27.212305 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe705a4-b766-46ca-ba36-777ce8e50a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:27.212577 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe705a4-b766-46ca-ba36-777ce8e50a0c None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:27.213357 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe705a4-b766-46ca-ba36-777ce8e50a0c None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:27.213665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe705a4-b766-46ca-ba36-777ce8e50a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:27.215038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe705a4-b766-46ca-ba36-777ce8e50a0c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:27.223831 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 429/860] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:19:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:27.230121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3224e6-3173-4af1-b6d3-682cdbaab5a1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:27.338684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3224e6-3173-4af1-b6d3-682cdbaab5a1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:27.377187 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3205440-b210-447a-b776-0713681c57ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:27.377996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3205440-b210-447a-b776-0713681c57ed None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:27.378284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3205440-b210-447a-b776-0713681c57ed None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:27.378562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3205440-b210-447a-b776-0713681c57ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:27.390159 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3205440-b210-447a-b776-0713681c57ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:27.391623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3205440-b210-447a-b776-0713681c57ed None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:27.401268 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-a3205440-b210-447a-b776-0713681c57ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:27.411003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:27.412003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:27.413198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:27.413198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:27.413198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:27.413198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:27.416953 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 432/861] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:27.418504 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe705a4-b766-46ca-ba36-777ce8e50a0c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:27.449092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:27.530926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe705a4-b766-46ca-ba36-777ce8e50a0c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:27.566671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a2212-a172-4936-a2b0-0bb55b1fd8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:27.567663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a2212-a172-4936-a2b0-0bb55b1fd8ad None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:27.568708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a2212-a172-4936-a2b0-0bb55b1fd8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:27.569593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a2212-a172-4936-a2b0-0bb55b1fd8ad None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:27.570582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a2212-a172-4936-a2b0-0bb55b1fd8ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:27.571116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a2212-a172-4936-a2b0-0bb55b1fd8ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:27.572758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a2212-a172-4936-a2b0-0bb55b1fd8ad None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:27.586051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 430/862] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:27.596783 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3205440-b210-447a-b776-0713681c57ed None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:27.694041 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3205440-b210-447a-b776-0713681c57ed None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:27.729250 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ce3c5-3eed-4b70-a7ad-30afd399c306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:27.730073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ce3c5-3eed-4b70-a7ad-30afd399c306 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:27.730359 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ce3c5-3eed-4b70-a7ad-30afd399c306 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:27.730635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ce3c5-3eed-4b70-a7ad-30afd399c306 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:27.738473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ce3c5-3eed-4b70-a7ad-30afd399c306 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:27.740492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ce3c5-3eed-4b70-a7ad-30afd399c306 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-5e9ce3c5-3eed-4b70-a7ad-30afd399c306 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:27.758964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:27.759961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:27.760924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:27.760924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:27.760924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:27.760924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:27.760924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:27.760924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:27.760924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:27.760924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:27.760924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:19:27.760924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:27.760924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 433/863] 10.222.0.39 () {56 vars in 1117 bytes} [Thu May 26 12:19:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:27.766524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a2212-a172-4936-a2b0-0bb55b1fd8ad None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:27.866417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:27.880912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a2212-a172-4936-a2b0-0bb55b1fd8ad None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:27.919142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccb640-dd48-4a02-9c26-6dda331bc265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:27.919822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccb640-dd48-4a02-9c26-6dda331bc265 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:27.920218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccb640-dd48-4a02-9c26-6dda331bc265 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:27.920502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccb640-dd48-4a02-9c26-6dda331bc265 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:27.921377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccb640-dd48-4a02-9c26-6dda331bc265 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:27.921694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccb640-dd48-4a02-9c26-6dda331bc265 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:27.923149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccb640-dd48-4a02-9c26-6dda331bc265 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:27.941809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 431/864] 10.222.0.39 () {56 vars in 1149 bytes} [Thu May 26 12:19:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:27.947340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ce3c5-3eed-4b70-a7ad-30afd399c306 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:28.010788 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:28.054661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ce3c5-3eed-4b70-a7ad-30afd399c306 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:28.089540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3534393-3423-43b6-8539-482de9b4ce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:28.090540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3534393-3423-43b6-8539-482de9b4ce12 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:28.091047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3534393-3423-43b6-8539-482de9b4ce12 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:28.091544 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3534393-3423-43b6-8539-482de9b4ce12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:28.162790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3534393-3423-43b6-8539-482de9b4ce12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:28.164569 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3534393-3423-43b6-8539-482de9b4ce12 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:28.227797 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:28.276886 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 434/865] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:27 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:19:28.278796 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccb640-dd48-4a02-9c26-6dda331bc265 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:28.384598 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccb640-dd48-4a02-9c26-6dda331bc265 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:28.423696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da984050-6880-4c20-b416-63abd166e71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:28.424419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da984050-6880-4c20-b416-63abd166e71b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:28.424704 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da984050-6880-4c20-b416-63abd166e71b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:28.425004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da984050-6880-4c20-b416-63abd166e71b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:28.436940 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da984050-6880-4c20-b416-63abd166e71b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:28.438391 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da984050-6880-4c20-b416-63abd166e71b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:28.446154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-da984050-6880-4c20-b416-63abd166e71b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:28.458239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:28.459306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:28.460342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:28.460342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:28.460342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:28.460342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:28.460342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 432/866] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:28.467082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03fb6f-b5bb-48e6-a64b-c4b101ccf377 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:28.467383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03fb6f-b5bb-48e6-a64b-c4b101ccf377 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:28.467672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03fb6f-b5bb-48e6-a64b-c4b101ccf377 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:28.469216 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 435/867] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:28.469658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da984050-6880-4c20-b416-63abd166e71b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:28.474102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4efdb-b51b-4d69-b365-425b8a93360e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:28.474914 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4efdb-b51b-4d69-b365-425b8a93360e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:28.475199 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4efdb-b51b-4d69-b365-425b8a93360e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:28.492133 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9ca4efdb-b51b-4d69-b365-425b8a93360e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:28.493351 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9ca4efdb-b51b-4d69-b365-425b8a93360e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:28.572875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 436/868] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:28.589880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4efdb-b51b-4d69-b365-425b8a93360e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:28.602686 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da984050-6880-4c20-b416-63abd166e71b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:28.652275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72e12f-73db-449c-b6bb-68870d70af55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:28.653581 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72e12f-73db-449c-b6bb-68870d70af55 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:28.654456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72e12f-73db-449c-b6bb-68870d70af55 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:28.655184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72e12f-73db-449c-b6bb-68870d70af55 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:28.656357 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72e12f-73db-449c-b6bb-68870d70af55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:28.656884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72e12f-73db-449c-b6bb-68870d70af55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:28.659062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72e12f-73db-449c-b6bb-68870d70af55 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:28.680235 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 433/869] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:28.681232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72e12f-73db-449c-b6bb-68870d70af55 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:28.694266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:28.706015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4efdb-b51b-4d69-b365-425b8a93360e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:28.747500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8400a4-3e74-4255-93f0-73e5e9a0e2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:28.748191 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8400a4-3e74-4255-93f0-73e5e9a0e2fd None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:28.748533 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8400a4-3e74-4255-93f0-73e5e9a0e2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:28.748869 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8400a4-3e74-4255-93f0-73e5e9a0e2fd None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:28.749650 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8400a4-3e74-4255-93f0-73e5e9a0e2fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:28.751630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8400a4-3e74-4255-93f0-73e5e9a0e2fd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:28.769151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 437/870] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:19:28 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:28.783473 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:28.834656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72e12f-73db-449c-b6bb-68870d70af55 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:28.882117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98917f2-a8d0-4fa0-b78c-155fbd7c3a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:28.883034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98917f2-a8d0-4fa0-b78c-155fbd7c3a99 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:28.883322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98917f2-a8d0-4fa0-b78c-155fbd7c3a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:28.883599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98917f2-a8d0-4fa0-b78c-155fbd7c3a99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:28.891504 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98917f2-a8d0-4fa0-b78c-155fbd7c3a99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:28.893042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98917f2-a8d0-4fa0-b78c-155fbd7c3a99 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b98917f2-a8d0-4fa0-b78c-155fbd7c3a99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:28.913762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:28.914723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:28.915628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:28.915628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:28.915628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:28.915628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:28.915628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:28.915628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:28.915628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:28.915628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:28.918444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 434/871] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:28.923964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8400a4-3e74-4255-93f0-73e5e9a0e2fd None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:28.948186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ae19e-6216-4c45-b338-42b8321addd7 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:28.948388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ae19e-6216-4c45-b338-42b8321addd7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:28.948650 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ae19e-6216-4c45-b338-42b8321addd7 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:28.951241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 435/872] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:28.959061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58684c7a-5ef0-4e34-a03b-aaff8a755889 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:28.959573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58684c7a-5ef0-4e34-a03b-aaff8a755889 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:28.960190 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58684c7a-5ef0-4e34-a03b-aaff8a755889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:28.983149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-58684c7a-5ef0-4e34-a03b-aaff8a755889 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:28.984565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-58684c7a-5ef0-4e34-a03b-aaff8a755889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:29.052082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8400a4-3e74-4255-93f0-73e5e9a0e2fd None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:29.065484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 436/873] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:28 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:29.088154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58684c7a-5ef0-4e34-a03b-aaff8a755889 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:29.097577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c502ba-8fb1-4d99-8e2f-6cb8816aca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:29.098432 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c502ba-8fb1-4d99-8e2f-6cb8816aca09 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:29.098816 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c502ba-8fb1-4d99-8e2f-6cb8816aca09 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:29.099189 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c502ba-8fb1-4d99-8e2f-6cb8816aca09 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:29.100658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c502ba-8fb1-4d99-8e2f-6cb8816aca09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:29.101228 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c502ba-8fb1-4d99-8e2f-6cb8816aca09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:29.102750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c502ba-8fb1-4d99-8e2f-6cb8816aca09 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:29.115914 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 438/874] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:29.121340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c502ba-8fb1-4d99-8e2f-6cb8816aca09 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:29.136983 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:29.141193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:29.212463 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58684c7a-5ef0-4e34-a03b-aaff8a755889 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:29.244057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c502ba-8fb1-4d99-8e2f-6cb8816aca09 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:29.252093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d77112-a4fb-4146-a2c2-4ef02523d0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:29.253234 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d77112-a4fb-4146-a2c2-4ef02523d0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:29.253936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d77112-a4fb-4146-a2c2-4ef02523d0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:29.254425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d77112-a4fb-4146-a2c2-4ef02523d0b8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:29.255401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d77112-a4fb-4146-a2c2-4ef02523d0b8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:29.257038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d77112-a4fb-4146-a2c2-4ef02523d0b8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-66d77112-a4fb-4146-a2c2-4ef02523d0b8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:29.270630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:29.271750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:29.272605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:29.275629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 437/875] 10.222.0.39 () {56 vars in 1126 bytes} [Thu May 26 12:19:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:29.280227 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29930a-d756-4035-afbc-3621db2f61f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:29.281819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29930a-d756-4035-afbc-3621db2f61f5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:29.282023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d77112-a4fb-4146-a2c2-4ef02523d0b8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:29.282496 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29930a-d756-4035-afbc-3621db2f61f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:29.282974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29930a-d756-4035-afbc-3621db2f61f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:29.284026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29930a-d756-4035-afbc-3621db2f61f5 None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=bc48f3a3998b4c5ab199181005f9a5d7) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:29.284913 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29930a-d756-4035-afbc-3621db2f61f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:29.288166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29930a-d756-4035-afbc-3621db2f61f5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:29.300739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 439/876] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:29 2022] GET /identity/v3/role_assignments?user.id=bc48f3a3998b4c5ab199181005f9a5d7&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:29.383209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c51b0-8e44-4b1b-813a-c700fa5775dd None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:29.383505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c51b0-8e44-4b1b-813a-c700fa5775dd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:29.383784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c51b0-8e44-4b1b-813a-c700fa5775dd None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:29.385734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 440/877] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:29.391178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddb78c-cfbb-47b5-90b0-c6562fd4c0ef None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:29.391464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddb78c-cfbb-47b5-90b0-c6562fd4c0ef None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:29.391744 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddb78c-cfbb-47b5-90b0-c6562fd4c0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:29.405895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d77112-a4fb-4146-a2c2-4ef02523d0b8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:29.410425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-47ddb78c-cfbb-47b5-90b0-c6562fd4c0ef None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:29.411631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-47ddb78c-cfbb-47b5-90b0-c6562fd4c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:29.433950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:29.461953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08690c-56a3-45fc-bf91-f70d9de6ddf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:29.463134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08690c-56a3-45fc-bf91-f70d9de6ddf6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:29.464343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08690c-56a3-45fc-bf91-f70d9de6ddf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:29.464874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08690c-56a3-45fc-bf91-f70d9de6ddf6 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:29.466362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08690c-56a3-45fc-bf91-f70d9de6ddf6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:29.466931 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08690c-56a3-45fc-bf91-f70d9de6ddf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:29.469352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08690c-56a3-45fc-bf91-f70d9de6ddf6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:29.482208 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 438/878] 10.222.0.39 () {56 vars in 1122 bytes} [Thu May 26 12:19:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:29.484049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08690c-56a3-45fc-bf91-f70d9de6ddf6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:29.506749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 441/879] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:29 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:29.529751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddb78c-cfbb-47b5-90b0-c6562fd4c0ef None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:29.532904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:29.614008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08690c-56a3-45fc-bf91-f70d9de6ddf6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:29.652408 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddb78c-cfbb-47b5-90b0-c6562fd4c0ef None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:29.655904 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa938e-0ed4-46ea-9612-14f9d7801cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:29.656582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa938e-0ed4-46ea-9612-14f9d7801cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:29.656902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa938e-0ed4-46ea-9612-14f9d7801cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:29.657207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa938e-0ed4-46ea-9612-14f9d7801cc8 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:29.657926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa938e-0ed4-46ea-9612-14f9d7801cc8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:29.658242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa938e-0ed4-46ea-9612-14f9d7801cc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:29.659628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa938e-0ed4-46ea-9612-14f9d7801cc8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:29.666554 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 439/880] 10.222.0.39 () {56 vars in 1122 bytes} [Thu May 26 12:19:29 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:29.704044 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6f49f-e42d-4b5b-a6dd-eae255815659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:29.704757 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6f49f-e42d-4b5b-a6dd-eae255815659 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:29.705040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6f49f-e42d-4b5b-a6dd-eae255815659 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:29.705315 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6f49f-e42d-4b5b-a6dd-eae255815659 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:29.706050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6f49f-e42d-4b5b-a6dd-eae255815659 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:29.707428 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6f49f-e42d-4b5b-a6dd-eae255815659 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:29.728174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 442/881] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:19:29 2022] POST /identity/v3/services => generated 269 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:19:31.147268 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb1267-0b0d-4f20-94be-c0aa1174f4e4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:31.147932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb1267-0b0d-4f20-94be-c0aa1174f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:31.147932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb1267-0b0d-4f20-94be-c0aa1174f4e4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:31.149245 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 440/882] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:31.154663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f114fa1-7fa3-4d76-870b-ba63711e03ce None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:31.155060 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f114fa1-7fa3-4d76-870b-ba63711e03ce None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:31.155245 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f114fa1-7fa3-4d76-870b-ba63711e03ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:31.174875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4f114fa1-7fa3-4d76-870b-ba63711e03ce None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:31.176070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4f114fa1-7fa3-4d76-870b-ba63711e03ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:31.236903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:31.252092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 443/883] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:31.274195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb1267-0b0d-4f20-94be-c0aa1174f4e4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:31.318273 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:31.388497 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb1267-0b0d-4f20-94be-c0aa1174f4e4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:31.424472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b298b4c-3f69-460f-91bc-6f070e9a40c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:31.425229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b298b4c-3f69-460f-91bc-6f070e9a40c9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:31.425515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b298b4c-3f69-460f-91bc-6f070e9a40c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:31.425787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b298b4c-3f69-460f-91bc-6f070e9a40c9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:31.426446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b298b4c-3f69-460f-91bc-6f070e9a40c9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:31.427886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b298b4c-3f69-460f-91bc-6f070e9a40c9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0b298b4c-3f69-460f-91bc-6f070e9a40c9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:31.440231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:31.441277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:31.442136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 441/884] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:19:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:31.448070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f114fa1-7fa3-4d76-870b-ba63711e03ce None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:31.555711 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f114fa1-7fa3-4d76-870b-ba63711e03ce None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:31.592781 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34613d36-6d89-4703-a5de-98193b3d7e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:31.593468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34613d36-6d89-4703-a5de-98193b3d7e13 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:31.593750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34613d36-6d89-4703-a5de-98193b3d7e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:31.594025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34613d36-6d89-4703-a5de-98193b3d7e13 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:31.594753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34613d36-6d89-4703-a5de-98193b3d7e13 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:31.595061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34613d36-6d89-4703-a5de-98193b3d7e13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:31.596472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34613d36-6d89-4703-a5de-98193b3d7e13 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:31.603046 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 444/885] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:19:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:31.608489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b298b4c-3f69-460f-91bc-6f070e9a40c9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:31.715019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:31.719626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b298b4c-3f69-460f-91bc-6f070e9a40c9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:31.755293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297bd566-b77f-42f0-b95c-2e0a0da264a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:31.756079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bd566-b77f-42f0-b95c-2e0a0da264a8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:31.756367 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bd566-b77f-42f0-b95c-2e0a0da264a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:31.756859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297bd566-b77f-42f0-b95c-2e0a0da264a8 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:31.757391 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bd566-b77f-42f0-b95c-2e0a0da264a8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:31.757699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bd566-b77f-42f0-b95c-2e0a0da264a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:31.759088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297bd566-b77f-42f0-b95c-2e0a0da264a8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:31.764748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 442/886] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:19:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:31.770400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34613d36-6d89-4703-a5de-98193b3d7e13 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:31.816470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f2ff0-211a-4a6a-87c0-d5c1d875e68c None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:31.817140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f2ff0-211a-4a6a-87c0-d5c1d875e68c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:31.817660 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f2ff0-211a-4a6a-87c0-d5c1d875e68c None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:31.819829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 443/887] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:31.825167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc0d38-a697-4142-bded-061df91ecf37 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:31.825800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc0d38-a697-4142-bded-061df91ecf37 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:31.826299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc0d38-a697-4142-bded-061df91ecf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:31.845588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0dbc0d38-a697-4142-bded-061df91ecf37 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:31.847505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:31.847815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0dbc0d38-a697-4142-bded-061df91ecf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:31.908750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34613d36-6d89-4703-a5de-98193b3d7e13 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:31.930365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 444/888] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:31.950889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6377f6-a75f-441f-b8ca-1350899b651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:31.952003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6377f6-a75f-441f-b8ca-1350899b651f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:31.952492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6377f6-a75f-441f-b8ca-1350899b651f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:31.953083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6377f6-a75f-441f-b8ca-1350899b651f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:31.954079 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6377f6-a75f-441f-b8ca-1350899b651f None admin] RBAC: Adding query filter params (interface=public, service_id=7bde3ee295694192a1639dd155714c0d, region_id=RegionOne) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:31.954579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc0d38-a697-4142-bded-061df91ecf37 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:31.954801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6377f6-a75f-441f-b8ca-1350899b651f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:31.956319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6377f6-a75f-441f-b8ca-1350899b651f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:31.962406 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 445/889] 10.222.0.39 () {56 vars in 1251 bytes} [Thu May 26 12:19:31 2022] GET /identity/v3/endpoints?service_id=7bde3ee295694192a1639dd155714c0d&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:31.968184 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6377f6-a75f-441f-b8ca-1350899b651f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:32.065452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:32.073549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc0d38-a697-4142-bded-061df91ecf37 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:32.082023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6377f6-a75f-441f-b8ca-1350899b651f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:32.099886 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:32.108895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533d866-02bb-4dc6-b9b1-ab6c2554389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:32.109726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533d866-02bb-4dc6-b9b1-ab6c2554389b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:32.110021 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533d866-02bb-4dc6-b9b1-ab6c2554389b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:32.110385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533d866-02bb-4dc6-b9b1-ab6c2554389b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:32.121411 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533d866-02bb-4dc6-b9b1-ab6c2554389b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:32.121703 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddc33b-faf5-49ce-ba33-4b76f910c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:32.122369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddc33b-faf5-49ce-ba33-4b76f910c25f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:32.122653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddc33b-faf5-49ce-ba33-4b76f910c25f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:32.122930 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddc33b-faf5-49ce-ba33-4b76f910c25f None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:32.123618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fddc33b-faf5-49ce-ba33-4b76f910c25f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:32.125008 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fddc33b-faf5-49ce-ba33-4b76f910c25f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6533d866-02bb-4dc6-b9b1-ab6c2554389b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:32.129521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:32.130523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:32.136574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:32.136574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:32.136574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:32.136574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:32.136574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:32.136574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:32.136574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:32.136574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:32.136574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:32.136574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:32.136574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:19:32.136574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:32.137276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 446/891] 10.222.0.39 () {56 vars in 1087 bytes} [Thu May 26 12:19:31 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:19:32.137352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 445/891] 10.222.0.39 () {56 vars in 1120 bytes} [Thu May 26 12:19:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:32.137352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69140d24-1b30-48d1-970f-a4d140431eb9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:32.137489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f6bcf-4e28-4b27-a9a4-4c066aefe432 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:32.137570 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69140d24-1b30-48d1-970f-a4d140431eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:32.137638 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f6bcf-4e28-4b27-a9a4-4c066aefe432 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:32.137705 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69140d24-1b30-48d1-970f-a4d140431eb9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:32.137778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f6bcf-4e28-4b27-a9a4-4c066aefe432 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:32.137847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 446/892] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:32.137920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 447/893] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:32.145861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f6bcf-4e28-4b27-a9a4-4c066aefe432 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:32.146309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56778-08cf-499d-9280-79ac9c4d1ac9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:32.146877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56778-08cf-499d-9280-79ac9c4d1ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:32.147157 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56778-08cf-499d-9280-79ac9c4d1ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:32.166035 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9ee56778-08cf-499d-9280-79ac9c4d1ac9 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:32.167275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9ee56778-08cf-499d-9280-79ac9c4d1ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:32.243689 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 447/894] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:32.250504 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110072b-28e0-4397-9e15-fb512466e3ae None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:32.251276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110072b-28e0-4397-9e15-fb512466e3ae None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:32.252155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110072b-28e0-4397-9e15-fb512466e3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:32.270980 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f6bcf-4e28-4b27-a9a4-4c066aefe432 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:32.277224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e110072b-28e0-4397-9e15-fb512466e3ae None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:32.278495 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e110072b-28e0-4397-9e15-fb512466e3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:32.313867 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b033781-6bb9-42fd-8df8-c58a7bee2697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:32.314547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b033781-6bb9-42fd-8df8-c58a7bee2697 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:32.314943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b033781-6bb9-42fd-8df8-c58a7bee2697 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:32.315220 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b033781-6bb9-42fd-8df8-c58a7bee2697 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:32.316303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b033781-6bb9-42fd-8df8-c58a7bee2697 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:32.316303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b033781-6bb9-42fd-8df8-c58a7bee2697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:32.317660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b033781-6bb9-42fd-8df8-c58a7bee2697 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:32.328033 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 448/895] 10.222.0.39 () {56 vars in 1115 bytes} [Thu May 26 12:19:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:32.329894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b033781-6bb9-42fd-8df8-c58a7bee2697 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:32.363866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 448/896] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:32.363866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110072b-28e0-4397-9e15-fb512466e3ae None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:32.379068 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:32.386777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:32.445827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b033781-6bb9-42fd-8df8-c58a7bee2697 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:32.465708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110072b-28e0-4397-9e15-fb512466e3ae None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:32.483644 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961d001-ef00-4e13-a9e8-e52383b2fe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:32.484315 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961d001-ef00-4e13-a9e8-e52383b2fe44 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:32.484600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961d001-ef00-4e13-a9e8-e52383b2fe44 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:32.484924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961d001-ef00-4e13-a9e8-e52383b2fe44 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:32.485711 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961d001-ef00-4e13-a9e8-e52383b2fe44 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:32.487083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961d001-ef00-4e13-a9e8-e52383b2fe44 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:32.508825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 449/897] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:19:32 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:32.508825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961d001-ef00-4e13-a9e8-e52383b2fe44 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:32.511224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9074ca-c4b0-49a5-85f4-39cbae5d5b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:32.511224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9074ca-c4b0-49a5-85f4-39cbae5d5b89 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:32.511430 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9074ca-c4b0-49a5-85f4-39cbae5d5b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:32.511619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9074ca-c4b0-49a5-85f4-39cbae5d5b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:32.525364 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9074ca-c4b0-49a5-85f4-39cbae5d5b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:32.526938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9074ca-c4b0-49a5-85f4-39cbae5d5b89 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-3d9074ca-c4b0-49a5-85f4-39cbae5d5b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:32.547805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:32.548910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:32.550388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:32.550388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:32.550388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:32.550388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:32.554486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 449/898] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:32.555623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9074ca-c4b0-49a5-85f4-39cbae5d5b89 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:32.639261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:32.654646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961d001-ef00-4e13-a9e8-e52383b2fe44 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:32.658306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:32.686288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9074ca-c4b0-49a5-85f4-39cbae5d5b89 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:32.697658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d04611-21e5-4167-8a90-79932c5d3094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:32.698494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d04611-21e5-4167-8a90-79932c5d3094 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:32.698778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d04611-21e5-4167-8a90-79932c5d3094 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:32.699054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d04611-21e5-4167-8a90-79932c5d3094 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:32.699722 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d04611-21e5-4167-8a90-79932c5d3094 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:32.701141 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d04611-21e5-4167-8a90-79932c5d3094 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-17d04611-21e5-4167-8a90-79932c5d3094 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:32.715484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:32.716645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:32.717800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 450/899] 10.222.0.39 () {56 vars in 1132 bytes} [Thu May 26 12:19:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:32.723016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d04611-21e5-4167-8a90-79932c5d3094 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:32.735304 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecbf71-2737-4169-b649-decd77db2fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:32.735984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecbf71-2737-4169-b649-decd77db2fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:32.736737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecbf71-2737-4169-b649-decd77db2fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:32.737041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecbf71-2737-4169-b649-decd77db2fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:32.737775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fecbf71-2737-4169-b649-decd77db2fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:32.738087 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fecbf71-2737-4169-b649-decd77db2fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:32.740280 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fecbf71-2737-4169-b649-decd77db2fe0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:32.757389 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 450/900] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:32.765798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecbf71-2737-4169-b649-decd77db2fe0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:32.840494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d04611-21e5-4167-8a90-79932c5d3094 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:32.894424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b77387-e5ff-4535-98e0-073eb3cf74db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:32.895108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b77387-e5ff-4535-98e0-073eb3cf74db None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:32.895391 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b77387-e5ff-4535-98e0-073eb3cf74db None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:32.895774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b77387-e5ff-4535-98e0-073eb3cf74db None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:32.896551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b77387-e5ff-4535-98e0-073eb3cf74db None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:32.896903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b77387-e5ff-4535-98e0-073eb3cf74db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:32.898343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b77387-e5ff-4535-98e0-073eb3cf74db None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:32.900498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecbf71-2737-4169-b649-decd77db2fe0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:32.908847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 451/901] 10.222.0.39 () {56 vars in 1126 bytes} [Thu May 26 12:19:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:32.909973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b77387-e5ff-4535-98e0-073eb3cf74db None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:32.933237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:32.947909 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374780e-985f-4955-b4e6-857872b49bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:32.949276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374780e-985f-4955-b4e6-857872b49bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:32.949976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374780e-985f-4955-b4e6-857872b49bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:32.950398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374780e-985f-4955-b4e6-857872b49bb2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:32.951169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:32.960576 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374780e-985f-4955-b4e6-857872b49bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:32.962317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374780e-985f-4955-b4e6-857872b49bb2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8374780e-985f-4955-b4e6-857872b49bb2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:32.979171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:32.980289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:32.981287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:32.981287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:32.981287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:32.981287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:32.981287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:32.981287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:32.981287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:32.981287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:32.981287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:19:32.981287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:32.981814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 451/902] 10.222.0.39 () {56 vars in 1117 bytes} [Thu May 26 12:19:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:32.989697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374780e-985f-4955-b4e6-857872b49bb2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:33.038443 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b77387-e5ff-4535-98e0-073eb3cf74db None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:33.076653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb637803-fe09-4937-82b3-0c05ddbaf827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:33.077704 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb637803-fe09-4937-82b3-0c05ddbaf827 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:33.078259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb637803-fe09-4937-82b3-0c05ddbaf827 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:33.078836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb637803-fe09-4937-82b3-0c05ddbaf827 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:33.079741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb637803-fe09-4937-82b3-0c05ddbaf827 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:33.080259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb637803-fe09-4937-82b3-0c05ddbaf827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:33.082036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb637803-fe09-4937-82b3-0c05ddbaf827 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:33.093128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 452/903] 10.222.0.39 () {56 vars in 1126 bytes} [Thu May 26 12:19:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:33.094239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb637803-fe09-4937-82b3-0c05ddbaf827 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:33.095118 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374780e-985f-4955-b4e6-857872b49bb2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:33.134231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdd9b8-4eee-4b97-a61a-af6dce1d504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:33.134776 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdd9b8-4eee-4b97-a61a-af6dce1d504b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:33.135060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdd9b8-4eee-4b97-a61a-af6dce1d504b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:33.135336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdd9b8-4eee-4b97-a61a-af6dce1d504b None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:33.136233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdd9b8-4eee-4b97-a61a-af6dce1d504b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:33.136542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdd9b8-4eee-4b97-a61a-af6dce1d504b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:33.138069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdd9b8-4eee-4b97-a61a-af6dce1d504b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:33.162519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 452/904] 10.222.0.39 () {56 vars in 1149 bytes} [Thu May 26 12:19:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:33.163575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdd9b8-4eee-4b97-a61a-af6dce1d504b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:33.203976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:33.213260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb637803-fe09-4937-82b3-0c05ddbaf827 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:33.218394 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:33.255189 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199ca3e-4f74-498a-b520-169e9a68794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:33.257402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199ca3e-4f74-498a-b520-169e9a68794f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:33.257888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199ca3e-4f74-498a-b520-169e9a68794f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:33.258362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199ca3e-4f74-498a-b520-169e9a68794f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:33.260408 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199ca3e-4f74-498a-b520-169e9a68794f None admin] RBAC: Adding query filter params (interface=public, service_id=cb4ede7fd85c4bcdaeee0ee94b73a52a, region_id=RegionOne) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:33.260982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199ca3e-4f74-498a-b520-169e9a68794f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:33.263384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199ca3e-4f74-498a-b520-169e9a68794f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:33.270693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 453/905] 10.222.0.39 () {56 vars in 1251 bytes} [Thu May 26 12:19:33 2022] GET /identity/v3/endpoints?service_id=cb4ede7fd85c4bcdaeee0ee94b73a52a&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:33.276941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199ca3e-4f74-498a-b520-169e9a68794f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:33.301529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdd9b8-4eee-4b97-a61a-af6dce1d504b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:33.339083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d580f-6506-4e17-bd9c-195a2e133346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:33.339842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d580f-6506-4e17-bd9c-195a2e133346 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:33.340108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d580f-6506-4e17-bd9c-195a2e133346 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:33.340463 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d580f-6506-4e17-bd9c-195a2e133346 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:33.392357 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199ca3e-4f74-498a-b520-169e9a68794f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:33.416772 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d580f-6506-4e17-bd9c-195a2e133346 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:33.418309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d580f-6506-4e17-bd9c-195a2e133346 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:33.431399 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042894fd-4be1-47e2-bc5f-b32c54322f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:33.432419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042894fd-4be1-47e2-bc5f-b32c54322f75 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:33.432979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042894fd-4be1-47e2-bc5f-b32c54322f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:33.433476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042894fd-4be1-47e2-bc5f-b32c54322f75 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:33.434611 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042894fd-4be1-47e2-bc5f-b32c54322f75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:33.436185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042894fd-4be1-47e2-bc5f-b32c54322f75 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:33.443045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 454/906] 10.222.0.39 () {56 vars in 1087 bytes} [Thu May 26 12:19:33 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:19:33.476049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:33.545753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 453/907] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:33 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:19:33.556077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042894fd-4be1-47e2-bc5f-b32c54322f75 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:33.587848 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:33.687717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042894fd-4be1-47e2-bc5f-b32c54322f75 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:33.722957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24086f-a29d-420b-b9c4-ae4f13196851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:33.723756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24086f-a29d-420b-b9c4-ae4f13196851 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:33.724033 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24086f-a29d-420b-b9c4-ae4f13196851 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:33.724301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24086f-a29d-420b-b9c4-ae4f13196851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:33.736240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24086f-a29d-420b-b9c4-ae4f13196851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:33.737715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24086f-a29d-420b-b9c4-ae4f13196851 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-5b24086f-a29d-420b-b9c4-ae4f13196851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:33.756317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:33.757493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:33.758425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:33.758425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:33.758425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:33.758425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:33.758425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 455/908] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:33.764081 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d580f-6506-4e17-bd9c-195a2e133346 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:33.874992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d580f-6506-4e17-bd9c-195a2e133346 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:33.920092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995afd4d-c3ee-44c9-90ed-4b2a74200d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:33.920795 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995afd4d-c3ee-44c9-90ed-4b2a74200d53 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:33.921080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995afd4d-c3ee-44c9-90ed-4b2a74200d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:33.921353 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995afd4d-c3ee-44c9-90ed-4b2a74200d53 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:33.922089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995afd4d-c3ee-44c9-90ed-4b2a74200d53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:33.922396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995afd4d-c3ee-44c9-90ed-4b2a74200d53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:33.923783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995afd4d-c3ee-44c9-90ed-4b2a74200d53 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:33.937770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:33.943075 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 454/909] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:33.951635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24086f-a29d-420b-b9c4-ae4f13196851 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:34.039055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:34.064233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24086f-a29d-420b-b9c4-ae4f13196851 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:34.103640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e59855-6efd-4d36-85c6-96f01766cac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:34.104447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59855-6efd-4d36-85c6-96f01766cac5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:34.104738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59855-6efd-4d36-85c6-96f01766cac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:34.105031 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59855-6efd-4d36-85c6-96f01766cac5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:34.111728 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e59855-6efd-4d36-85c6-96f01766cac5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:34.113191 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e59855-6efd-4d36-85c6-96f01766cac5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-73e59855-6efd-4d36-85c6-96f01766cac5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:34.128089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:34.129057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:34.131174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:34.131174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:34.131174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:34.131174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:34.131174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:34.131174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:34.131174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:34.131174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:34.131174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 456/910] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:34.135553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995afd4d-c3ee-44c9-90ed-4b2a74200d53 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:34.249429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995afd4d-c3ee-44c9-90ed-4b2a74200d53 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:34.288522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310a98c-8a91-4a16-b1bc-5d004541ce88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:34.289232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310a98c-8a91-4a16-b1bc-5d004541ce88 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:34.289517 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310a98c-8a91-4a16-b1bc-5d004541ce88 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:34.289787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310a98c-8a91-4a16-b1bc-5d004541ce88 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:34.290572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310a98c-8a91-4a16-b1bc-5d004541ce88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:34.290882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310a98c-8a91-4a16-b1bc-5d004541ce88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:34.292322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310a98c-8a91-4a16-b1bc-5d004541ce88 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:34.305805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 455/911] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:34.313781 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e59855-6efd-4d36-85c6-96f01766cac5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:34.423000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e59855-6efd-4d36-85c6-96f01766cac5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:34.435064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8c67e-1de4-4787-ab80-2da45f047eba None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:34.435382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8c67e-1de4-4787-ab80-2da45f047eba None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:34.435626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8c67e-1de4-4787-ab80-2da45f047eba None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:34.438540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 456/912] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:34.442706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e04c7-18d3-47aa-8388-49b507615fc3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:34.442993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e04c7-18d3-47aa-8388-49b507615fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:34.443779 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e04c7-18d3-47aa-8388-49b507615fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:34.460043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b45859-050d-46db-98c0-50c4548c637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:34.460730 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b45859-050d-46db-98c0-50c4548c637e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:34.461027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b45859-050d-46db-98c0-50c4548c637e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:34.461310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b45859-050d-46db-98c0-50c4548c637e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:34.462152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b45859-050d-46db-98c0-50c4548c637e None admin] RBAC: Adding query filter params (role.id=c130ba76816741e29f2e2a913e37b50c, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=bc48f3a3998b4c5ab199181005f9a5d7) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:34.462586 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b45859-050d-46db-98c0-50c4548c637e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:34.463261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-996e04c7-18d3-47aa-8388-49b507615fc3 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:34.464037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b45859-050d-46db-98c0-50c4548c637e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:34.464451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-996e04c7-18d3-47aa-8388-49b507615fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:34.467216 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:34.471600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 457/913] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:34 2022] GET /identity/v3/role_assignments?user.id=bc48f3a3998b4c5ab199181005f9a5d7&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=c130ba76816741e29f2e2a913e37b50c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:34.529214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:34.545737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 457/914] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:34.569354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b45859-050d-46db-98c0-50c4548c637e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:34.683108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b45859-050d-46db-98c0-50c4548c637e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:34.722224 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cd719-abae-43f8-a6eb-5f86105f37bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:34.723049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cd719-abae-43f8-a6eb-5f86105f37bc None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:34.723336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cd719-abae-43f8-a6eb-5f86105f37bc None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:34.723617 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cd719-abae-43f8-a6eb-5f86105f37bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:34.724292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cd719-abae-43f8-a6eb-5f86105f37bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:34.725852 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cd719-abae-43f8-a6eb-5f86105f37bc None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-c92cd719-abae-43f8-a6eb-5f86105f37bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:34.742764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:34.743786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:19:34.744613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:34.748745 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 458/915] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:19:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:34.750803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e04c7-18d3-47aa-8388-49b507615fc3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:34.858914 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e04c7-18d3-47aa-8388-49b507615fc3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:34.888654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b47e4a-d2bf-4252-a239-a01429b23fb7 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:34.889018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b47e4a-d2bf-4252-a239-a01429b23fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:34.889547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b47e4a-d2bf-4252-a239-a01429b23fb7 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:34.893239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 459/916] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:34.895769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418f164-17a6-47e7-a86b-01365746d42b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:34.896248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418f164-17a6-47e7-a86b-01365746d42b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:34.896803 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418f164-17a6-47e7-a86b-01365746d42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:34.904550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75f912-f4b8-4c87-8b80-50d8dd1518f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:34.905267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75f912-f4b8-4c87-8b80-50d8dd1518f3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:34.905550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75f912-f4b8-4c87-8b80-50d8dd1518f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:34.905828 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75f912-f4b8-4c87-8b80-50d8dd1518f3 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:34.906547 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75f912-f4b8-4c87-8b80-50d8dd1518f3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:34.906862 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75f912-f4b8-4c87-8b80-50d8dd1518f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:34.908243 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75f912-f4b8-4c87-8b80-50d8dd1518f3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:34.918008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 458/917] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:19:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:34.918910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d418f164-17a6-47e7-a86b-01365746d42b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:34.920122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d418f164-17a6-47e7-a86b-01365746d42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:34.921666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75f912-f4b8-4c87-8b80-50d8dd1518f3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:34.993011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:34.994137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:35.012811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 460/918] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:35.034471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418f164-17a6-47e7-a86b-01365746d42b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:35.061982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75f912-f4b8-4c87-8b80-50d8dd1518f3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:35.098949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a5009-583d-45c6-9adc-19ff9f054307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:35.100185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a5009-583d-45c6-9adc-19ff9f054307 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:35.100472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a5009-583d-45c6-9adc-19ff9f054307 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:35.100889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a5009-583d-45c6-9adc-19ff9f054307 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:35.101608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a5009-583d-45c6-9adc-19ff9f054307 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:35.101932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a5009-583d-45c6-9adc-19ff9f054307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:35.103301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a5009-583d-45c6-9adc-19ff9f054307 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:35.114492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 459/919] 10.222.0.39 () {56 vars in 1114 bytes} [Thu May 26 12:19:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:35.116913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a5009-583d-45c6-9adc-19ff9f054307 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:35.163295 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418f164-17a6-47e7-a86b-01365746d42b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:35.215488 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c2794-c7ae-4f5d-944e-d3d80853b9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:35.216317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c2794-c7ae-4f5d-944e-d3d80853b9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:35.216604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c2794-c7ae-4f5d-944e-d3d80853b9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:35.216924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c2794-c7ae-4f5d-944e-d3d80853b9e8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:35.217595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c2794-c7ae-4f5d-944e-d3d80853b9e8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:35.219539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c2794-c7ae-4f5d-944e-d3d80853b9e8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:35.231356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a5009-583d-45c6-9adc-19ff9f054307 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-858c2794-c7ae-4f5d-944e-d3d80853b9e8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:35.236146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:35.237140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:35.237975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:35.242853 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 461/920] 10.222.0.39 () {56 vars in 1126 bytes} [Thu May 26 12:19:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:35.245284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c2794-c7ae-4f5d-944e-d3d80853b9e8 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:35.256818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:35.289334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a874d7b-b69c-4ecc-a92a-6e1bfab3436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:35.290384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a874d7b-b69c-4ecc-a92a-6e1bfab3436f None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:35.290865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a874d7b-b69c-4ecc-a92a-6e1bfab3436f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:35.291360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a874d7b-b69c-4ecc-a92a-6e1bfab3436f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:35.292300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a874d7b-b69c-4ecc-a92a-6e1bfab3436f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:35.293912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a874d7b-b69c-4ecc-a92a-6e1bfab3436f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:35.324995 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 460/921] 10.222.0.39 () {60 vars in 1144 bytes} [Thu May 26 12:19:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:35.328388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:35.377189 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c2794-c7ae-4f5d-944e-d3d80853b9e8 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:35.421962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480740d-3516-41fb-a99c-b71df0e21e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:35.422651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480740d-3516-41fb-a99c-b71df0e21e4f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:35.422940 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480740d-3516-41fb-a99c-b71df0e21e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:35.423216 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480740d-3516-41fb-a99c-b71df0e21e4f None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:35.423938 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480740d-3516-41fb-a99c-b71df0e21e4f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:35.424249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480740d-3516-41fb-a99c-b71df0e21e4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:35.425675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480740d-3516-41fb-a99c-b71df0e21e4f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:35.432387 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 462/922] 10.222.0.39 () {56 vars in 1122 bytes} [Thu May 26 12:19:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:35.438364 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a874d7b-b69c-4ecc-a92a-6e1bfab3436f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:35.551762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a874d7b-b69c-4ecc-a92a-6e1bfab3436f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:35.588098 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361af98-3c6f-4fb5-8f2a-2c707d89eae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:35.588803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361af98-3c6f-4fb5-8f2a-2c707d89eae8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:35.589092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361af98-3c6f-4fb5-8f2a-2c707d89eae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:35.589364 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361af98-3c6f-4fb5-8f2a-2c707d89eae8 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:35.590078 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361af98-3c6f-4fb5-8f2a-2c707d89eae8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:35.590388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361af98-3c6f-4fb5-8f2a-2c707d89eae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:35.591757 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361af98-3c6f-4fb5-8f2a-2c707d89eae8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:35.597007 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 461/923] 10.222.0.39 () {56 vars in 1122 bytes} [Thu May 26 12:19:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:35.602710 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480740d-3516-41fb-a99c-b71df0e21e4f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:35.711374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480740d-3516-41fb-a99c-b71df0e21e4f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:35.731073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:35.751625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310deb6d-d8e7-4385-a689-ad6d7879d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:35.752318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310deb6d-d8e7-4385-a689-ad6d7879d5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:35.752605 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310deb6d-d8e7-4385-a689-ad6d7879d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:35.752916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310deb6d-d8e7-4385-a689-ad6d7879d5a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:35.753740 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310deb6d-d8e7-4385-a689-ad6d7879d5a5 None admin] RBAC: Adding query filter params (interface=public, service_id=78a8f240719f4315a0750f8882c5bdbe, region_id=RegionOne) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:35.754061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310deb6d-d8e7-4385-a689-ad6d7879d5a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:35.755492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310deb6d-d8e7-4385-a689-ad6d7879d5a5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:35.762534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 463/924] 10.222.0.39 () {56 vars in 1251 bytes} [Thu May 26 12:19:35 2022] GET /identity/v3/endpoints?service_id=78a8f240719f4315a0750f8882c5bdbe&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:35.767982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361af98-3c6f-4fb5-8f2a-2c707d89eae8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:35.810424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:35.878900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361af98-3c6f-4fb5-8f2a-2c707d89eae8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:35.917654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2a80b-4b96-4f4d-833a-dfdb7e9c351e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:35.918325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a80b-4b96-4f4d-833a-dfdb7e9c351e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:35.918609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a80b-4b96-4f4d-833a-dfdb7e9c351e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:35.918887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2a80b-4b96-4f4d-833a-dfdb7e9c351e None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:35.919578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2a80b-4b96-4f4d-833a-dfdb7e9c351e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:35.920979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2a80b-4b96-4f4d-833a-dfdb7e9c351e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:35.927598 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 462/925] 10.222.0.39 () {56 vars in 1087 bytes} [Thu May 26 12:19:35 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:19:35.929298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada81c4-9fa4-4516-aec9-b4f5aea6b044 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:35.929598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada81c4-9fa4-4516-aec9-b4f5aea6b044 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:35.929889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada81c4-9fa4-4516-aec9-b4f5aea6b044 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:35.931670 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 464/926] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:35.937446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74159ef-3c07-41c4-9bd9-77d40c583430 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:35.937738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74159ef-3c07-41c4-9bd9-77d40c583430 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:35.938023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74159ef-3c07-41c4-9bd9-77d40c583430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:35.957294 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c74159ef-3c07-41c4-9bd9-77d40c583430 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:35.958535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c74159ef-3c07-41c4-9bd9-77d40c583430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:36.043699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 463/927] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:36.067253 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada81c4-9fa4-4516-aec9-b4f5aea6b044 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:36.185504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada81c4-9fa4-4516-aec9-b4f5aea6b044 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:36.222131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e1944-7a9c-4ae6-bd47-cb1a3602c974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:36.222950 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e1944-7a9c-4ae6-bd47-cb1a3602c974 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:36.223236 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e1944-7a9c-4ae6-bd47-cb1a3602c974 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:36.223518 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e1944-7a9c-4ae6-bd47-cb1a3602c974 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:36.224183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e1944-7a9c-4ae6-bd47-cb1a3602c974 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:36.225617 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e1944-7a9c-4ae6-bd47-cb1a3602c974 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-e87e1944-7a9c-4ae6-bd47-cb1a3602c974 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:36.251485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:36.252483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:36.253349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 465/928] 10.222.0.39 () {56 vars in 1132 bytes} [Thu May 26 12:19:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:36.261870 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74159ef-3c07-41c4-9bd9-77d40c583430 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:36.302690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:36.377037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74159ef-3c07-41c4-9bd9-77d40c583430 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:36.420675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fa453-832c-48d5-91ea-f68435c838f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:36.424597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fa453-832c-48d5-91ea-f68435c838f2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:36.424909 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fa453-832c-48d5-91ea-f68435c838f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:36.425189 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fa453-832c-48d5-91ea-f68435c838f2 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:36.425919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fa453-832c-48d5-91ea-f68435c838f2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:36.426228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fa453-832c-48d5-91ea-f68435c838f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:36.427632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fa453-832c-48d5-91ea-f68435c838f2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:36.434261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 464/929] 10.222.0.39 () {56 vars in 1126 bytes} [Thu May 26 12:19:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:36.439640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e1944-7a9c-4ae6-bd47-cb1a3602c974 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:36.538449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:36.653681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e1944-7a9c-4ae6-bd47-cb1a3602c974 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:36.718167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478fdf5-45e7-46b0-b1a4-ec2688196d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:36.718872 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478fdf5-45e7-46b0-b1a4-ec2688196d82 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:36.719162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478fdf5-45e7-46b0-b1a4-ec2688196d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:36.719444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478fdf5-45e7-46b0-b1a4-ec2688196d82 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:36.720185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478fdf5-45e7-46b0-b1a4-ec2688196d82 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:36.720498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478fdf5-45e7-46b0-b1a4-ec2688196d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:36.725164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478fdf5-45e7-46b0-b1a4-ec2688196d82 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:36.733943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 466/930] 10.222.0.39 () {56 vars in 1126 bytes} [Thu May 26 12:19:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:36.739408 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fa453-832c-48d5-91ea-f68435c838f2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:36.835824 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5a234-7c8e-4fde-993b-5106a750ab06 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:36.836461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5a234-7c8e-4fde-993b-5106a750ab06 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:36.836972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5a234-7c8e-4fde-993b-5106a750ab06 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:36.838816 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 467/931] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:36.842751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:36.844229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb1d88-7a39-4f5a-bbc5-3ec882fd615c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:36.844838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb1d88-7a39-4f5a-bbc5-3ec882fd615c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:36.845385 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb1d88-7a39-4f5a-bbc5-3ec882fd615c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:36.845848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fa453-832c-48d5-91ea-f68435c838f2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:36.864664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-88bb1d88-7a39-4f5a-bbc5-3ec882fd615c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:36.866889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-88bb1d88-7a39-4f5a-bbc5-3ec882fd615c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:36.886645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b06fa-c1bb-4fec-a243-6b64daf7a43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:36.887383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b06fa-c1bb-4fec-a243-6b64daf7a43d None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:36.887735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b06fa-c1bb-4fec-a243-6b64daf7a43d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:36.888079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b06fa-c1bb-4fec-a243-6b64daf7a43d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:36.888925 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b06fa-c1bb-4fec-a243-6b64daf7a43d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:36.890817 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b06fa-c1bb-4fec-a243-6b64daf7a43d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:36.918525 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 465/932] 10.222.0.39 () {60 vars in 1144 bytes} [Thu May 26 12:19:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:36.970317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 468/933] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:36.995152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b06fa-c1bb-4fec-a243-6b64daf7a43d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:37.110602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b06fa-c1bb-4fec-a243-6b64daf7a43d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:37.147975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976df177-819e-4768-ae2c-c236cc60c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:37.149074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976df177-819e-4768-ae2c-c236cc60c34a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:37.149535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976df177-819e-4768-ae2c-c236cc60c34a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:37.149956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976df177-819e-4768-ae2c-c236cc60c34a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:37.161968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976df177-819e-4768-ae2c-c236cc60c34a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-976df177-819e-4768-ae2c-c236cc60c34a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:37.170414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:37.171363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:37.172201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:37.172201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:37.172201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:37.172201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:37.172201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:37.172201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:37.172201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:37.172201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:37.172201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:37.172201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:37.172201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:19:37.172201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:37.172201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 466/934] 10.222.0.39 () {56 vars in 1120 bytes} [Thu May 26 12:19:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:37.179686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb1d88-7a39-4f5a-bbc5-3ec882fd615c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:37.216190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:37.294953 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb1d88-7a39-4f5a-bbc5-3ec882fd615c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:37.335714 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7833c24-ccc8-4657-9265-5a9d6c7fba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:37.336677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7833c24-ccc8-4657-9265-5a9d6c7fba70 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:37.337155 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7833c24-ccc8-4657-9265-5a9d6c7fba70 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:37.337577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7833c24-ccc8-4657-9265-5a9d6c7fba70 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:37.338480 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7833c24-ccc8-4657-9265-5a9d6c7fba70 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:37.338934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7833c24-ccc8-4657-9265-5a9d6c7fba70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:37.340448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7833c24-ccc8-4657-9265-5a9d6c7fba70 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:37.350337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 469/935] 10.222.0.39 () {56 vars in 1115 bytes} [Thu May 26 12:19:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:37.356292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976df177-819e-4768-ae2c-c236cc60c34a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:37.373646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:37.466334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976df177-819e-4768-ae2c-c236cc60c34a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:37.502448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88273e-0437-4619-943a-b0d6bada9026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:37.503248 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88273e-0437-4619-943a-b0d6bada9026 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:37.503535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88273e-0437-4619-943a-b0d6bada9026 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:37.503811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88273e-0437-4619-943a-b0d6bada9026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:37.515827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88273e-0437-4619-943a-b0d6bada9026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:37.517321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88273e-0437-4619-943a-b0d6bada9026 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ac88273e-0437-4619-943a-b0d6bada9026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:37.535616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:37.536578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:37.538247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:37.538247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:37.538247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:37.538247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:37.538247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 467/936] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:37.543200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7833c24-ccc8-4657-9265-5a9d6c7fba70 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:37.650554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:37.654307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7833c24-ccc8-4657-9265-5a9d6c7fba70 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:37.694978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a654292-2320-44a1-8d4f-55754d1c0868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:37.695669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a654292-2320-44a1-8d4f-55754d1c0868 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:37.695956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a654292-2320-44a1-8d4f-55754d1c0868 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:37.696232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a654292-2320-44a1-8d4f-55754d1c0868 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:37.697017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a654292-2320-44a1-8d4f-55754d1c0868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:37.697330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a654292-2320-44a1-8d4f-55754d1c0868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:37.698761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a654292-2320-44a1-8d4f-55754d1c0868 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:37.713602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 470/937] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:37.719421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88273e-0437-4619-943a-b0d6bada9026 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:37.792747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:37.832580 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88273e-0437-4619-943a-b0d6bada9026 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:37.869180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b9128-632a-439c-8394-6c7b7a66d268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:37.870011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b9128-632a-439c-8394-6c7b7a66d268 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:37.870299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b9128-632a-439c-8394-6c7b7a66d268 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:37.870637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b9128-632a-439c-8394-6c7b7a66d268 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:37.880189 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b9128-632a-439c-8394-6c7b7a66d268 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:37.880378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b9128-632a-439c-8394-6c7b7a66d268 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-007b9128-632a-439c-8394-6c7b7a66d268 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:37.897617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:37.898522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:37.899474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:37.899474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:37.899474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:37.899474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:37.899474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:37.899474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:37.899474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:37.899474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:37.899474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:19:37.899474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:37.899474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 468/938] 10.222.0.39 () {56 vars in 1117 bytes} [Thu May 26 12:19:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:37.903476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a654292-2320-44a1-8d4f-55754d1c0868 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:37.931335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426850ed-4916-464b-a230-eebcd251cde4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:37.932226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426850ed-4916-464b-a230-eebcd251cde4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:37.932761 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426850ed-4916-464b-a230-eebcd251cde4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:37.935307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 469/939] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:37.940433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5695d-c149-420d-8022-9100a3c5aa5d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:37.940983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5695d-c149-420d-8022-9100a3c5aa5d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:37.941482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5695d-c149-420d-8022-9100a3c5aa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:37.961063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-34a5695d-c149-420d-8022-9100a3c5aa5d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:37.962264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-34a5695d-c149-420d-8022-9100a3c5aa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:38.013159 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a654292-2320-44a1-8d4f-55754d1c0868 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:38.052905 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 470/940] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:38.059181 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c471b0-076e-4561-a7d5-ccad618d8d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:38.059866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c471b0-076e-4561-a7d5-ccad618d8d12 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:38.060154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c471b0-076e-4561-a7d5-ccad618d8d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:38.060433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c471b0-076e-4561-a7d5-ccad618d8d12 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:38.061312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c471b0-076e-4561-a7d5-ccad618d8d12 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:38.061626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c471b0-076e-4561-a7d5-ccad618d8d12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:38.063118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c471b0-076e-4561-a7d5-ccad618d8d12 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:38.072383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5695d-c149-420d-8022-9100a3c5aa5d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:38.083695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 471/941] 10.222.0.39 () {56 vars in 1149 bytes} [Thu May 26 12:19:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:38.089923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c471b0-076e-4561-a7d5-ccad618d8d12 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:38.109543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:38.137674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:38.191518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5695d-c149-420d-8022-9100a3c5aa5d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:38.216989 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c471b0-076e-4561-a7d5-ccad618d8d12 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:38.232900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668c429-1ad7-4a63-ab7a-64d1ff288008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:38.234071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668c429-1ad7-4a63-ab7a-64d1ff288008 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:38.234513 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668c429-1ad7-4a63-ab7a-64d1ff288008 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:38.234955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668c429-1ad7-4a63-ab7a-64d1ff288008 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:38.235959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668c429-1ad7-4a63-ab7a-64d1ff288008 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:38.237691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668c429-1ad7-4a63-ab7a-64d1ff288008 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:38.239392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: WARNING keystone.server.flask.common [None req-0668c429-1ad7-4a63-ab7a-64d1ff288008 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 12:19:38.254782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cfbd6-eab2-4f6e-adf9-429585e484af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:38.255653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cfbd6-eab2-4f6e-adf9-429585e484af None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:38.256513 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cfbd6-eab2-4f6e-adf9-429585e484af None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:38.256971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cfbd6-eab2-4f6e-adf9-429585e484af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:38.259069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.sql.core [None req-0668c429-1ad7-4a63-ab7a-64d1ff288008 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:19:38.259069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 12:19:38.259069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [parameters: {'id': '212074b260434a4f90c09822e53d3002', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 12:19:38.259069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80141) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:19:38.268997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cfbd6-eab2-4f6e-adf9-429585e484af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:38.270668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cfbd6-eab2-4f6e-adf9-429585e484af None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:38.279471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0668c429-1ad7-4a63-ab7a-64d1ff288008 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 212074b260434a4f90c09822e53d3002.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 212074b260434a4f90c09822e53d3002. May 26 12:19:38.279471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:38.279471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:19:38.279471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:19:38.279471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:19:38.279471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:19:38.279471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:19:38.279471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:19:38.279471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:19:38.279471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application conn.query(q) May 26 12:19:38.279471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:19:38.279471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:19:38.279471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application result.read() May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 12:19:38.280320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application next(self.gen) May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application yield resource May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application next(self.gen) May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise self.value May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application session.commit() May 26 12:19:38.281317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.session.flush() May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application compat.raise_( May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:19:38.282265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:19:38.283199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application conn.query(q) May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application result.read() May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:19:38.284028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [parameters: {'id': '212074b260434a4f90c09822e53d3002', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:38.285060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:38.286159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:38.287819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:38.287819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 12:19:38.287819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 12:19:38.287819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:38.287819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:38.287819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 12:19:38.287819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 12:19:38.287819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 212074b260434a4f90c09822e53d3002. May 26 12:19:38.287819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-e51cfbd6-eab2-4f6e-adf9-429585e484af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:38.290636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:38.292619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:38.294819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:38.294819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:38.294819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:38.294819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:38.297000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 471/943] 10.222.0.39 () {60 vars in 1140 bytes} [Thu May 26 12:19:38 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:38.297180 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 472/943] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:38.297329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668c429-1ad7-4a63-ab7a-64d1ff288008 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:38.297477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cfbd6-eab2-4f6e-adf9-429585e484af None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:38.386420 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:38.413496 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668c429-1ad7-4a63-ab7a-64d1ff288008 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:38.423289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cfbd6-eab2-4f6e-adf9-429585e484af None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:38.426134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:38.457790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728862ca-aa08-4fd1-9db7-858414b327d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:38.458590 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728862ca-aa08-4fd1-9db7-858414b327d0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:38.458879 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728862ca-aa08-4fd1-9db7-858414b327d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:38.459735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728862ca-aa08-4fd1-9db7-858414b327d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:38.460285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b616103-49cf-40d9-9436-3ad88c54ebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:38.460938 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b616103-49cf-40d9-9436-3ad88c54ebd1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:38.461228 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b616103-49cf-40d9-9436-3ad88c54ebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:38.461508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b616103-49cf-40d9-9436-3ad88c54ebd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:38.462240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b616103-49cf-40d9-9436-3ad88c54ebd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:38.462555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b616103-49cf-40d9-9436-3ad88c54ebd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:38.463919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b616103-49cf-40d9-9436-3ad88c54ebd1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:38.467837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728862ca-aa08-4fd1-9db7-858414b327d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:38.469518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728862ca-aa08-4fd1-9db7-858414b327d0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:38.481052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 473/944] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:38.481052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536c178-3bb7-4d08-be11-80fb6e71d85a None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:38.481052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536c178-3bb7-4d08-be11-80fb6e71d85a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:38.481052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536c178-3bb7-4d08-be11-80fb6e71d85a None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:38.481052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 474/945] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:38.483871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536c178-3bb7-4d08-be11-80fb6e71d85a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-728862ca-aa08-4fd1-9db7-858414b327d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:38.491373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:38.492253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:38.493173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:38.493173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:38.493173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:38.493173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:38.493173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:38.493173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:38.493173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:38.493173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:38.493921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 472/946] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:38.495389 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bd925-a67e-4d1b-9ecc-29765d4bc716 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:38.495681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bd925-a67e-4d1b-9ecc-29765d4bc716 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:38.495960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bd925-a67e-4d1b-9ecc-29765d4bc716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:38.513679 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1a6bd925-a67e-4d1b-9ecc-29765d4bc716 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:38.515251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1a6bd925-a67e-4d1b-9ecc-29765d4bc716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:38.599027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536c178-3bb7-4d08-be11-80fb6e71d85a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:38.604992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 473/947] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:38.605765 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bd925-a67e-4d1b-9ecc-29765d4bc716 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:38.627800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:38.638736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407153ba-20c6-453e-8011-12510224b6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:38.639828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407153ba-20c6-453e-8011-12510224b6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:38.640115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407153ba-20c6-453e-8011-12510224b6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:38.640392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407153ba-20c6-453e-8011-12510224b6a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:38.649929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407153ba-20c6-453e-8011-12510224b6a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:38.651372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407153ba-20c6-453e-8011-12510224b6a9 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-407153ba-20c6-453e-8011-12510224b6a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:38.670551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:38.671476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:38.672383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:38.672383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:38.672383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:38.672383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:38.672383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:38.672383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:38.672383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:38.672383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:38.672856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 475/948] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:38.673438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407153ba-20c6-453e-8011-12510224b6a9 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:38.716604 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:38.720518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bd925-a67e-4d1b-9ecc-29765d4bc716 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:38.757387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df129b3-178f-4abb-9cd4-ef444c2cf0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:38.758063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df129b3-178f-4abb-9cd4-ef444c2cf0ff None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:38.758351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df129b3-178f-4abb-9cd4-ef444c2cf0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:38.758631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df129b3-178f-4abb-9cd4-ef444c2cf0ff None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:38.759399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df129b3-178f-4abb-9cd4-ef444c2cf0ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:38.759711 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df129b3-178f-4abb-9cd4-ef444c2cf0ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:38.761197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df129b3-178f-4abb-9cd4-ef444c2cf0ff None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:38.784789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 474/949] 10.222.0.39 () {56 vars in 1112 bytes} [Thu May 26 12:19:38 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:38.784789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df129b3-178f-4abb-9cd4-ef444c2cf0ff None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:38.792059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407153ba-20c6-453e-8011-12510224b6a9 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:38.832989 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68524f-67fa-4aa8-a942-a926e2bd3e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:38.833936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68524f-67fa-4aa8-a942-a926e2bd3e1a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:38.834332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68524f-67fa-4aa8-a942-a926e2bd3e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:38.834687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68524f-67fa-4aa8-a942-a926e2bd3e1a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:38.836069 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68524f-67fa-4aa8-a942-a926e2bd3e1a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:38.836966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68524f-67fa-4aa8-a942-a926e2bd3e1a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-fb68524f-67fa-4aa8-a942-a926e2bd3e1a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:38.851091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:38.852136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:38.853026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:38.857319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 476/950] 10.222.0.39 () {56 vars in 1126 bytes} [Thu May 26 12:19:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:38.859036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68524f-67fa-4aa8-a942-a926e2bd3e1a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:38.924145 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df129b3-178f-4abb-9cd4-ef444c2cf0ff None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:38.936951 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:38.979309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f4e53-6c67-40bf-8f35-a4addaca56cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:38.980145 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4e53-6c67-40bf-8f35-a4addaca56cc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:38.980634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4e53-6c67-40bf-8f35-a4addaca56cc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:38.981169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4e53-6c67-40bf-8f35-a4addaca56cc None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:38.982493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f4e53-6c67-40bf-8f35-a4addaca56cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:38.983800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f4e53-6c67-40bf-8f35-a4addaca56cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:38.985323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f4e53-6c67-40bf-8f35-a4addaca56cc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:39.001818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 475/951] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:39.003376 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68524f-67fa-4aa8-a942-a926e2bd3e1a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:39.009717 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f4e53-6c67-40bf-8f35-a4addaca56cc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:39.035072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:39.055088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13d5c6-97f8-47cc-846f-62462725b77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:39.056181 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13d5c6-97f8-47cc-846f-62462725b77b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:39.056181 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13d5c6-97f8-47cc-846f-62462725b77b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:39.056382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13d5c6-97f8-47cc-846f-62462725b77b None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:39.057064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13d5c6-97f8-47cc-846f-62462725b77b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:39.057379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13d5c6-97f8-47cc-846f-62462725b77b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:39.058758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13d5c6-97f8-47cc-846f-62462725b77b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:39.064824 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 477/952] 10.222.0.39 () {56 vars in 1122 bytes} [Thu May 26 12:19:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:39.070694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13d5c6-97f8-47cc-846f-62462725b77b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:39.139791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f4e53-6c67-40bf-8f35-a4addaca56cc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:39.180435 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40960bd-1024-4a34-a543-f0e2020e7cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:39.181385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40960bd-1024-4a34-a543-f0e2020e7cce None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:39.181663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40960bd-1024-4a34-a543-f0e2020e7cce None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:39.181966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40960bd-1024-4a34-a543-f0e2020e7cce None admin] PATH_INFO: `/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/bc48f3a3998b4c5ab199181005f9a5d7/roles/c130ba76816741e29f2e2a913e37b50c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:39.185117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40960bd-1024-4a34-a543-f0e2020e7cce None admin] RBAC: Authorizing `identity:create_grant(project_id=b341d104240e4b4cb61d365e8167f6a8, user_id=bc48f3a3998b4c5ab199181005f9a5d7, role_id=c130ba76816741e29f2e2a913e37b50c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:39.187056 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40960bd-1024-4a34-a543-f0e2020e7cce None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:39.194034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13d5c6-97f8-47cc-846f-62462725b77b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:39.205757 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 476/953] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:19:39 2022] PUT /identity/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/bc48f3a3998b4c5ab199181005f9a5d7/roles/c130ba76816741e29f2e2a913e37b50c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:19:39.214823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:39.254366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc34e0f-cb02-47d3-b4a7-928be587477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:39.255098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc34e0f-cb02-47d3-b4a7-928be587477e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:39.255423 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc34e0f-cb02-47d3-b4a7-928be587477e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:39.255742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc34e0f-cb02-47d3-b4a7-928be587477e None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:39.257025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc34e0f-cb02-47d3-b4a7-928be587477e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:39.257624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc34e0f-cb02-47d3-b4a7-928be587477e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:39.259288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc34e0f-cb02-47d3-b4a7-928be587477e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:39.266012 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 478/954] 10.222.0.39 () {56 vars in 1122 bytes} [Thu May 26 12:19:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:39.273063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40960bd-1024-4a34-a543-f0e2020e7cce None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:39.333772 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f5d4b-5ac5-4264-9fb4-88d4a6d7498d None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:39.334619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f5d4b-5ac5-4264-9fb4-88d4a6d7498d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:39.335217 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f5d4b-5ac5-4264-9fb4-88d4a6d7498d None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:39.337467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 479/955] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:39.343064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6790e-4a23-42c5-9a21-f4df8b487ffa None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:39.343396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6790e-4a23-42c5-9a21-f4df8b487ffa None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:39.343691 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6790e-4a23-42c5-9a21-f4df8b487ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:39.362686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ecd6790e-4a23-42c5-9a21-f4df8b487ffa None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:39.363904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ecd6790e-4a23-42c5-9a21-f4df8b487ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:39.373174 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:39.393837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40960bd-1024-4a34-a543-f0e2020e7cce None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:39.438702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c393f1b-22c8-4437-9e71-882eaea57291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:39.439346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c393f1b-22c8-4437-9e71-882eaea57291 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:39.439642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c393f1b-22c8-4437-9e71-882eaea57291 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:39.439923 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c393f1b-22c8-4437-9e71-882eaea57291 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:39.440688 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c393f1b-22c8-4437-9e71-882eaea57291 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:39.442244 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c393f1b-22c8-4437-9e71-882eaea57291 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:39.445783 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 480/956] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:39.467562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 477/957] 10.222.0.39 () {60 vars in 1144 bytes} [Thu May 26 12:19:39 2022] POST /identity/v3/endpoints => generated 349 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:19:39.467770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6790e-4a23-42c5-9a21-f4df8b487ffa None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:39.587454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6790e-4a23-42c5-9a21-f4df8b487ffa None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:39.601088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:39.635857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39a67d-6479-49bb-aacd-78e981df63ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:39.636677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39a67d-6479-49bb-aacd-78e981df63ba None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:39.636990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39a67d-6479-49bb-aacd-78e981df63ba None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:39.637263 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39a67d-6479-49bb-aacd-78e981df63ba None admin] PATH_INFO: `/v3/services/compute` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:39.637925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39a67d-6479-49bb-aacd-78e981df63ba None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:39.639347 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39a67d-6479-49bb-aacd-78e981df63ba None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0b39a67d-6479-49bb-aacd-78e981df63ba None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:39.653119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:39.654345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:39.655246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 481/958] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:39.660773 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c393f1b-22c8-4437-9e71-882eaea57291 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:39.772488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c393f1b-22c8-4437-9e71-882eaea57291 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:39.807920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687a5a1-7dbf-4982-a1d1-897fff8ed27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:39.808626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687a5a1-7dbf-4982-a1d1-897fff8ed27f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:39.808947 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687a5a1-7dbf-4982-a1d1-897fff8ed27f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:39.809224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687a5a1-7dbf-4982-a1d1-897fff8ed27f None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:39.809946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687a5a1-7dbf-4982-a1d1-897fff8ed27f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:39.810256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687a5a1-7dbf-4982-a1d1-897fff8ed27f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:39.811630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687a5a1-7dbf-4982-a1d1-897fff8ed27f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:39.813669 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:39.818448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 478/959] 10.222.0.39 () {56 vars in 1112 bytes} [Thu May 26 12:19:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:39.826404 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39a67d-6479-49bb-aacd-78e981df63ba None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:39.939712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39a67d-6479-49bb-aacd-78e981df63ba None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:39.974581 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87347d-65f5-428c-a02d-3877c44191c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:39.975619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87347d-65f5-428c-a02d-3877c44191c1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:39.975866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87347d-65f5-428c-a02d-3877c44191c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:39.976175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87347d-65f5-428c-a02d-3877c44191c1 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:39.976876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87347d-65f5-428c-a02d-3877c44191c1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:39.977185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87347d-65f5-428c-a02d-3877c44191c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:39.978542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87347d-65f5-428c-a02d-3877c44191c1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:39.983614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 482/960] 10.222.0.39 () {56 vars in 1112 bytes} [Thu May 26 12:19:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:41.182009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f40c98-bc9f-406e-acb3-a0cffa21cf4b None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:41.182516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f40c98-bc9f-406e-acb3-a0cffa21cf4b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:41.182516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f40c98-bc9f-406e-acb3-a0cffa21cf4b None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:41.184149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 479/961] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:41.189833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ca164-e4b6-4c6f-87fb-12d5c93b7d35 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:41.190276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ca164-e4b6-4c6f-87fb-12d5c93b7d35 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:41.190367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ca164-e4b6-4c6f-87fb-12d5c93b7d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:41.208054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-156ca164-e4b6-4c6f-87fb-12d5c93b7d35 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:41.209341 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-156ca164-e4b6-4c6f-87fb-12d5c93b7d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:41.238046 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:41.281689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 483/962] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:41.309939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f40c98-bc9f-406e-acb3-a0cffa21cf4b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:41.424748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f40c98-bc9f-406e-acb3-a0cffa21cf4b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:41.460189 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c502e-dc63-4fc6-83cc-14ef18577ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:41.460890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c502e-dc63-4fc6-83cc-14ef18577ce7 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:41.461176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c502e-dc63-4fc6-83cc-14ef18577ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:41.461512 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c502e-dc63-4fc6-83cc-14ef18577ce7 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:41.462233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c502e-dc63-4fc6-83cc-14ef18577ce7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:41.463725 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c502e-dc63-4fc6-83cc-14ef18577ce7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:41.477709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.sql.core [None req-210c502e-dc63-4fc6-83cc-14ef18577ce7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:19:41.477709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 12:19:41.477709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [parameters: {'user_id': 'da6dd1e6802a49bbb03aab7ba35996e7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 12:19:41.477709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80141) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-210c502e-dc63-4fc6-83cc-14ef18577ce7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application conn.query(q) May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application result.read() May 26 12:19:41.485359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:19:41.486206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application next(self.gen) May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application yield resource May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application next(self.gen) May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise self.value May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application session.commit() May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:19:41.487156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.session.flush() May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application compat.raise_( May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:19:41.488057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:19:41.489935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application conn.query(q) May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application result.read() May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:19:41.492991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [parameters: {'user_id': 'da6dd1e6802a49bbb03aab7ba35996e7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:41.494946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 12:19:41.497298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 12:19:41.498319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 12:19:41.498319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 12:19:41.498319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:19:41.498319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:19:41.498319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 12:19:41.498319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:41.498319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 480/963] 10.222.0.39 () {60 vars in 1131 bytes} [Thu May 26 12:19:41 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:41.498717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ca164-e4b6-4c6f-87fb-12d5c93b7d35 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:41.599004 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ca164-e4b6-4c6f-87fb-12d5c93b7d35 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:41.605106 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd953a-a5b8-427f-b717-67aa05379e2b None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:41.605742 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd953a-a5b8-427f-b717-67aa05379e2b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:41.606237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd953a-a5b8-427f-b717-67aa05379e2b None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:41.610881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 481/964] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:41.618653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c535e5f-42fa-40ca-83ec-c3c41b4fb956 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:41.618977 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c535e5f-42fa-40ca-83ec-c3c41b4fb956 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:41.619203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c535e5f-42fa-40ca-83ec-c3c41b4fb956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:41.640131 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6c535e5f-42fa-40ca-83ec-c3c41b4fb956 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:41.641774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6c535e5f-42fa-40ca-83ec-c3c41b4fb956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:41.647307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f16f6-0d01-4c8e-858f-c2a97fb1345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:41.648493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f16f6-0d01-4c8e-858f-c2a97fb1345c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:41.649027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f16f6-0d01-4c8e-858f-c2a97fb1345c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:41.649519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f16f6-0d01-4c8e-858f-c2a97fb1345c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:41.659627 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f16f6-0d01-4c8e-858f-c2a97fb1345c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:41.661105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f16f6-0d01-4c8e-858f-c2a97fb1345c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-599f16f6-0d01-4c8e-858f-c2a97fb1345c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:41.676922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:41.678130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:41.684302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:41.684302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:41.684302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:41.684302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:41.684302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:41.684302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:41.684302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:41.684302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:41.684302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:19:41.684302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:41.684302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 484/965] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:19:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:41.686747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f16f6-0d01-4c8e-858f-c2a97fb1345c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:41.714849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:41.719052 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:41.736906 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 482/966] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:41.757950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c535e5f-42fa-40ca-83ec-c3c41b4fb956 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:41.816593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f16f6-0d01-4c8e-858f-c2a97fb1345c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:41.854078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9fd4d-d451-4509-bc2e-e35ddd25edff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:41.854762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9fd4d-d451-4509-bc2e-e35ddd25edff None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:41.855047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9fd4d-d451-4509-bc2e-e35ddd25edff None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:41.855327 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9fd4d-d451-4509-bc2e-e35ddd25edff None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:41.856150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9fd4d-d451-4509-bc2e-e35ddd25edff None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:41.856462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9fd4d-d451-4509-bc2e-e35ddd25edff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:41.857949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9fd4d-d451-4509-bc2e-e35ddd25edff None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:41.870944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c535e5f-42fa-40ca-83ec-c3c41b4fb956 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:41.903516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 485/967] 10.222.0.39 () {56 vars in 1101 bytes} [Thu May 26 12:19:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:41.903516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89037a17-9ca6-4aed-af22-ae3fcfaff8e3 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:41.903516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89037a17-9ca6-4aed-af22-ae3fcfaff8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:41.903516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89037a17-9ca6-4aed-af22-ae3fcfaff8e3 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:41.903516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 486/968] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:41.905473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434528a-e347-40f3-92f3-0e036e35e978 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:41.905769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434528a-e347-40f3-92f3-0e036e35e978 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:41.906047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434528a-e347-40f3-92f3-0e036e35e978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:41.923336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc35243-3f43-4104-9ab5-870528eef62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:41.924400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc35243-3f43-4104-9ab5-870528eef62d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:41.924796 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc35243-3f43-4104-9ab5-870528eef62d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:41.925198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc35243-3f43-4104-9ab5-870528eef62d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:41.925301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3434528a-e347-40f3-92f3-0e036e35e978 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:41.926489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3434528a-e347-40f3-92f3-0e036e35e978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:41.939085 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc35243-3f43-4104-9ab5-870528eef62d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-1dc35243-3f43-4104-9ab5-870528eef62d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:41.949458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:41.950486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:41.951358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:41.951358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:41.951358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:41.951358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:41.951358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:41.951358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:41.951358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:41.951358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:41.951358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:41.951358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:41.951358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:19:41.951358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:41.951358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 483/969] 10.222.0.39 () {56 vars in 1120 bytes} [Thu May 26 12:19:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:41.958667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc35243-3f43-4104-9ab5-870528eef62d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:42.017935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 487/970] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:42.034919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:42.042515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434528a-e347-40f3-92f3-0e036e35e978 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:42.062427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:42.097077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc35243-3f43-4104-9ab5-870528eef62d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:42.149599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24da71-a4e9-4470-bfa2-c30874c0bf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:42.150699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24da71-a4e9-4470-bfa2-c30874c0bf48 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:42.150984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24da71-a4e9-4470-bfa2-c30874c0bf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:42.151259 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24da71-a4e9-4470-bfa2-c30874c0bf48 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:42.152055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24da71-a4e9-4470-bfa2-c30874c0bf48 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:42.152369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24da71-a4e9-4470-bfa2-c30874c0bf48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:42.154803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c24da71-a4e9-4470-bfa2-c30874c0bf48 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:42.170344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 484/971] 10.222.0.39 () {56 vars in 1115 bytes} [Thu May 26 12:19:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:42.171876 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24da71-a4e9-4470-bfa2-c30874c0bf48 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:42.188942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434528a-e347-40f3-92f3-0e036e35e978 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:42.235195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f5124-ef75-482b-b4e6-3f94c6080d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:42.236130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f5124-ef75-482b-b4e6-3f94c6080d50 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:42.236479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f5124-ef75-482b-b4e6-3f94c6080d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:42.236908 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f5124-ef75-482b-b4e6-3f94c6080d50 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:42.237936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f5124-ef75-482b-b4e6-3f94c6080d50 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:42.239035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f5124-ef75-482b-b4e6-3f94c6080d50 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b53f5124-ef75-482b-b4e6-3f94c6080d50 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:42.255183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:42.256925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:42.257846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:42.260802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 488/972] 10.222.0.39 () {56 vars in 1126 bytes} [Thu May 26 12:19:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:42.263223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f5124-ef75-482b-b4e6-3f94c6080d50 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:42.294999 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24da71-a4e9-4470-bfa2-c30874c0bf48 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:42.310421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:42.332028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a6f9e-aa62-469f-9a0a-4047a6dae6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:42.332868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a6f9e-aa62-469f-9a0a-4047a6dae6af None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:42.333155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a6f9e-aa62-469f-9a0a-4047a6dae6af None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:42.333449 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a6f9e-aa62-469f-9a0a-4047a6dae6af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:42.345639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a6f9e-aa62-469f-9a0a-4047a6dae6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:42.347104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a6f9e-aa62-469f-9a0a-4047a6dae6af None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:42.353220 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-a86a6f9e-aa62-469f-9a0a-4047a6dae6af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:42.364901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:42.366599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:42.367543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:42.367543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:42.367543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:42.367543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:42.367543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 485/973] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:42.368004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5db41c-08e9-4035-a46f-bef291a5c9da None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:42.368233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5db41c-08e9-4035-a46f-bef291a5c9da None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:42.368438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5db41c-08e9-4035-a46f-bef291a5c9da None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:42.369891 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 486/974] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:42.372275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5db41c-08e9-4035-a46f-bef291a5c9da None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:42.380340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f5124-ef75-482b-b4e6-3f94c6080d50 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:42.415283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de388a-b388-4c09-862b-bb9e8f824475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:42.415975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de388a-b388-4c09-862b-bb9e8f824475 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:42.416259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de388a-b388-4c09-862b-bb9e8f824475 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:42.416538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de388a-b388-4c09-862b-bb9e8f824475 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:42.417281 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de388a-b388-4c09-862b-bb9e8f824475 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:42.417588 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de388a-b388-4c09-862b-bb9e8f824475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:42.418947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de388a-b388-4c09-862b-bb9e8f824475 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:42.423540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 489/975] 10.222.0.39 () {56 vars in 1122 bytes} [Thu May 26 12:19:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:42.424693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf9477-1045-4291-b92c-cc85208249b7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:42.425009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf9477-1045-4291-b92c-cc85208249b7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:42.425289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf9477-1045-4291-b92c-cc85208249b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:42.441557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3ebf9477-1045-4291-b92c-cc85208249b7 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:42.442731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3ebf9477-1045-4291-b92c-cc85208249b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:42.474605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5db41c-08e9-4035-a46f-bef291a5c9da None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:42.509009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 490/976] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:42.509839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf9477-1045-4291-b92c-cc85208249b7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:42.513451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67270028-7234-4567-a2f0-2ddeb7043381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:42.514227 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67270028-7234-4567-a2f0-2ddeb7043381 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:42.514520 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67270028-7234-4567-a2f0-2ddeb7043381 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:42.514799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67270028-7234-4567-a2f0-2ddeb7043381 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:42.515524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67270028-7234-4567-a2f0-2ddeb7043381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:42.515838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67270028-7234-4567-a2f0-2ddeb7043381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:42.517257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67270028-7234-4567-a2f0-2ddeb7043381 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:42.533524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 487/977] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:42.533524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67270028-7234-4567-a2f0-2ddeb7043381 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:42.559727 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:42.587319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:42.618299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf9477-1045-4291-b92c-cc85208249b7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:42.631723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67270028-7234-4567-a2f0-2ddeb7043381 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:42.653083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb6e01-4d40-4507-8042-4f2a4f92ad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:42.653753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb6e01-4d40-4507-8042-4f2a4f92ad51 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:42.654042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb6e01-4d40-4507-8042-4f2a4f92ad51 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:42.654327 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb6e01-4d40-4507-8042-4f2a4f92ad51 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:42.655038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb6e01-4d40-4507-8042-4f2a4f92ad51 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:42.655355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb6e01-4d40-4507-8042-4f2a4f92ad51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:42.656747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb6e01-4d40-4507-8042-4f2a4f92ad51 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:42.661782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 491/978] 10.222.0.39 () {56 vars in 1122 bytes} [Thu May 26 12:19:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:42.662611 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb6e01-4d40-4507-8042-4f2a4f92ad51 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:42.665706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab408dc-d799-40f9-bb5a-b56fe0ea1fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:42.666378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab408dc-d799-40f9-bb5a-b56fe0ea1fa2 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:42.666756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab408dc-d799-40f9-bb5a-b56fe0ea1fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:42.667047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab408dc-d799-40f9-bb5a-b56fe0ea1fa2 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:42.667824 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab408dc-d799-40f9-bb5a-b56fe0ea1fa2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:42.669230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab408dc-d799-40f9-bb5a-b56fe0ea1fa2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:42.683833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 488/979] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:19:42 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:19:42.683833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab408dc-d799-40f9-bb5a-b56fe0ea1fa2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:42.781494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb6e01-4d40-4507-8042-4f2a4f92ad51 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:42.789658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:42.817227 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab408dc-d799-40f9-bb5a-b56fe0ea1fa2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:42.828967 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5bb1e-7660-4651-9e0c-ffbdb356bdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:42.829860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5bb1e-7660-4651-9e0c-ffbdb356bdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:42.830146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5bb1e-7660-4651-9e0c-ffbdb356bdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:42.830418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5bb1e-7660-4651-9e0c-ffbdb356bdb6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:42.832889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:42.841031 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5bb1e-7660-4651-9e0c-ffbdb356bdb6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:42.842907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5bb1e-7660-4651-9e0c-ffbdb356bdb6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:42.857787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09cdcf-0c80-4285-acbb-89e63a3eaad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:42.858462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09cdcf-0c80-4285-acbb-89e63a3eaad0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:42.858746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09cdcf-0c80-4285-acbb-89e63a3eaad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:42.859024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09cdcf-0c80-4285-acbb-89e63a3eaad0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:42.859840 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09cdcf-0c80-4285-acbb-89e63a3eaad0 None admin] RBAC: Adding query filter params (interface=admin, service_id=78a8f240719f4315a0750f8882c5bdbe, region_id=RegionOne) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-cff5bb1e-7660-4651-9e0c-ffbdb356bdb6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:42.860029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:42.860946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:42.868073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:42.868073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:42.868073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:42.868073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:42.868073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:42.868073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:42.868073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:42.868073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:42.868073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:19:42.868073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:42.868784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09cdcf-0c80-4285-acbb-89e63a3eaad0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:42.868784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09cdcf-0c80-4285-acbb-89e63a3eaad0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:42.868948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 492/980] 10.222.0.39 () {56 vars in 1117 bytes} [Thu May 26 12:19:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:42.868948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5bb1e-7660-4651-9e0c-ffbdb356bdb6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:42.877552 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 489/981] 10.222.0.39 () {56 vars in 1249 bytes} [Thu May 26 12:19:42 2022] GET /identity/v3/endpoints?service_id=78a8f240719f4315a0750f8882c5bdbe&interface=admin®ion_id=RegionOne => generated 193 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:42.880554 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09cdcf-0c80-4285-acbb-89e63a3eaad0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:42.985933 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5bb1e-7660-4651-9e0c-ffbdb356bdb6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:42.988842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09cdcf-0c80-4285-acbb-89e63a3eaad0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:43.023954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95b9fd-34cc-476e-a53d-6c2d0a9918b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:43.024774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95b9fd-34cc-476e-a53d-6c2d0a9918b2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:43.025073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95b9fd-34cc-476e-a53d-6c2d0a9918b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:43.025452 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95b9fd-34cc-476e-a53d-6c2d0a9918b2 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:43.026408 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95b9fd-34cc-476e-a53d-6c2d0a9918b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:43.026727 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95b9fd-34cc-476e-a53d-6c2d0a9918b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:43.027775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38852b8d-c782-49b7-937f-2c6455242cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:43.028276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95b9fd-34cc-476e-a53d-6c2d0a9918b2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:43.028441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38852b8d-c782-49b7-937f-2c6455242cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:43.028738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38852b8d-c782-49b7-937f-2c6455242cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:43.029022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38852b8d-c782-49b7-937f-2c6455242cf3 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:43.029714 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38852b8d-c782-49b7-937f-2c6455242cf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:43.031076 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38852b8d-c782-49b7-937f-2c6455242cf3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:43.045152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 490/982] 10.222.0.39 () {56 vars in 1087 bytes} [Thu May 26 12:19:42 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:19:43.047817 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 493/983] 10.222.0.39 () {56 vars in 1149 bytes} [Thu May 26 12:19:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:43.053671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38852b8d-c782-49b7-937f-2c6455242cf3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:43.069453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:43.167797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38852b8d-c782-49b7-937f-2c6455242cf3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:43.206647 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dcf93-26cf-49d0-9514-f17ecb03453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:43.207317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dcf93-26cf-49d0-9514-f17ecb03453c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:43.207596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dcf93-26cf-49d0-9514-f17ecb03453c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:43.207866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dcf93-26cf-49d0-9514-f17ecb03453c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:43.280291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dcf93-26cf-49d0-9514-f17ecb03453c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:43.281823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dcf93-26cf-49d0-9514-f17ecb03453c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:43.297688 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:43.389157 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 491/984] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:43 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:19:43.394551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95b9fd-34cc-476e-a53d-6c2d0a9918b2 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:43.451718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:43.501252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95b9fd-34cc-476e-a53d-6c2d0a9918b2 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:43.536817 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20786cd-39fa-4786-a414-f4be2945ed37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:43.538174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20786cd-39fa-4786-a414-f4be2945ed37 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:43.538650 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20786cd-39fa-4786-a414-f4be2945ed37 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:43.538929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20786cd-39fa-4786-a414-f4be2945ed37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:43.549598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20786cd-39fa-4786-a414-f4be2945ed37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:43.551040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20786cd-39fa-4786-a414-f4be2945ed37 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-f20786cd-39fa-4786-a414-f4be2945ed37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:43.569439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:43.570340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:43.571269 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:43.571269 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:43.571269 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:43.571269 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:43.573028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 494/985] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:43.576154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dcf93-26cf-49d0-9514-f17ecb03453c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:43.681181 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dcf93-26cf-49d0-9514-f17ecb03453c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:43.691453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:43.717754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6df4f8-4ddc-46d9-9fd1-38d5dcf712b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:43.718418 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6df4f8-4ddc-46d9-9fd1-38d5dcf712b3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:43.718698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6df4f8-4ddc-46d9-9fd1-38d5dcf712b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:43.718969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6df4f8-4ddc-46d9-9fd1-38d5dcf712b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:43.719682 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6df4f8-4ddc-46d9-9fd1-38d5dcf712b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:43.719984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6df4f8-4ddc-46d9-9fd1-38d5dcf712b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:43.721372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6df4f8-4ddc-46d9-9fd1-38d5dcf712b3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:43.737798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 492/986] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:43.739095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20786cd-39fa-4786-a414-f4be2945ed37 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:43.844876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20786cd-39fa-4786-a414-f4be2945ed37 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:43.847279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:43.888294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b026359-b4a0-421f-af33-24fbabe6d7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:43.889127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b026359-b4a0-421f-af33-24fbabe6d7bf None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:43.889409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b026359-b4a0-421f-af33-24fbabe6d7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:43.889746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b026359-b4a0-421f-af33-24fbabe6d7bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:43.897650 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b026359-b4a0-421f-af33-24fbabe6d7bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:43.899421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b026359-b4a0-421f-af33-24fbabe6d7bf None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-2b026359-b4a0-421f-af33-24fbabe6d7bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:43.914050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:43.914966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:43.916011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:43.916011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:43.916011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:43.916011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:43.916011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:43.916011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:43.916011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:43.916011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:43.916011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 495/987] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:43.920944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6df4f8-4ddc-46d9-9fd1-38d5dcf712b3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:44.024408 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6df4f8-4ddc-46d9-9fd1-38d5dcf712b3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:44.062642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6491273-745b-4d52-8ba7-6021ee948127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:44.063311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6491273-745b-4d52-8ba7-6021ee948127 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:44.063597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6491273-745b-4d52-8ba7-6021ee948127 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:44.063876 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6491273-745b-4d52-8ba7-6021ee948127 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:44.064666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6491273-745b-4d52-8ba7-6021ee948127 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:44.065013 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6491273-745b-4d52-8ba7-6021ee948127 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:44.066448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6491273-745b-4d52-8ba7-6021ee948127 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:44.079266 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 493/988] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:44.085749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b026359-b4a0-421f-af33-24fbabe6d7bf None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:44.192037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b026359-b4a0-421f-af33-24fbabe6d7bf None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:44.226809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255c646-0726-45d8-b5b3-8f49dd81ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:44.227477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c646-0726-45d8-b5b3-8f49dd81ec09 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:44.227765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c646-0726-45d8-b5b3-8f49dd81ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:44.228048 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255c646-0726-45d8-b5b3-8f49dd81ec09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:44.228922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255c646-0726-45d8-b5b3-8f49dd81ec09 None admin] RBAC: Adding query filter params (role.id=c130ba76816741e29f2e2a913e37b50c, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=bc48f3a3998b4c5ab199181005f9a5d7) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:44.229245 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255c646-0726-45d8-b5b3-8f49dd81ec09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:44.230695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255c646-0726-45d8-b5b3-8f49dd81ec09 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:44.244806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 496/989] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:44 2022] GET /identity/v3/role_assignments?user.id=bc48f3a3998b4c5ab199181005f9a5d7&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=c130ba76816741e29f2e2a913e37b50c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:44.951263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2175bdd-cc48-48d9-8be5-ddc03cbe02b2 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:44.951770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2175bdd-cc48-48d9-8be5-ddc03cbe02b2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:44.951870 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2175bdd-cc48-48d9-8be5-ddc03cbe02b2 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:44.953380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 494/990] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:44.958239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d81d14-9f96-4dd1-8467-222a572990eb None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:44.958613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d81d14-9f96-4dd1-8467-222a572990eb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:44.958790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d81d14-9f96-4dd1-8467-222a572990eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:44.976627 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-94d81d14-9f96-4dd1-8467-222a572990eb None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:44.977840 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-94d81d14-9f96-4dd1-8467-222a572990eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:45.002156 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:45.049662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 497/991] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:45.072611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2175bdd-cc48-48d9-8be5-ddc03cbe02b2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:45.108473 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:45.183177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2175bdd-cc48-48d9-8be5-ddc03cbe02b2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:45.216924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f669ab1-d12b-4370-b1e6-91f60d71e104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:45.217716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f669ab1-d12b-4370-b1e6-91f60d71e104 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:45.218001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f669ab1-d12b-4370-b1e6-91f60d71e104 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:45.218281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f669ab1-d12b-4370-b1e6-91f60d71e104 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:45.218932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f669ab1-d12b-4370-b1e6-91f60d71e104 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:45.220309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f669ab1-d12b-4370-b1e6-91f60d71e104 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-2f669ab1-d12b-4370-b1e6-91f60d71e104 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:45.231820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:45.232827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:45.233692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 495/992] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:45.239095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d81d14-9f96-4dd1-8467-222a572990eb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:45.277731 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d0984-6347-4044-b689-03874b2d6618 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:45.278028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d0984-6347-4044-b689-03874b2d6618 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:45.278300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d0984-6347-4044-b689-03874b2d6618 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:45.279694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 496/993] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:45.284638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e5ddc-9011-4be2-8d8e-a99c3c632986 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:45.284966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e5ddc-9011-4be2-8d8e-a99c3c632986 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:45.285253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e5ddc-9011-4be2-8d8e-a99c3c632986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:45.303338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ad3e5ddc-9011-4be2-8d8e-a99c3c632986 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:45.304378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ad3e5ddc-9011-4be2-8d8e-a99c3c632986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:45.347057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d81d14-9f96-4dd1-8467-222a572990eb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:45.380375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 497/994] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:45.388484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5126e-7138-45c9-96a7-37c87f8d1042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:45.389241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5126e-7138-45c9-96a7-37c87f8d1042 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:45.389535 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5126e-7138-45c9-96a7-37c87f8d1042 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:45.389811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5126e-7138-45c9-96a7-37c87f8d1042 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:45.390527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5126e-7138-45c9-96a7-37c87f8d1042 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:45.390861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5126e-7138-45c9-96a7-37c87f8d1042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:45.392231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5126e-7138-45c9-96a7-37c87f8d1042 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:45.401068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 498/995] 10.222.0.39 () {56 vars in 1112 bytes} [Thu May 26 12:19:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:45.403599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e5ddc-9011-4be2-8d8e-a99c3c632986 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:45.406124 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5126e-7138-45c9-96a7-37c87f8d1042 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:45.434690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:45.434870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:45.515944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5126e-7138-45c9-96a7-37c87f8d1042 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:45.522897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e5ddc-9011-4be2-8d8e-a99c3c632986 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:45.554135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26070b2b-09c0-4027-8f24-e3ca749490c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:45.555284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26070b2b-09c0-4027-8f24-e3ca749490c6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:45.555766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26070b2b-09c0-4027-8f24-e3ca749490c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:45.556221 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26070b2b-09c0-4027-8f24-e3ca749490c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:45.557088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26070b2b-09c0-4027-8f24-e3ca749490c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:45.558402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072213f-6156-418b-ba70-fa5687905858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:45.558937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26070b2b-09c0-4027-8f24-e3ca749490c6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:45.559046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072213f-6156-418b-ba70-fa5687905858 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:45.559338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072213f-6156-418b-ba70-fa5687905858 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:45.559618 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072213f-6156-418b-ba70-fa5687905858 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:45.560326 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072213f-6156-418b-ba70-fa5687905858 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:45.560633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072213f-6156-418b-ba70-fa5687905858 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:45.562076 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072213f-6156-418b-ba70-fa5687905858 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:45.567189 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 498/996] 10.222.0.39 () {56 vars in 1112 bytes} [Thu May 26 12:19:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:45.573555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072213f-6156-418b-ba70-fa5687905858 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-26070b2b-09c0-4027-8f24-e3ca749490c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:45.574062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:45.575007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:19:45.575851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:45.578392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 499/997] 10.222.0.39 () {56 vars in 1126 bytes} [Thu May 26 12:19:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:45.583887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26070b2b-09c0-4027-8f24-e3ca749490c6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:45.663761 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:45.675648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:45.676734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072213f-6156-418b-ba70-fa5687905858 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:45.694736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26070b2b-09c0-4027-8f24-e3ca749490c6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:45.713510 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4872bb-9045-48e1-8e9c-e66496e3f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:45.714186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4872bb-9045-48e1-8e9c-e66496e3f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:45.714475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4872bb-9045-48e1-8e9c-e66496e3f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:45.714761 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4872bb-9045-48e1-8e9c-e66496e3f3d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:45.715565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4872bb-9045-48e1-8e9c-e66496e3f3d2 None admin] RBAC: Adding query filter params (interface=public, service_id=804255d87bee4b938a49d95a79136ce1, region_id=RegionOne) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:45.715885 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4872bb-9045-48e1-8e9c-e66496e3f3d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:45.717332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4872bb-9045-48e1-8e9c-e66496e3f3d2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:45.730459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 499/998] 10.222.0.39 () {56 vars in 1251 bytes} [Thu May 26 12:19:45 2022] GET /identity/v3/endpoints?service_id=804255d87bee4b938a49d95a79136ce1&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:45.732223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4872bb-9045-48e1-8e9c-e66496e3f3d2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:45.738015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c859d5f-4ea2-481f-892d-24e6a44d8710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:45.738709 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c859d5f-4ea2-481f-892d-24e6a44d8710 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:45.739000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c859d5f-4ea2-481f-892d-24e6a44d8710 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:45.739285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c859d5f-4ea2-481f-892d-24e6a44d8710 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:45.740015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c859d5f-4ea2-481f-892d-24e6a44d8710 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:45.740334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c859d5f-4ea2-481f-892d-24e6a44d8710 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:45.741811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c859d5f-4ea2-481f-892d-24e6a44d8710 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:45.751492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 500/999] 10.222.0.39 () {56 vars in 1122 bytes} [Thu May 26 12:19:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:45.753646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c859d5f-4ea2-481f-892d-24e6a44d8710 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:45.851677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4872bb-9045-48e1-8e9c-e66496e3f3d2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:45.861552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c859d5f-4ea2-481f-892d-24e6a44d8710 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:45.893628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362dd32-edc9-47c3-b560-fd7d2f2e353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:45.894299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362dd32-edc9-47c3-b560-fd7d2f2e353f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:45.894579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362dd32-edc9-47c3-b560-fd7d2f2e353f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:45.894855 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362dd32-edc9-47c3-b560-fd7d2f2e353f None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:45.895794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362dd32-edc9-47c3-b560-fd7d2f2e353f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:45.897218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362dd32-edc9-47c3-b560-fd7d2f2e353f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:45.903262 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bac587-2075-4b52-b90a-c9ab6eaea3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:45.903813 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 500/1000] 10.222.0.39 () {56 vars in 1087 bytes} [Thu May 26 12:19:45 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:19:45.905064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bac587-2075-4b52-b90a-c9ab6eaea3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:45.905356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bac587-2075-4b52-b90a-c9ab6eaea3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:45.905630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bac587-2075-4b52-b90a-c9ab6eaea3f8 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:45.906357 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bac587-2075-4b52-b90a-c9ab6eaea3f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:45.906668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bac587-2075-4b52-b90a-c9ab6eaea3f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:45.908066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bac587-2075-4b52-b90a-c9ab6eaea3f8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:45.914725 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 501/1001] 10.222.0.39 () {56 vars in 1122 bytes} [Thu May 26 12:19:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:45.920286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362dd32-edc9-47c3-b560-fd7d2f2e353f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:45.941632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:46.036359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362dd32-edc9-47c3-b560-fd7d2f2e353f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:46.075118 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab9bf7-5891-46e7-8d26-873c104d3bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:46.075807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab9bf7-5891-46e7-8d26-873c104d3bda None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:46.076092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab9bf7-5891-46e7-8d26-873c104d3bda None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:46.076370 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab9bf7-5891-46e7-8d26-873c104d3bda None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:46.077179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab9bf7-5891-46e7-8d26-873c104d3bda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:46.078588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab9bf7-5891-46e7-8d26-873c104d3bda None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:46.097738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 501/1002] 10.222.0.39 () {60 vars in 1144 bytes} [Thu May 26 12:19:45 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:46.558927 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ac796-587f-4481-bd2b-c46271528c68 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:46.559472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ac796-587f-4481-bd2b-c46271528c68 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:46.559472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ac796-587f-4481-bd2b-c46271528c68 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:46.561029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 502/1003] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:46.567132 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff94f73-9d80-4b01-9105-f371e1c49d45 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:46.567455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff94f73-9d80-4b01-9105-f371e1c49d45 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:46.567835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff94f73-9d80-4b01-9105-f371e1c49d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:46.585812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4ff94f73-9d80-4b01-9105-f371e1c49d45 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:46.587002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4ff94f73-9d80-4b01-9105-f371e1c49d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:46.665082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 502/1004] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:46 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:46.683305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ac796-587f-4481-bd2b-c46271528c68 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:46.700655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:46.790554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ac796-587f-4481-bd2b-c46271528c68 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:46.825379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464f0ad-1cde-4e28-ac39-e35eca8fa8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:46.826438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464f0ad-1cde-4e28-ac39-e35eca8fa8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:46.826911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464f0ad-1cde-4e28-ac39-e35eca8fa8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:46.827370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464f0ad-1cde-4e28-ac39-e35eca8fa8b5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:46.828229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464f0ad-1cde-4e28-ac39-e35eca8fa8b5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:46.829818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464f0ad-1cde-4e28-ac39-e35eca8fa8b5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-4464f0ad-1cde-4e28-ac39-e35eca8fa8b5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:46.841778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:46.842808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:19:46.843672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:46.846154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 503/1005] 10.222.0.39 () {56 vars in 1105 bytes} [Thu May 26 12:19:46 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:46.852098 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff94f73-9d80-4b01-9105-f371e1c49d45 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:46.854536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:46.964293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff94f73-9d80-4b01-9105-f371e1c49d45 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:46.998991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19f511-5cc4-4435-b5fe-ce1edbd927b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:46.999928 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19f511-5cc4-4435-b5fe-ce1edbd927b6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:47.000393 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19f511-5cc4-4435-b5fe-ce1edbd927b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:47.000877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19f511-5cc4-4435-b5fe-ce1edbd927b6 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:47.001789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19f511-5cc4-4435-b5fe-ce1edbd927b6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:47.002283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19f511-5cc4-4435-b5fe-ce1edbd927b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:47.003854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19f511-5cc4-4435-b5fe-ce1edbd927b6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:47.009683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 503/1006] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:47.015331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464f0ad-1cde-4e28-ac39-e35eca8fa8b5 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:47.099751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:47.126680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464f0ad-1cde-4e28-ac39-e35eca8fa8b5 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:47.164475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57f07a-f564-4c2d-9b83-2812f6383e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:47.165178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57f07a-f564-4c2d-9b83-2812f6383e26 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:47.165461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57f07a-f564-4c2d-9b83-2812f6383e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:47.165738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57f07a-f564-4c2d-9b83-2812f6383e26 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:47.166450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57f07a-f564-4c2d-9b83-2812f6383e26 None admin] RBAC: Adding query filter params (type=image) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:47.166762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57f07a-f564-4c2d-9b83-2812f6383e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:47.168131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57f07a-f564-4c2d-9b83-2812f6383e26 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:47.181032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 504/1007] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:48.153230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205904f-ddbb-4529-9c44-31c473eb9c86 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.153787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205904f-ddbb-4529-9c44-31c473eb9c86 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.153787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205904f-ddbb-4529-9c44-31c473eb9c86 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.155105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 504/1008] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:48.161153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c47d9-d278-4680-9991-0dc45784bdb3 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.161647 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c47d9-d278-4680-9991-0dc45784bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.161727 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c47d9-d278-4680-9991-0dc45784bdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.179088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-364c47d9-d278-4680-9991-0dc45784bdb3 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:48.180290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-364c47d9-d278-4680-9991-0dc45784bdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:48.248476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 505/1009] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:48.275337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205904f-ddbb-4529-9c44-31c473eb9c86 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:48.324507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c687f3f-c588-480a-a646-ba8f36fd520f None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.324839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c687f3f-c588-480a-a646-ba8f36fd520f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.325120 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c687f3f-c588-480a-a646-ba8f36fd520f None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.326485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 506/1010] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:48.331632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a351cac-7279-483d-9e6f-24087d13f1c6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.331920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a351cac-7279-483d-9e6f-24087d13f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.332368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a351cac-7279-483d-9e6f-24087d13f1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.347061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:48.351148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1a351cac-7279-483d-9e6f-24087d13f1c6 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:48.352527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1a351cac-7279-483d-9e6f-24087d13f1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:48.388440 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205904f-ddbb-4529-9c44-31c473eb9c86 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:48.424659 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659c223-f9df-4484-8582-2941c1cbb23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:48.429059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 507/1011] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:48.429168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659c223-f9df-4484-8582-2941c1cbb23a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.429168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659c223-f9df-4484-8582-2941c1cbb23a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.429168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659c223-f9df-4484-8582-2941c1cbb23a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.429168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659c223-f9df-4484-8582-2941c1cbb23a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:48.429168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659c223-f9df-4484-8582-2941c1cbb23a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-7659c223-f9df-4484-8582-2941c1cbb23a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:48.447627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:48.448948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:48.449802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 505/1012] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:48.452094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a351cac-7279-483d-9e6f-24087d13f1c6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:48.454771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:48.456013 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659c223-f9df-4484-8582-2941c1cbb23a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:48.562941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a351cac-7279-483d-9e6f-24087d13f1c6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:48.573584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659c223-f9df-4484-8582-2941c1cbb23a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:48.602641 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbf046-e212-4231-bfa1-28053388810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:48.603450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbf046-e212-4231-bfa1-28053388810d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.603733 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbf046-e212-4231-bfa1-28053388810d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.604016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbf046-e212-4231-bfa1-28053388810d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.605241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbf046-e212-4231-bfa1-28053388810d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:48.605934 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:48.606679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbf046-e212-4231-bfa1-28053388810d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:48.608769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 508/1013] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:48.612914 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5065ca-7be7-4207-bd08-51556b7a963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:48.613177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5065ca-7be7-4207-bd08-51556b7a963a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.613544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5065ca-7be7-4207-bd08-51556b7a963a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.613795 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5065ca-7be7-4207-bd08-51556b7a963a None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.614633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbf046-e212-4231-bfa1-28053388810d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:48.615105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5065ca-7be7-4207-bd08-51556b7a963a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:48.615887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5065ca-7be7-4207-bd08-51556b7a963a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:48.618029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5065ca-7be7-4207-bd08-51556b7a963a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:48.623418 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 506/1014] 10.222.0.39 () {56 vars in 1112 bytes} [Thu May 26 12:19:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:48.628657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5065ca-7be7-4207-bd08-51556b7a963a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:48.690711 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:48.728133 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbf046-e212-4231-bfa1-28053388810d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:48.738354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5065ca-7be7-4207-bd08-51556b7a963a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:48.766875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd57288-c269-48f8-aa71-f1eea12c0802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:48.767827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd57288-c269-48f8-aa71-f1eea12c0802 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.768262 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd57288-c269-48f8-aa71-f1eea12c0802 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.768699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd57288-c269-48f8-aa71-f1eea12c0802 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.769593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd57288-c269-48f8-aa71-f1eea12c0802 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:48.772067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd57288-c269-48f8-aa71-f1eea12c0802 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:48.777087 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b35f10-fdb0-4368-b0c7-355edbd6d77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:48.777762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35f10-fdb0-4368-b0c7-355edbd6d77a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.778045 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35f10-fdb0-4368-b0c7-355edbd6d77a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.778322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b35f10-fdb0-4368-b0c7-355edbd6d77a None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.779040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b35f10-fdb0-4368-b0c7-355edbd6d77a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:48.779350 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b35f10-fdb0-4368-b0c7-355edbd6d77a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:48.780834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b35f10-fdb0-4368-b0c7-355edbd6d77a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:48.788735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 507/1015] 10.222.0.39 () {56 vars in 1112 bytes} [Thu May 26 12:19:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:48.796221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b35f10-fdb0-4368-b0c7-355edbd6d77a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:48.809143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 509/1016] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:19:48 2022] POST /identity/v3/projects => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:48.869691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:48.927408 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b35f10-fdb0-4368-b0c7-355edbd6d77a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:48.966147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911886f9-4989-438f-a2fd-8923af9230b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:48.966827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911886f9-4989-438f-a2fd-8923af9230b7 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:48.967117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911886f9-4989-438f-a2fd-8923af9230b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:48.967397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911886f9-4989-438f-a2fd-8923af9230b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:48.968163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911886f9-4989-438f-a2fd-8923af9230b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:48.969597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911886f9-4989-438f-a2fd-8923af9230b7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:48.990421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 508/1017] 10.222.0.39 () {60 vars in 1144 bytes} [Thu May 26 12:19:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:19:49.448841 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69e7ec-bc08-4967-8ac9-194c8d172c62 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:49.449337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69e7ec-bc08-4967-8ac9-194c8d172c62 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:49.449337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69e7ec-bc08-4967-8ac9-194c8d172c62 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:49.450826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 510/1018] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:49.455847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603309f-7104-4415-b6f7-f044b4e9524d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:49.456224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603309f-7104-4415-b6f7-f044b4e9524d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:49.456417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603309f-7104-4415-b6f7-f044b4e9524d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:49.476557 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c603309f-7104-4415-b6f7-f044b4e9524d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:49.478043 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c603309f-7104-4415-b6f7-f044b4e9524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:49.567267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 509/1019] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:49 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:49.589961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69e7ec-bc08-4967-8ac9-194c8d172c62 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:49.694934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69e7ec-bc08-4967-8ac9-194c8d172c62 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:49.717832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:49.731340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7858cd9-5fe2-44bb-9de4-7bfddded52d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:49.732010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7858cd9-5fe2-44bb-9de4-7bfddded52d7 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:49.732290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7858cd9-5fe2-44bb-9de4-7bfddded52d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:49.732561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7858cd9-5fe2-44bb-9de4-7bfddded52d7 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:49.733325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7858cd9-5fe2-44bb-9de4-7bfddded52d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:49.734679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7858cd9-5fe2-44bb-9de4-7bfddded52d7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:49.749514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 511/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:19:49 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:51.105951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98250aaf-d83b-48ca-9db8-e9f5bc477e85 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:51.106486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98250aaf-d83b-48ca-9db8-e9f5bc477e85 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:51.106568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98250aaf-d83b-48ca-9db8-e9f5bc477e85 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:51.107936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 510/1021] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:51.113099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86047467-878d-4946-b34a-7b38d93b3835 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:51.113475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86047467-878d-4946-b34a-7b38d93b3835 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:51.113652 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86047467-878d-4946-b34a-7b38d93b3835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:51.131219 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-86047467-878d-4946-b34a-7b38d93b3835 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:51.132502 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-86047467-878d-4946-b34a-7b38d93b3835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:51.212487 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 512/1022] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:51.236703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98250aaf-d83b-48ca-9db8-e9f5bc477e85 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:51.281774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:51.343685 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc396-20d8-4470-acc4-1c928b1eafb7 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:51.343878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98250aaf-d83b-48ca-9db8-e9f5bc477e85 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:51.343963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc396-20d8-4470-acc4-1c928b1eafb7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:51.344243 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc396-20d8-4470-acc4-1c928b1eafb7 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:51.345780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 513/1023] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:51.351082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb8f38-e4ce-4d71-8a68-0d34b4884c42 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:51.351590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb8f38-e4ce-4d71-8a68-0d34b4884c42 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:51.351860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb8f38-e4ce-4d71-8a68-0d34b4884c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:51.369502 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2acb8f38-e4ce-4d71-8a68-0d34b4884c42 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:51.370697 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2acb8f38-e4ce-4d71-8a68-0d34b4884c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:51.381680 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c955a49-e072-4fe5-9aab-cb79a2e2d5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:51.382924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c955a49-e072-4fe5-9aab-cb79a2e2d5bc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:51.383409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c955a49-e072-4fe5-9aab-cb79a2e2d5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:51.383807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c955a49-e072-4fe5-9aab-cb79a2e2d5bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:51.385503 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c955a49-e072-4fe5-9aab-cb79a2e2d5bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:51.387921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c955a49-e072-4fe5-9aab-cb79a2e2d5bc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:51.390314 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 511/1024] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:51.396014 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c955a49-e072-4fe5-9aab-cb79a2e2d5bc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:51.448755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 514/1025] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:51.469255 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb8f38-e4ce-4d71-8a68-0d34b4884c42 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:51.503372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c955a49-e072-4fe5-9aab-cb79a2e2d5bc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:51.511179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:51.514396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:51.544976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3694c-81c1-4ee7-b8d9-08685571bee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:51.545653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3694c-81c1-4ee7-b8d9-08685571bee7 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:51.545939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3694c-81c1-4ee7-b8d9-08685571bee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:51.546947 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3694c-81c1-4ee7-b8d9-08685571bee7 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:51.546947 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3694c-81c1-4ee7-b8d9-08685571bee7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:51.548357 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3694c-81c1-4ee7-b8d9-08685571bee7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:51.570765 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 512/1026] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:19:51 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:19:51.584167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb8f38-e4ce-4d71-8a68-0d34b4884c42 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:51.623527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42096b60-b510-4d7a-b896-81b24bee4c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:51.624366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42096b60-b510-4d7a-b896-81b24bee4c32 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:51.624649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42096b60-b510-4d7a-b896-81b24bee4c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:51.624957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42096b60-b510-4d7a-b896-81b24bee4c32 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:51.637572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42096b60-b510-4d7a-b896-81b24bee4c32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-42096b60-b510-4d7a-b896-81b24bee4c32 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:51.646273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:51.647507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:51.653907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:51.653907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:51.653907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:51.653907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:51.653907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:51.653907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:51.653907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:51.653907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:51.653907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:51.653907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:51.653907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:19:51.653907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:51.653907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 515/1027] 10.222.0.39 () {56 vars in 1120 bytes} [Thu May 26 12:19:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:51.654625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3694c-81c1-4ee7-b8d9-08685571bee7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:51.766106 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3694c-81c1-4ee7-b8d9-08685571bee7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:51.801670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58772bea-7c91-4e94-8474-407da7758d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:51.802364 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772bea-7c91-4e94-8474-407da7758d48 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:51.802656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772bea-7c91-4e94-8474-407da7758d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:51.802938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58772bea-7c91-4e94-8474-407da7758d48 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:51.803991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58772bea-7c91-4e94-8474-407da7758d48 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:51.804400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58772bea-7c91-4e94-8474-407da7758d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:51.805916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58772bea-7c91-4e94-8474-407da7758d48 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:51.816164 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 513/1028] 10.222.0.39 () {56 vars in 1115 bytes} [Thu May 26 12:19:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:51.823065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42096b60-b510-4d7a-b896-81b24bee4c32 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:51.932908 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:51.936907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42096b60-b510-4d7a-b896-81b24bee4c32 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:51.972526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14ab2-4741-4ec7-8185-d7ba85c63b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:51.973393 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14ab2-4741-4ec7-8185-d7ba85c63b44 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:51.973679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14ab2-4741-4ec7-8185-d7ba85c63b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:51.973954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a14ab2-4741-4ec7-8185-d7ba85c63b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:51.985599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14ab2-4741-4ec7-8185-d7ba85c63b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:51.987037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a14ab2-4741-4ec7-8185-d7ba85c63b44 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-69a14ab2-4741-4ec7-8185-d7ba85c63b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:52.003877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:52.004861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:52.005771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:52.005771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:52.005771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:52.005771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:52.005771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 516/1029] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:52.009464 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0891e24-220d-4d0b-be41-562853bf5fe6 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:52.009759 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0891e24-220d-4d0b-be41-562853bf5fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:52.010052 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0891e24-220d-4d0b-be41-562853bf5fe6 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:52.011738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 514/1030] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:52.011862 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14ab2-4741-4ec7-8185-d7ba85c63b44 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:52.016624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb185f-1d42-4e71-8cee-10641a3c6251 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:52.016876 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb185f-1d42-4e71-8cee-10641a3c6251 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:52.017159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb185f-1d42-4e71-8cee-10641a3c6251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:52.034691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-67bb185f-1d42-4e71-8cee-10641a3c6251 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:52.035883 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-67bb185f-1d42-4e71-8cee-10641a3c6251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:52.058262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:52.108534 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 515/1031] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:52.124990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a14ab2-4741-4ec7-8185-d7ba85c63b44 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:52.133497 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb185f-1d42-4e71-8cee-10641a3c6251 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:52.166131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cebb0-9bcb-4e14-b97f-15048015179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:52.166918 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cebb0-9bcb-4e14-b97f-15048015179f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:52.167307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cebb0-9bcb-4e14-b97f-15048015179f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:52.167597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cebb0-9bcb-4e14-b97f-15048015179f None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:52.168345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cebb0-9bcb-4e14-b97f-15048015179f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:52.168651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cebb0-9bcb-4e14-b97f-15048015179f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:52.170087 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3cebb0-9bcb-4e14-b97f-15048015179f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:52.188227 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 517/1032] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:52.189298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cebb0-9bcb-4e14-b97f-15048015179f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:52.201973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:52.246236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb185f-1d42-4e71-8cee-10641a3c6251 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:52.286042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c030b-d99a-4188-aa68-05136510f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:52.286766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c030b-d99a-4188-aa68-05136510f184 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:52.287051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c030b-d99a-4188-aa68-05136510f184 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:52.287333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c030b-d99a-4188-aa68-05136510f184 None admin] PATH_INFO: `/v3/services/image` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:52.288612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c030b-d99a-4188-aa68-05136510f184 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:52.290028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c030b-d99a-4188-aa68-05136510f184 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:52.299066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cebb0-9bcb-4e14-b97f-15048015179f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-734c030b-d99a-4188-aa68-05136510f184 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:52.301589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:52.302582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:52.303448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 516/1033] 10.222.0.39 () {56 vars in 1105 bytes} [Thu May 26 12:19:52 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:52.308825 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c030b-d99a-4188-aa68-05136510f184 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:52.330639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:52.341802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183212c9-29f7-4be7-aa5a-e5183645a6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:52.342791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183212c9-29f7-4be7-aa5a-e5183645a6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:52.343256 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183212c9-29f7-4be7-aa5a-e5183645a6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:52.343687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183212c9-29f7-4be7-aa5a-e5183645a6c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:52.351557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183212c9-29f7-4be7-aa5a-e5183645a6c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:52.353370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183212c9-29f7-4be7-aa5a-e5183645a6c3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-183212c9-29f7-4be7-aa5a-e5183645a6c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:52.368246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:52.369381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:52.370353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:52.370353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:52.370353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:52.370353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:52.370353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:52.370353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:52.370353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:52.370353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:52.370353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:19:52.370353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:52.370928 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 518/1034] 10.222.0.39 () {56 vars in 1093 bytes} [Thu May 26 12:19:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:52.375689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183212c9-29f7-4be7-aa5a-e5183645a6c3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:52.420306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c030b-d99a-4188-aa68-05136510f184 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:52.449559 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:52.455374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec790aac-c18e-4d75-a831-a0b49bdf2cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:52.456053 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec790aac-c18e-4d75-a831-a0b49bdf2cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:52.456335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec790aac-c18e-4d75-a831-a0b49bdf2cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:52.456607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec790aac-c18e-4d75-a831-a0b49bdf2cf4 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:52.457352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec790aac-c18e-4d75-a831-a0b49bdf2cf4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:52.457662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec790aac-c18e-4d75-a831-a0b49bdf2cf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:52.459076 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec790aac-c18e-4d75-a831-a0b49bdf2cf4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:52.464127 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 517/1035] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:52.469672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec790aac-c18e-4d75-a831-a0b49bdf2cf4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:52.488393 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183212c9-29f7-4be7-aa5a-e5183645a6c3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:52.523555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36340060-ba4e-4bd9-a0c1-e1dbb0fe8314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:52.524227 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36340060-ba4e-4bd9-a0c1-e1dbb0fe8314 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:52.524513 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36340060-ba4e-4bd9-a0c1-e1dbb0fe8314 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:52.524819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36340060-ba4e-4bd9-a0c1-e1dbb0fe8314 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:52.525662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36340060-ba4e-4bd9-a0c1-e1dbb0fe8314 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:52.525977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36340060-ba4e-4bd9-a0c1-e1dbb0fe8314 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:52.527400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36340060-ba4e-4bd9-a0c1-e1dbb0fe8314 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:52.545512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 519/1036] 10.222.0.39 () {56 vars in 1133 bytes} [Thu May 26 12:19:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:52.551034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36340060-ba4e-4bd9-a0c1-e1dbb0fe8314 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:52.561126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:52.579413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec790aac-c18e-4d75-a831-a0b49bdf2cf4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:52.619520 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c2644-ead4-45b2-b3a8-622a563ef52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:52.620296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c2644-ead4-45b2-b3a8-622a563ef52e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:52.620643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c2644-ead4-45b2-b3a8-622a563ef52e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:52.620963 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c2644-ead4-45b2-b3a8-622a563ef52e None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:52.621676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c2644-ead4-45b2-b3a8-622a563ef52e None admin] RBAC: Adding query filter params (type=image) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:52.621988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c2644-ead4-45b2-b3a8-622a563ef52e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:52.623565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c2644-ead4-45b2-b3a8-622a563ef52e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:52.628937 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 518/1037] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:52.634540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c2644-ead4-45b2-b3a8-622a563ef52e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:52.655815 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36340060-ba4e-4bd9-a0c1-e1dbb0fe8314 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:52.684257 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:52.693800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978070c-6037-43d1-a3d2-6c8cddf97d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:52.694939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978070c-6037-43d1-a3d2-6c8cddf97d7d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:52.695323 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978070c-6037-43d1-a3d2-6c8cddf97d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:52.695595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978070c-6037-43d1-a3d2-6c8cddf97d7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:52.742703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c2644-ead4-45b2-b3a8-622a563ef52e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:52.777592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978070c-6037-43d1-a3d2-6c8cddf97d7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:52.779069 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978070c-6037-43d1-a3d2-6c8cddf97d7d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:52.786888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a68ec-84c7-4fd2-bc15-c0b84097b40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:52.787646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a68ec-84c7-4fd2-bc15-c0b84097b40b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:52.788002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a68ec-84c7-4fd2-bc15-c0b84097b40b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:52.788243 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a68ec-84c7-4fd2-bc15-c0b84097b40b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:52.789076 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a68ec-84c7-4fd2-bc15-c0b84097b40b None admin] RBAC: Adding query filter params (interface=public, service_id=427ba4cb0c794a62acd549a56f4d1bcd, region_id=RegionOne) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:52.789400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a68ec-84c7-4fd2-bc15-c0b84097b40b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:52.790785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a68ec-84c7-4fd2-bc15-c0b84097b40b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:52.797152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 519/1038] 10.222.0.39 () {56 vars in 1251 bytes} [Thu May 26 12:19:52 2022] GET /identity/v3/endpoints?service_id=427ba4cb0c794a62acd549a56f4d1bcd&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:52.802463 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a68ec-84c7-4fd2-bc15-c0b84097b40b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:52.818841 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:52.908264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 520/1039] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:52 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:19:52.915078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978070c-6037-43d1-a3d2-6c8cddf97d7d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:52.930653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a68ec-84c7-4fd2-bc15-c0b84097b40b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:52.949262 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:52.977209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fb091-d586-41b6-a5a3-89474bff68e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:52.977882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fb091-d586-41b6-a5a3-89474bff68e4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:52.978166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fb091-d586-41b6-a5a3-89474bff68e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:52.978441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fb091-d586-41b6-a5a3-89474bff68e4 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:52.979134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fb091-d586-41b6-a5a3-89474bff68e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:52.980600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fb091-d586-41b6-a5a3-89474bff68e4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:52.987411 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 520/1040] 10.222.0.39 () {56 vars in 1087 bytes} [Thu May 26 12:19:52 2022] GET /identity/v3/services => generated 1957 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:19:53.041444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978070c-6037-43d1-a3d2-6c8cddf97d7d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:53.081368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512bc50-f96c-4cda-abe1-e243b7763ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:53.082110 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512bc50-f96c-4cda-abe1-e243b7763ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:53.082396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512bc50-f96c-4cda-abe1-e243b7763ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:53.082675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512bc50-f96c-4cda-abe1-e243b7763ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:53.096270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512bc50-f96c-4cda-abe1-e243b7763ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:53.097798 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512bc50-f96c-4cda-abe1-e243b7763ae0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-f512bc50-f96c-4cda-abe1-e243b7763ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:53.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:53.123030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:53.123942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:53.123942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:53.123942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:53.123942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:53.124872 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 521/1041] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:53.131608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fb091-d586-41b6-a5a3-89474bff68e4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:53.233642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:53.271109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fb091-d586-41b6-a5a3-89474bff68e4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:53.309152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f5f65-4a6f-42ba-b7f4-21022c433881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:53.309831 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f5f65-4a6f-42ba-b7f4-21022c433881 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:53.310117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f5f65-4a6f-42ba-b7f4-21022c433881 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:53.310395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f5f65-4a6f-42ba-b7f4-21022c433881 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:53.311134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f5f65-4a6f-42ba-b7f4-21022c433881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:53.311444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f5f65-4a6f-42ba-b7f4-21022c433881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:53.312852 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f5f65-4a6f-42ba-b7f4-21022c433881 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:53.331049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 521/1042] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:53.332326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512bc50-f96c-4cda-abe1-e243b7763ae0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:53.422605 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:53.443972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512bc50-f96c-4cda-abe1-e243b7763ae0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:53.481131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025b588-c82c-4002-8542-618e7bdec0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:53.481943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025b588-c82c-4002-8542-618e7bdec0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:53.482232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025b588-c82c-4002-8542-618e7bdec0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:53.482504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025b588-c82c-4002-8542-618e7bdec0b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:53.490616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025b588-c82c-4002-8542-618e7bdec0b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:53.492921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025b588-c82c-4002-8542-618e7bdec0b4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-9025b588-c82c-4002-8542-618e7bdec0b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:53.508113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:53.509149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:53.510076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:53.510076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:53.510076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:53.510076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:53.510076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:53.510076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:53.510076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:53.510076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:53.510076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 522/1043] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:53.516384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f5f65-4a6f-42ba-b7f4-21022c433881 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:53.634303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f5f65-4a6f-42ba-b7f4-21022c433881 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:53.674317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88faccb-bfc3-47cc-95ec-bce16ed87b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:53.674990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88faccb-bfc3-47cc-95ec-bce16ed87b43 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:53.675274 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88faccb-bfc3-47cc-95ec-bce16ed87b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:53.675612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88faccb-bfc3-47cc-95ec-bce16ed87b43 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:53.676408 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88faccb-bfc3-47cc-95ec-bce16ed87b43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:53.676737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88faccb-bfc3-47cc-95ec-bce16ed87b43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:53.678231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88faccb-bfc3-47cc-95ec-bce16ed87b43 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:53.681828 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:53.697621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 522/1044] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:53.699185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025b588-c82c-4002-8542-618e7bdec0b4 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:53.808958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025b588-c82c-4002-8542-618e7bdec0b4 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:53.845478 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcb088-b815-4007-a9b6-3f09392d775a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:53.846169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcb088-b815-4007-a9b6-3f09392d775a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:53.846453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcb088-b815-4007-a9b6-3f09392d775a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:53.846733 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcb088-b815-4007-a9b6-3f09392d775a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:53.847602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcb088-b815-4007-a9b6-3f09392d775a None admin] RBAC: Adding query filter params (role.id=c130ba76816741e29f2e2a913e37b50c, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=04f5fbbe45ec4dcf8301da8483af2941) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:53.847920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcb088-b815-4007-a9b6-3f09392d775a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:53.849457 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcb088-b815-4007-a9b6-3f09392d775a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:53.864756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 523/1045] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:53 2022] GET /identity/v3/role_assignments?user.id=04f5fbbe45ec4dcf8301da8483af2941&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=c130ba76816741e29f2e2a913e37b50c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:54.071974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a700d7-131d-4ea2-b408-e634b9fc6f05 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.072345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a700d7-131d-4ea2-b408-e634b9fc6f05 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.072528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a700d7-131d-4ea2-b408-e634b9fc6f05 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.074086 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 523/1046] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:54.079272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a9925-ddaf-413b-82a0-63bacef8b85b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.079567 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a9925-ddaf-413b-82a0-63bacef8b85b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.079845 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a9925-ddaf-413b-82a0-63bacef8b85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.086701 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:54.099274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d34a9925-ddaf-413b-82a0-63bacef8b85b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:54.100445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d34a9925-ddaf-413b-82a0-63bacef8b85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:54.185429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 524/1047] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:54.214249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a700d7-131d-4ea2-b408-e634b9fc6f05 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:54.325769 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a700d7-131d-4ea2-b408-e634b9fc6f05 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:54.361896 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f6b22-c8f1-4d93-83d3-89d156a62431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:54.362690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f6b22-c8f1-4d93-83d3-89d156a62431 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.362971 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f6b22-c8f1-4d93-83d3-89d156a62431 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.363244 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f6b22-c8f1-4d93-83d3-89d156a62431 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.374319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f6b22-c8f1-4d93-83d3-89d156a62431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b27f6b22-c8f1-4d93-83d3-89d156a62431 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:54.381888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:54.382805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:54.383657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:54.383657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:54.383657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:54.383657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:54.383657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:54.383657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:54.383657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:54.383657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:54.383657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:54.383657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:54.383657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:54.383657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:54.388623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 524/1048] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:19:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:54.390241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a9925-ddaf-413b-82a0-63bacef8b85b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:54.491185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a9925-ddaf-413b-82a0-63bacef8b85b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:54.525963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f47bde-cf67-45fc-a160-b0343c82d06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:54.526631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47bde-cf67-45fc-a160-b0343c82d06b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.526911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47bde-cf67-45fc-a160-b0343c82d06b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.527185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f47bde-cf67-45fc-a160-b0343c82d06b None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.528067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f47bde-cf67-45fc-a160-b0343c82d06b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:54.528381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f47bde-cf67-45fc-a160-b0343c82d06b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:54.529784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f47bde-cf67-45fc-a160-b0343c82d06b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:54.531163 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:54.540546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 525/1049] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:54.546161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f6b22-c8f1-4d93-83d3-89d156a62431 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:54.609647 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:54.656926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f6b22-c8f1-4d93-83d3-89d156a62431 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:54.691799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3abc82-a7e2-451f-b13b-383a50aa2445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:54.692671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3abc82-a7e2-451f-b13b-383a50aa2445 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.692976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3abc82-a7e2-451f-b13b-383a50aa2445 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.693249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3abc82-a7e2-451f-b13b-383a50aa2445 None admin] PATH_INFO: `/v3/users/93f903abb7344ccaa1f47d301246c4f8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.707087 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3abc82-a7e2-451f-b13b-383a50aa2445 None admin] RBAC: Authorizing `identity:get_user(user_id=93f903abb7344ccaa1f47d301246c4f8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:54.708544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3abc82-a7e2-451f-b13b-383a50aa2445 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:54.715148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 525/1050] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:19:54 2022] GET /identity/v3/users/93f903abb7344ccaa1f47d301246c4f8 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:54.716372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f47bde-cf67-45fc-a160-b0343c82d06b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:54.827390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f47bde-cf67-45fc-a160-b0343c82d06b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:54.861248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b476d-7108-48b7-9001-58a2c7e89824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:54.861909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b476d-7108-48b7-9001-58a2c7e89824 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:54.862195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b476d-7108-48b7-9001-58a2c7e89824 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:54.862473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b476d-7108-48b7-9001-58a2c7e89824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:54.935118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:54.942964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b476d-7108-48b7-9001-58a2c7e89824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:54.945142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b476d-7108-48b7-9001-58a2c7e89824 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:55.055015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 526/1051] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:54 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:19:55.056313 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3abc82-a7e2-451f-b13b-383a50aa2445 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:55.157037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3abc82-a7e2-451f-b13b-383a50aa2445 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:55.173904 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:55.198910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0d671-236a-4902-8c8f-2ce0b2326fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:55.199792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0d671-236a-4902-8c8f-2ce0b2326fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.200070 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0d671-236a-4902-8c8f-2ce0b2326fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.200342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0d671-236a-4902-8c8f-2ce0b2326fc7 None admin] PATH_INFO: `/v3/projects/af91450ab07c4884ab2898e3018e35be` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.201565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0d671-236a-4902-8c8f-2ce0b2326fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=af91450ab07c4884ab2898e3018e35be)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:55.203002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0d671-236a-4902-8c8f-2ce0b2326fc7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:55.209822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 526/1052] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:19:55 2022] GET /identity/v3/projects/af91450ab07c4884ab2898e3018e35be => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:55.211670 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b476d-7108-48b7-9001-58a2c7e89824 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:55.306614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:55.314014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b476d-7108-48b7-9001-58a2c7e89824 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:55.348938 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f72bad-fd7a-44ac-9008-3111032bbcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:55.349597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f72bad-fd7a-44ac-9008-3111032bbcc3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.349876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f72bad-fd7a-44ac-9008-3111032bbcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.350147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f72bad-fd7a-44ac-9008-3111032bbcc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.352027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f72bad-fd7a-44ac-9008-3111032bbcc3 None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=af91450ab07c4884ab2898e3018e35be, user.id=93f903abb7344ccaa1f47d301246c4f8) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:55.352378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f72bad-fd7a-44ac-9008-3111032bbcc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:55.353862 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f72bad-fd7a-44ac-9008-3111032bbcc3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:55.364737 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 527/1053] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:19:55 2022] GET /identity/v3/role_assignments?user.id=93f903abb7344ccaa1f47d301246c4f8&scope.project.id=af91450ab07c4884ab2898e3018e35be&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:55.364956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b562f-e1a8-4871-95ab-7042013f87d9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.364956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b562f-e1a8-4871-95ab-7042013f87d9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.364956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b562f-e1a8-4871-95ab-7042013f87d9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.368734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 527/1054] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:55.371794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa780ca5-e41c-4127-9ed6-88ea5cf2a332 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.372087 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa780ca5-e41c-4127-9ed6-88ea5cf2a332 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.372369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa780ca5-e41c-4127-9ed6-88ea5cf2a332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.390376 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fa780ca5-e41c-4127-9ed6-88ea5cf2a332 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:55.391598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fa780ca5-e41c-4127-9ed6-88ea5cf2a332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:55.470869 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 528/1055] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:55.494501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b562f-e1a8-4871-95ab-7042013f87d9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:55.607160 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b562f-e1a8-4871-95ab-7042013f87d9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:55.641073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23272579-1943-4e0c-b79a-1a9221d168b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:55.641866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23272579-1943-4e0c-b79a-1a9221d168b8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.642141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23272579-1943-4e0c-b79a-1a9221d168b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.642410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23272579-1943-4e0c-b79a-1a9221d168b8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.643064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23272579-1943-4e0c-b79a-1a9221d168b8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:55.644422 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23272579-1943-4e0c-b79a-1a9221d168b8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-23272579-1943-4e0c-b79a-1a9221d168b8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:55.656691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:55.657812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:55.658764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 528/1056] 10.222.0.39 () {56 vars in 1105 bytes} [Thu May 26 12:19:55 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:55.666400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa780ca5-e41c-4127-9ed6-88ea5cf2a332 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:55.759343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:55.770301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa780ca5-e41c-4127-9ed6-88ea5cf2a332 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:55.805944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5a2dc-7dbd-41e5-8f5c-7731809f760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:55.806614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5a2dc-7dbd-41e5-8f5c-7731809f760b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.806896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5a2dc-7dbd-41e5-8f5c-7731809f760b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.807169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5a2dc-7dbd-41e5-8f5c-7731809f760b None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.807879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5a2dc-7dbd-41e5-8f5c-7731809f760b None admin] RBAC: Adding query filter params (name=image) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:55.808184 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5a2dc-7dbd-41e5-8f5c-7731809f760b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:55.809569 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5a2dc-7dbd-41e5-8f5c-7731809f760b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:55.819147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 529/1057] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:55.820970 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23272579-1943-4e0c-b79a-1a9221d168b8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:55.871625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:55.944107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23272579-1943-4e0c-b79a-1a9221d168b8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:55.979074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d4df4-fa14-49ec-ab7e-ca102e4b3cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:55.979751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4df4-fa14-49ec-ab7e-ca102e4b3cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:55.980037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4df4-fa14-49ec-ab7e-ca102e4b3cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:55.980316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4df4-fa14-49ec-ab7e-ca102e4b3cb9 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:55.981133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d4df4-fa14-49ec-ab7e-ca102e4b3cb9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:55.981449 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d4df4-fa14-49ec-ab7e-ca102e4b3cb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:55.982908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d4df4-fa14-49ec-ab7e-ca102e4b3cb9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:55.988017 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 529/1058] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:55.993707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5a2dc-7dbd-41e5-8f5c-7731809f760b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:56.078302 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abfcb7-e253-457b-9cef-eaaa10427865 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:56.078611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abfcb7-e253-457b-9cef-eaaa10427865 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:56.078795 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abfcb7-e253-457b-9cef-eaaa10427865 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:56.080291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 530/1059] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:19:56.085213 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f4f9a-7057-475f-9947-291a4f6f9119 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:56.085842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f4f9a-7057-475f-9947-291a4f6f9119 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:56.086134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f4f9a-7057-475f-9947-291a4f6f9119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:56.101661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5a2dc-7dbd-41e5-8f5c-7731809f760b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:56.104114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-aa6f4f9a-7057-475f-9947-291a4f6f9119 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:56.105350 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-aa6f4f9a-7057-475f-9947-291a4f6f9119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:56.141316 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c08e1e-6619-4d82-b75e-61554e5774a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:56.143195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c08e1e-6619-4d82-b75e-61554e5774a6 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:56.143689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c08e1e-6619-4d82-b75e-61554e5774a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:56.144153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c08e1e-6619-4d82-b75e-61554e5774a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:56.145164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c08e1e-6619-4d82-b75e-61554e5774a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:56.147002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c08e1e-6619-4d82-b75e-61554e5774a6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:56.174223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 530/1060] 10.222.0.39 () {60 vars in 1144 bytes} [Thu May 26 12:19:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:19:56.192226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 531/1061] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:19:56.216222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c08e1e-6619-4d82-b75e-61554e5774a6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:56.233387 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:56.340514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c08e1e-6619-4d82-b75e-61554e5774a6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:56.380617 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377c248-2bf2-4710-8357-87fbe95b55d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:56.381505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c248-2bf2-4710-8357-87fbe95b55d6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:56.381790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c248-2bf2-4710-8357-87fbe95b55d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:56.382956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377c248-2bf2-4710-8357-87fbe95b55d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:56.393095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377c248-2bf2-4710-8357-87fbe95b55d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-4377c248-2bf2-4710-8357-87fbe95b55d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:56.402229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:56.403340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:56.404421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:56.404421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:56.404421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:56.404421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:56.404421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:56.404421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:56.404421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:56.404421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:56.404421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:56.404421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:56.404421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:19:56.404421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:56.404421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 531/1062] 10.222.0.39 () {56 vars in 1120 bytes} [Thu May 26 12:19:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:56.409722 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f4f9a-7057-475f-9947-291a4f6f9119 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:56.447977 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:56.517123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f4f9a-7057-475f-9947-291a4f6f9119 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:56.556494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd0774-c171-429f-9089-48a496ead3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:56.557198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd0774-c171-429f-9089-48a496ead3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:56.557479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd0774-c171-429f-9089-48a496ead3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:56.557752 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd0774-c171-429f-9089-48a496ead3c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:56.558502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd0774-c171-429f-9089-48a496ead3c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:56.558807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd0774-c171-429f-9089-48a496ead3c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:56.560171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd0774-c171-429f-9089-48a496ead3c6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:56.569359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 532/1063] 10.222.0.39 () {56 vars in 1115 bytes} [Thu May 26 12:19:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:56.575597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377c248-2bf2-4710-8357-87fbe95b55d6 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:56.650067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:56.683688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377c248-2bf2-4710-8357-87fbe95b55d6 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:56.719175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0275e9-5b58-42cf-8c47-caed47a36126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:56.719986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0275e9-5b58-42cf-8c47-caed47a36126 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:56.720271 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0275e9-5b58-42cf-8c47-caed47a36126 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:56.720550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0275e9-5b58-42cf-8c47-caed47a36126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:56.732448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0275e9-5b58-42cf-8c47-caed47a36126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:56.733932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0275e9-5b58-42cf-8c47-caed47a36126 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-fa0275e9-5b58-42cf-8c47-caed47a36126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:56.751988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:56.753270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:56.754231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:56.754231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:56.754231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:56.754231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:56.754906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 532/1064] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:56.759105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd0774-c171-429f-9089-48a496ead3c6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:56.859009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:56.863106 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd0774-c171-429f-9089-48a496ead3c6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:56.903981 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a829b-321b-41f7-baff-c94b96892a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:56.904594 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a829b-321b-41f7-baff-c94b96892a0f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:56.904927 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a829b-321b-41f7-baff-c94b96892a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:56.905210 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a829b-321b-41f7-baff-c94b96892a0f None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:56.905937 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a829b-321b-41f7-baff-c94b96892a0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:56.906246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a829b-321b-41f7-baff-c94b96892a0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:56.907624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a829b-321b-41f7-baff-c94b96892a0f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:56.924589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 533/1065] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:56.925571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0275e9-5b58-42cf-8c47-caed47a36126 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:57.029550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0275e9-5b58-42cf-8c47-caed47a36126 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:57.052860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:57.066044 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66e1b2-1596-40ca-9f5b-3fea59eb00b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:57.066843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66e1b2-1596-40ca-9f5b-3fea59eb00b7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:57.067129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66e1b2-1596-40ca-9f5b-3fea59eb00b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:57.067406 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66e1b2-1596-40ca-9f5b-3fea59eb00b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:57.075911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66e1b2-1596-40ca-9f5b-3fea59eb00b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:57.077415 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66e1b2-1596-40ca-9f5b-3fea59eb00b7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-1b66e1b2-1596-40ca-9f5b-3fea59eb00b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:19:57.092296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:57.093336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:57.094333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:57.094333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:57.094333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:19:57.094333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:19:57.094333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:19:57.094333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:19:57.094333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:19:57.094333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:19:57.094333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:19:57.094333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:57.095538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 533/1066] 10.222.0.39 () {56 vars in 1093 bytes} [Thu May 26 12:19:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:57.099203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a829b-321b-41f7-baff-c94b96892a0f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:57.202841 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a829b-321b-41f7-baff-c94b96892a0f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:57.236419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98bc2a-c7b6-4d65-ab42-243a34cc9ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:57.237128 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98bc2a-c7b6-4d65-ab42-243a34cc9ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:57.237416 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98bc2a-c7b6-4d65-ab42-243a34cc9ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:57.237698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98bc2a-c7b6-4d65-ab42-243a34cc9ce7 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:57.238541 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98bc2a-c7b6-4d65-ab42-243a34cc9ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:57.238855 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98bc2a-c7b6-4d65-ab42-243a34cc9ce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:57.240289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98bc2a-c7b6-4d65-ab42-243a34cc9ce7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:57.262786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 534/1067] 10.222.0.39 () {56 vars in 1133 bytes} [Thu May 26 12:19:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:57.264216 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66e1b2-1596-40ca-9f5b-3fea59eb00b7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:57.370722 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66e1b2-1596-40ca-9f5b-3fea59eb00b7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:57.405008 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8058e-2dd3-4786-abbd-c63ad9b10cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:57.405808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8058e-2dd3-4786-abbd-c63ad9b10cce None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:57.406095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8058e-2dd3-4786-abbd-c63ad9b10cce None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:57.406376 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8058e-2dd3-4786-abbd-c63ad9b10cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:57.417421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8058e-2dd3-4786-abbd-c63ad9b10cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:57.418899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8058e-2dd3-4786-abbd-c63ad9b10cce None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-f8f8058e-2dd3-4786-abbd-c63ad9b10cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:57.440157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:57.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:57.442388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:57.442388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:57.442388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:57.442388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:57.442388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 534/1068] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:57.449715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98bc2a-c7b6-4d65-ab42-243a34cc9ce7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:57.471696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:57.557380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98bc2a-c7b6-4d65-ab42-243a34cc9ce7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:57.594063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e6d2c-9f02-4d80-8bee-9cf75eb0327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:57.594735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e6d2c-9f02-4d80-8bee-9cf75eb0327b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:57.595021 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e6d2c-9f02-4d80-8bee-9cf75eb0327b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:57.595300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e6d2c-9f02-4d80-8bee-9cf75eb0327b None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:57.596029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e6d2c-9f02-4d80-8bee-9cf75eb0327b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:57.596342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e6d2c-9f02-4d80-8bee-9cf75eb0327b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:57.597753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e6d2c-9f02-4d80-8bee-9cf75eb0327b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:57.614022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 535/1069] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:57.615237 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8058e-2dd3-4786-abbd-c63ad9b10cce None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:57.631836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44757-742c-4567-94b7-f4b75bbec5f6 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:57.632685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44757-742c-4567-94b7-f4b75bbec5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:57.633365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44757-742c-4567-94b7-f4b75bbec5f6 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:57.634754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 536/1070] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:57.640734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16b099-38de-4f45-89f9-bbc5c2b27873 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:57.641029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16b099-38de-4f45-89f9-bbc5c2b27873 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:57.641332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b16b099-38de-4f45-89f9-bbc5c2b27873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:57.654452 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:57.658921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2b16b099-38de-4f45-89f9-bbc5c2b27873 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:57.660116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2b16b099-38de-4f45-89f9-bbc5c2b27873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:57.728112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8058e-2dd3-4786-abbd-c63ad9b10cce None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:57.737145 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 537/1071] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:57.756797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16b099-38de-4f45-89f9-bbc5c2b27873 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:57.765786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:57.766655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e23a2-901b-4f77-8dd4-b6cf56137ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:57.767293 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e23a2-901b-4f77-8dd4-b6cf56137ade None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:57.767837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e23a2-901b-4f77-8dd4-b6cf56137ade None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:57.768201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e23a2-901b-4f77-8dd4-b6cf56137ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:57.775924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e23a2-901b-4f77-8dd4-b6cf56137ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:57.777409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e23a2-901b-4f77-8dd4-b6cf56137ade None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-299e23a2-901b-4f77-8dd4-b6cf56137ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:19:57.792324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:57.793297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:57.794309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:19:57.794309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:19:57.794309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:19:57.794309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:19:57.794309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:19:57.794309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:19:57.794309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:19:57.794309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:19:57.794309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 535/1072] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:57.799200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e23a2-901b-4f77-8dd4-b6cf56137ade None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:57.869282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b16b099-38de-4f45-89f9-bbc5c2b27873 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:57.903332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:57.910627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3670b-cd09-4d32-8f24-11dae0d706ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:57.910806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e23a2-901b-4f77-8dd4-b6cf56137ade None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:57.911438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3670b-cd09-4d32-8f24-11dae0d706ad None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:57.911716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3670b-cd09-4d32-8f24-11dae0d706ad None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:57.911989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3670b-cd09-4d32-8f24-11dae0d706ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:57.922935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3670b-cd09-4d32-8f24-11dae0d706ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-dba3670b-cd09-4d32-8f24-11dae0d706ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:19:57.931446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:57.932396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:57.933293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:57.933293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:57.933293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:57.933293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:57.933293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:19:57.933293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:19:57.933293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:19:57.933293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:19:57.933293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:19:57.933293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:19:57.933293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:19:57.933293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:57.933293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 538/1073] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:19:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:19:57.939266 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3670b-cd09-4d32-8f24-11dae0d706ad None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:57.949568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a902d0-bfe5-49b3-ac2f-787fb663764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:57.950235 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a902d0-bfe5-49b3-ac2f-787fb663764b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:57.950515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a902d0-bfe5-49b3-ac2f-787fb663764b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:57.950787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a902d0-bfe5-49b3-ac2f-787fb663764b None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:57.951579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a902d0-bfe5-49b3-ac2f-787fb663764b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:57.951888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a902d0-bfe5-49b3-ac2f-787fb663764b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:57.953370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a902d0-bfe5-49b3-ac2f-787fb663764b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:57.966341 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 536/1074] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:57.972144 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a902d0-bfe5-49b3-ac2f-787fb663764b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:58.016143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:58.055655 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3670b-cd09-4d32-8f24-11dae0d706ad None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:58.077778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a902d0-bfe5-49b3-ac2f-787fb663764b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:58.092990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c7144-ed37-40cb-bc2f-b472c34d737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:58.093664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c7144-ed37-40cb-bc2f-b472c34d737a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.093947 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c7144-ed37-40cb-bc2f-b472c34d737a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.094220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c7144-ed37-40cb-bc2f-b472c34d737a None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.094976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c7144-ed37-40cb-bc2f-b472c34d737a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:58.095286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c7144-ed37-40cb-bc2f-b472c34d737a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:58.096670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c7144-ed37-40cb-bc2f-b472c34d737a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:58.105623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 539/1075] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:19:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:58.111137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c7144-ed37-40cb-bc2f-b472c34d737a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:58.117944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fa2dd-268a-4896-8a30-fd778d6cfe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:58.118843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fa2dd-268a-4896-8a30-fd778d6cfe18 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.119128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fa2dd-268a-4896-8a30-fd778d6cfe18 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.119402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fa2dd-268a-4896-8a30-fd778d6cfe18 None admin] PATH_INFO: `/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/04f5fbbe45ec4dcf8301da8483af2941/roles/c130ba76816741e29f2e2a913e37b50c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.121682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fa2dd-268a-4896-8a30-fd778d6cfe18 None admin] RBAC: Authorizing `identity:create_grant(project_id=b341d104240e4b4cb61d365e8167f6a8, user_id=04f5fbbe45ec4dcf8301da8483af2941, role_id=c130ba76816741e29f2e2a913e37b50c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:58.123106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fa2dd-268a-4896-8a30-fd778d6cfe18 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:58.139009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 537/1076] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:19:57 2022] PUT /identity/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/04f5fbbe45ec4dcf8301da8483af2941/roles/c130ba76816741e29f2e2a913e37b50c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:19:58.224519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c7144-ed37-40cb-bc2f-b472c34d737a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:58.256184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:58.266880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f0ddc-966d-4fa4-a753-eb2c000fd43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:58.268081 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0ddc-966d-4fa4-a753-eb2c000fd43f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.268541 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0ddc-966d-4fa4-a753-eb2c000fd43f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.269036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f0ddc-966d-4fa4-a753-eb2c000fd43f None admin] PATH_INFO: `/v3/users/93f903abb7344ccaa1f47d301246c4f8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.270666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f0ddc-966d-4fa4-a753-eb2c000fd43f None admin] RBAC: Authorizing `identity:get_user(user_id=93f903abb7344ccaa1f47d301246c4f8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:58.272677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f0ddc-966d-4fa4-a753-eb2c000fd43f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:58.275312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 540/1077] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:19:58 2022] GET /identity/v3/users/93f903abb7344ccaa1f47d301246c4f8 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:19:58.281098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fa2dd-268a-4896-8a30-fd778d6cfe18 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:58.299611 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:58.392796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fa2dd-268a-4896-8a30-fd778d6cfe18 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:58.429515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932bea4-42f6-456c-83cd-e0b09d430e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:58.430395 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932bea4-42f6-456c-83cd-e0b09d430e00 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.430680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932bea4-42f6-456c-83cd-e0b09d430e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.430957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932bea4-42f6-456c-83cd-e0b09d430e00 None admin] PATH_INFO: `/v3/projects/af91450ab07c4884ab2898e3018e35be` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.432157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932bea4-42f6-456c-83cd-e0b09d430e00 None admin] RBAC: Authorizing `identity:get_project(project_id=af91450ab07c4884ab2898e3018e35be)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:58.433623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932bea4-42f6-456c-83cd-e0b09d430e00 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:58.435475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 538/1078] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:19:58 2022] GET /identity/v3/projects/af91450ab07c4884ab2898e3018e35be => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:19:58.441492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f0ddc-966d-4fa4-a753-eb2c000fd43f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:58.457270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d51b6a-05d9-4009-a8f0-890118e1857a None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.457788 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d51b6a-05d9-4009-a8f0-890118e1857a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.458068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d51b6a-05d9-4009-a8f0-890118e1857a None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.459562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 539/1079] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:19:58.465141 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a8a67-dfe2-43c0-bf33-722992b5c60f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.465431 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a8a67-dfe2-43c0-bf33-722992b5c60f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.465711 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a8a67-dfe2-43c0-bf33-722992b5c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.482448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f69a8a67-dfe2-43c0-bf33-722992b5c60f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:19:58.483648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f69a8a67-dfe2-43c0-bf33-722992b5c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:19:58.548781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f0ddc-966d-4fa4-a753-eb2c000fd43f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:58.554236 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 540/1080] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:19:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:19:58.577925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a8a67-dfe2-43c0-bf33-722992b5c60f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:58.583844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c569ace-76c6-4f30-ac78-6ca79456c806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:58.584777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c569ace-76c6-4f30-ac78-6ca79456c806 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.585093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c569ace-76c6-4f30-ac78-6ca79456c806 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.585900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c569ace-76c6-4f30-ac78-6ca79456c806 None admin] PATH_INFO: `/v3/projects/af91450ab07c4884ab2898e3018e35be/users/93f903abb7344ccaa1f47d301246c4f8/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.587894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c569ace-76c6-4f30-ac78-6ca79456c806 None admin] RBAC: Authorizing `identity:create_grant(project_id=af91450ab07c4884ab2898e3018e35be, user_id=93f903abb7344ccaa1f47d301246c4f8, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:58.589374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c569ace-76c6-4f30-ac78-6ca79456c806 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:58.592906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:58.606812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 541/1081] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:19:58 2022] PUT /identity/v3/projects/af91450ab07c4884ab2898e3018e35be/users/93f903abb7344ccaa1f47d301246c4f8/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:19:58.700672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a8a67-dfe2-43c0-bf33-722992b5c60f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:58.738498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd166a-009e-42fa-89ed-1d2b8359eae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:58.739179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd166a-009e-42fa-89ed-1d2b8359eae3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:58.739468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd166a-009e-42fa-89ed-1d2b8359eae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:58.739748 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd166a-009e-42fa-89ed-1d2b8359eae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:58.816493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd166a-009e-42fa-89ed-1d2b8359eae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:58.817904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd166a-009e-42fa-89ed-1d2b8359eae3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:58.831966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:58.935519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 541/1082] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:19:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:19:58.937140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c569ace-76c6-4f30-ac78-6ca79456c806 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:58.995778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:59.042668 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c569ace-76c6-4f30-ac78-6ca79456c806 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:59.076507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b43673-ec8d-4998-81e5-7303dc69e71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:59.077265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b43673-ec8d-4998-81e5-7303dc69e71f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:59.077574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b43673-ec8d-4998-81e5-7303dc69e71f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:59.077859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b43673-ec8d-4998-81e5-7303dc69e71f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:59.088846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b43673-ec8d-4998-81e5-7303dc69e71f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:59.090304 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b43673-ec8d-4998-81e5-7303dc69e71f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-16b43673-ec8d-4998-81e5-7303dc69e71f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:19:59.107854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:19:59.109074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:19:59.114709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:19:59.114709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:19:59.114709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:19:59.114709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:19:59.114709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 542/1083] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:19:59.116615 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd166a-009e-42fa-89ed-1d2b8359eae3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:19:59.220351 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd166a-009e-42fa-89ed-1d2b8359eae3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:19:59.233944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:19:59.257053 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77c4c6-a2b8-432f-bb87-94fa39a4d99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:19:59.258108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77c4c6-a2b8-432f-bb87-94fa39a4d99e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:19:59.258545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77c4c6-a2b8-432f-bb87-94fa39a4d99e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:19:59.258977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77c4c6-a2b8-432f-bb87-94fa39a4d99e None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:19:59.259906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77c4c6-a2b8-432f-bb87-94fa39a4d99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:19:59.260373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77c4c6-a2b8-432f-bb87-94fa39a4d99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:19:59.261976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77c4c6-a2b8-432f-bb87-94fa39a4d99e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:19:59.280829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 542/1084] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:00.383458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1259b-61ac-4198-af85-537178f6df60 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:00.384009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1259b-61ac-4198-af85-537178f6df60 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:00.384009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1259b-61ac-4198-af85-537178f6df60 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:00.385440 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 543/1085] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:00.390733 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c963eea-711a-40c0-b105-23958f19b958 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:00.391153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c963eea-711a-40c0-b105-23958f19b958 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:00.391336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c963eea-711a-40c0-b105-23958f19b958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:00.408823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4c963eea-711a-40c0-b105-23958f19b958 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:00.410007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4c963eea-711a-40c0-b105-23958f19b958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:00.476972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 543/1086] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:00.500023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1259b-61ac-4198-af85-537178f6df60 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:00.602138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1259b-61ac-4198-af85-537178f6df60 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:00.610996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:00.636302 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07222f-8678-4978-84e3-e1c6aea9082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:00.637073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07222f-8678-4978-84e3-e1c6aea9082f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:00.637354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07222f-8678-4978-84e3-e1c6aea9082f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:00.637633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07222f-8678-4978-84e3-e1c6aea9082f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:00.650375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07222f-8678-4978-84e3-e1c6aea9082f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0e07222f-8678-4978-84e3-e1c6aea9082f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:00.658748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:00.659842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:00.660740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:00.660740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:00.660740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:00.660740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:00.660740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:00.660740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:00.660740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:00.660740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:00.660740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:00.660740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:00.660740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:20:00.660740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:20:00.660740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 544/1087] 10.222.0.39 () {56 vars in 1120 bytes} [Thu May 26 12:20:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:00.666766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c963eea-711a-40c0-b105-23958f19b958 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:00.765299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c963eea-711a-40c0-b105-23958f19b958 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:00.766832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:00.801465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff77ee5-dbda-4c70-9bea-71dd6c59d5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:00.802138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff77ee5-dbda-4c70-9bea-71dd6c59d5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:00.802425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff77ee5-dbda-4c70-9bea-71dd6c59d5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:00.802705 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff77ee5-dbda-4c70-9bea-71dd6c59d5e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:00.803459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff77ee5-dbda-4c70-9bea-71dd6c59d5e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:00.803770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff77ee5-dbda-4c70-9bea-71dd6c59d5e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:00.805212 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff77ee5-dbda-4c70-9bea-71dd6c59d5e8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:00.813138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 544/1088] 10.222.0.39 () {56 vars in 1115 bytes} [Thu May 26 12:20:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:00.818845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07222f-8678-4978-84e3-e1c6aea9082f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:00.829767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7fb0a-4d50-4e98-ad7e-234aff41c26a None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:00.830063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7fb0a-4d50-4e98-ad7e-234aff41c26a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:00.830347 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a7fb0a-4d50-4e98-ad7e-234aff41c26a None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:00.831693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 545/1089] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:20:00.837298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5fe6e-d0e5-405b-90d8-038c13b5347d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:00.837590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5fe6e-d0e5-405b-90d8-038c13b5347d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:00.837876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5fe6e-d0e5-405b-90d8-038c13b5347d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:00.853980 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e6a5fe6e-d0e5-405b-90d8-038c13b5347d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:00.855171 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e6a5fe6e-d0e5-405b-90d8-038c13b5347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:00.925363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07222f-8678-4978-84e3-e1c6aea9082f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:00.933856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 546/1090] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:20:00.957593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5fe6e-d0e5-405b-90d8-038c13b5347d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:00.960088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b66778-42fc-4e99-9600-e860f89f1e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:00.961042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b66778-42fc-4e99-9600-e860f89f1e5d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:00.961335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b66778-42fc-4e99-9600-e860f89f1e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:00.961599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b66778-42fc-4e99-9600-e860f89f1e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:00.972266 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b66778-42fc-4e99-9600-e860f89f1e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:00.973739 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b66778-42fc-4e99-9600-e860f89f1e5d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-a0b66778-42fc-4e99-9600-e860f89f1e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:20:00.990361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:00.991961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:00.993156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:20:00.993156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:20:00.993156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:20:00.993156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:20:00.993156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 545/1091] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:00.997819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b66778-42fc-4e99-9600-e860f89f1e5d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:01.019813 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:01.053644 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:01.061394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5fe6e-d0e5-405b-90d8-038c13b5347d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:01.096241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403d778-f00d-4cbf-9e79-b6b3fe83ed2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:01.097066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403d778-f00d-4cbf-9e79-b6b3fe83ed2b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.097172 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b66778-42fc-4e99-9600-e860f89f1e5d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:01.097349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403d778-f00d-4cbf-9e79-b6b3fe83ed2b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.097621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403d778-f00d-4cbf-9e79-b6b3fe83ed2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.108575 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403d778-f00d-4cbf-9e79-b6b3fe83ed2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-7403d778-f00d-4cbf-9e79-b6b3fe83ed2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:01.116101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:01.117929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:01.118809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:01.118809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:01.118809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:01.118809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:01.118809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:01.118809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:01.118809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:01.118809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:01.118809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:01.118809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:01.118809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:01.118809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:20:01.118809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 547/1092] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:20:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:01.124349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403d778-f00d-4cbf-9e79-b6b3fe83ed2b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:01.130628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c90f9-45e8-410c-8585-c30a4d0ed5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:01.131292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c90f9-45e8-410c-8585-c30a4d0ed5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.131579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c90f9-45e8-410c-8585-c30a4d0ed5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.131856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c90f9-45e8-410c-8585-c30a4d0ed5c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.132685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c90f9-45e8-410c-8585-c30a4d0ed5c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:01.133022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c90f9-45e8-410c-8585-c30a4d0ed5c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:01.134394 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c90f9-45e8-410c-8585-c30a4d0ed5c8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:01.151408 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 546/1093] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:01.152383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c90f9-45e8-410c-8585-c30a4d0ed5c8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:01.226091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403d778-f00d-4cbf-9e79-b6b3fe83ed2b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:01.242749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:01.261111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c827c-44aa-4d41-ad06-4200ee4db5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:01.261802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c827c-44aa-4d41-ad06-4200ee4db5fa None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.262084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c827c-44aa-4d41-ad06-4200ee4db5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.262360 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c827c-44aa-4d41-ad06-4200ee4db5fa None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.263119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c827c-44aa-4d41-ad06-4200ee4db5fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:01.263426 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c827c-44aa-4d41-ad06-4200ee4db5fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:01.264837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c827c-44aa-4d41-ad06-4200ee4db5fa None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:01.268122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c90f9-45e8-410c-8585-c30a4d0ed5c8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:01.280675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 548/1094] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:20:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:01.281740 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c827c-44aa-4d41-ad06-4200ee4db5fa None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:01.300690 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:01.310250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c96cb-c653-4635-a34c-bd609a06edd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:01.311049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c96cb-c653-4635-a34c-bd609a06edd4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.311334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c96cb-c653-4635-a34c-bd609a06edd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.311613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c96cb-c653-4635-a34c-bd609a06edd4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.318738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c96cb-c653-4635-a34c-bd609a06edd4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:01.320938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c96cb-c653-4635-a34c-bd609a06edd4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-887c96cb-c653-4635-a34c-bd609a06edd4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:20:01.335146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:01.336838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:01.338224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:01.338224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:01.338224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:20:01.338224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:20:01.338224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:20:01.338224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:20:01.338224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:20:01.338224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:20:01.338224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:20:01.338224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:20:01.338224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 547/1095] 10.222.0.39 () {56 vars in 1093 bytes} [Thu May 26 12:20:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:01.342537 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c96cb-c653-4635-a34c-bd609a06edd4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:01.384358 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c827c-44aa-4d41-ad06-4200ee4db5fa None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:01.419421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08d4ee-0496-4802-9731-9e6c45e03218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:01.420228 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08d4ee-0496-4802-9731-9e6c45e03218 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.420512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08d4ee-0496-4802-9731-9e6c45e03218 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.420818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08d4ee-0496-4802-9731-9e6c45e03218 None admin] PATH_INFO: `/v3/users/93f903abb7344ccaa1f47d301246c4f8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.422020 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08d4ee-0496-4802-9731-9e6c45e03218 None admin] RBAC: Authorizing `identity:get_user(user_id=93f903abb7344ccaa1f47d301246c4f8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:01.423450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08d4ee-0496-4802-9731-9e6c45e03218 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:01.425180 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 549/1096] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:20:01 2022] GET /identity/v3/users/93f903abb7344ccaa1f47d301246c4f8 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:01.430822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08d4ee-0496-4802-9731-9e6c45e03218 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:01.442197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c96cb-c653-4635-a34c-bd609a06edd4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:01.475860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cdc15-3043-440b-a4c0-c70b02b1b4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:01.476521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cdc15-3043-440b-a4c0-c70b02b1b4ec None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.476841 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cdc15-3043-440b-a4c0-c70b02b1b4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.477120 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cdc15-3043-440b-a4c0-c70b02b1b4ec None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.477951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cdc15-3043-440b-a4c0-c70b02b1b4ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:01.478260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cdc15-3043-440b-a4c0-c70b02b1b4ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:01.479690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cdc15-3043-440b-a4c0-c70b02b1b4ec None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:01.488084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:01.497178 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 548/1097] 10.222.0.39 () {56 vars in 1133 bytes} [Thu May 26 12:20:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:01.502744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cdc15-3043-440b-a4c0-c70b02b1b4ec None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:01.521012 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:01.538096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08d4ee-0496-4802-9731-9e6c45e03218 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:01.574049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b235fa-db16-4b29-a5ce-27b7135c9170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:01.574784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b235fa-db16-4b29-a5ce-27b7135c9170 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.575075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b235fa-db16-4b29-a5ce-27b7135c9170 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.575358 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b235fa-db16-4b29-a5ce-27b7135c9170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.605726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cdc15-3043-440b-a4c0-c70b02b1b4ec None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:01.640450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b11ddc-4f3b-46e2-98e7-32c2d56ac856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:01.641137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b11ddc-4f3b-46e2-98e7-32c2d56ac856 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.641423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b11ddc-4f3b-46e2-98e7-32c2d56ac856 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.641690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b11ddc-4f3b-46e2-98e7-32c2d56ac856 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.654429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b235fa-db16-4b29-a5ce-27b7135c9170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:01.655919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b235fa-db16-4b29-a5ce-27b7135c9170 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:01.707091 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:01.711772 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b11ddc-4f3b-46e2-98e7-32c2d56ac856 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:01.713281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b11ddc-4f3b-46e2-98e7-32c2d56ac856 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:01.739342 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:01.756175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 550/1098] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:20:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:20:01.762234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b235fa-db16-4b29-a5ce-27b7135c9170 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:01.818239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 549/1099] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:20:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:20:01.819997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b11ddc-4f3b-46e2-98e7-32c2d56ac856 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:01.863681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b235fa-db16-4b29-a5ce-27b7135c9170 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:01.903224 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894352b1-f153-4090-a0fb-f70c69e0d67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:01.904097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894352b1-f153-4090-a0fb-f70c69e0d67f None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.904384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894352b1-f153-4090-a0fb-f70c69e0d67f None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.904664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894352b1-f153-4090-a0fb-f70c69e0d67f None admin] PATH_INFO: `/v3/projects/af91450ab07c4884ab2898e3018e35be` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.905881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894352b1-f153-4090-a0fb-f70c69e0d67f None admin] RBAC: Authorizing `identity:get_project(project_id=af91450ab07c4884ab2898e3018e35be)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:01.907321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894352b1-f153-4090-a0fb-f70c69e0d67f None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:01.909059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 551/1100] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:20:01 2022] GET /identity/v3/projects/af91450ab07c4884ab2898e3018e35be => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:01.915068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894352b1-f153-4090-a0fb-f70c69e0d67f None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:01.916466 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:01.921128 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b11ddc-4f3b-46e2-98e7-32c2d56ac856 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:01.955491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b581f6-6a45-48f2-a464-d9fef228d251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:01.956278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b581f6-6a45-48f2-a464-d9fef228d251 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:01.956557 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b581f6-6a45-48f2-a464-d9fef228d251 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:01.956864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b581f6-6a45-48f2-a464-d9fef228d251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:01.967178 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b581f6-6a45-48f2-a464-d9fef228d251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:01.968430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:01.968586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b581f6-6a45-48f2-a464-d9fef228d251 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-17b581f6-6a45-48f2-a464-d9fef228d251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:20:01.995954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:01.997088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:01.998142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:20:01.998142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:20:01.998142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:20:01.998142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:20:01.998384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 550/1101] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:20:02.003727 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b581f6-6a45-48f2-a464-d9fef228d251 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:02.016892 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894352b1-f153-4090-a0fb-f70c69e0d67f None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:02.050822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7b11a-2486-4ded-ae81-78f1d3085890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:02.051475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7b11a-2486-4ded-ae81-78f1d3085890 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:02.051760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7b11a-2486-4ded-ae81-78f1d3085890 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:02.052049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7b11a-2486-4ded-ae81-78f1d3085890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:02.052910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7b11a-2486-4ded-ae81-78f1d3085890 None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=af91450ab07c4884ab2898e3018e35be, user.id=93f903abb7344ccaa1f47d301246c4f8) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:02.053230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7b11a-2486-4ded-ae81-78f1d3085890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:02.054802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7b11a-2486-4ded-ae81-78f1d3085890 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:02.060549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 552/1102] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:20:01 2022] GET /identity/v3/role_assignments?user.id=93f903abb7344ccaa1f47d301246c4f8&scope.project.id=af91450ab07c4884ab2898e3018e35be&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:02.106198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b581f6-6a45-48f2-a464-d9fef228d251 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:02.143677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ccd8a-a9f9-44ff-be4a-70de1f9623e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:02.144362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ccd8a-a9f9-44ff-be4a-70de1f9623e0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:02.144650 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ccd8a-a9f9-44ff-be4a-70de1f9623e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:02.144959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ccd8a-a9f9-44ff-be4a-70de1f9623e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:02.145699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ccd8a-a9f9-44ff-be4a-70de1f9623e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:02.146009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ccd8a-a9f9-44ff-be4a-70de1f9623e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:02.147724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ccd8a-a9f9-44ff-be4a-70de1f9623e0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:02.160148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 551/1103] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:02.166562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7b11a-2486-4ded-ae81-78f1d3085890 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:02.271529 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7b11a-2486-4ded-ae81-78f1d3085890 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:02.288897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:02.306556 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494c75b-e614-48e9-94a2-ccfc5374a5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:02.307365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494c75b-e614-48e9-94a2-ccfc5374a5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:02.307653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494c75b-e614-48e9-94a2-ccfc5374a5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:02.307934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494c75b-e614-48e9-94a2-ccfc5374a5f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:02.314687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494c75b-e614-48e9-94a2-ccfc5374a5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:02.316128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494c75b-e614-48e9-94a2-ccfc5374a5f0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-7494c75b-e614-48e9-94a2-ccfc5374a5f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:20:02.330769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:02.331847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:02.332812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:20:02.332812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:20:02.332812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:20:02.332812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:20:02.332812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:20:02.332812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:20:02.332812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:20:02.332812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:20:02.332812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 553/1104] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:02.339914 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ccd8a-a9f9-44ff-be4a-70de1f9623e0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:02.352887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:02.438950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ccd8a-a9f9-44ff-be4a-70de1f9623e0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:02.473641 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478882d-2b43-4cdb-9040-affb8022f17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:02.474297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478882d-2b43-4cdb-9040-affb8022f17f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:02.474580 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478882d-2b43-4cdb-9040-affb8022f17f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:02.474855 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478882d-2b43-4cdb-9040-affb8022f17f None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:02.475641 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478882d-2b43-4cdb-9040-affb8022f17f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:02.476262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478882d-2b43-4cdb-9040-affb8022f17f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:02.477733 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478882d-2b43-4cdb-9040-affb8022f17f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:02.489671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 552/1105] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:02.496211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494c75b-e614-48e9-94a2-ccfc5374a5f0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:02.595471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494c75b-e614-48e9-94a2-ccfc5374a5f0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:02.629026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082f5fa-c39e-4e32-a748-0414ba071ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:02.629679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f5fa-c39e-4e32-a748-0414ba071ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:02.629965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f5fa-c39e-4e32-a748-0414ba071ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:02.630240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082f5fa-c39e-4e32-a748-0414ba071ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:02.631065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082f5fa-c39e-4e32-a748-0414ba071ca6 None admin] RBAC: Adding query filter params (role.id=c130ba76816741e29f2e2a913e37b50c, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=04f5fbbe45ec4dcf8301da8483af2941) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:02.631380 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082f5fa-c39e-4e32-a748-0414ba071ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:02.633583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082f5fa-c39e-4e32-a748-0414ba071ca6 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:02.639422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 554/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:20:02 2022] GET /identity/v3/role_assignments?user.id=04f5fbbe45ec4dcf8301da8483af2941&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=c130ba76816741e29f2e2a913e37b50c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:04.324100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e5398-8e55-4607-a7cf-5359692c54c4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:04.324627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e5398-8e55-4607-a7cf-5359692c54c4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:04.324747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e5398-8e55-4607-a7cf-5359692c54c4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:04.326085 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 553/1107] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:04.331388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782bd02-3e08-429f-8ff4-4b9c5c568407 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:04.331818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782bd02-3e08-429f-8ff4-4b9c5c568407 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:04.331942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782bd02-3e08-429f-8ff4-4b9c5c568407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:04.349310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c782bd02-3e08-429f-8ff4-4b9c5c568407 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:04.350472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c782bd02-3e08-429f-8ff4-4b9c5c568407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:04.384609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:04.417638 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 555/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:04.442256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e5398-8e55-4607-a7cf-5359692c54c4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:04.512728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:04.544129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e5398-8e55-4607-a7cf-5359692c54c4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:04.585361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db1b74-3205-4ece-a404-704ba65cb39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:04.586642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db1b74-3205-4ece-a404-704ba65cb39a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:04.586920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db1b74-3205-4ece-a404-704ba65cb39a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:04.587197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db1b74-3205-4ece-a404-704ba65cb39a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:04.588429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db1b74-3205-4ece-a404-704ba65cb39a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:04.589918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db1b74-3205-4ece-a404-704ba65cb39a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:04.591544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 554/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:20:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:04.599122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782bd02-3e08-429f-8ff4-4b9c5c568407 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:04.700071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782bd02-3e08-429f-8ff4-4b9c5c568407 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:04.732361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e11177-ab15-4422-8749-7a8f0284d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:04.733062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e11177-ab15-4422-8749-7a8f0284d32d None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:04.733349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e11177-ab15-4422-8749-7a8f0284d32d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:04.733626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e11177-ab15-4422-8749-7a8f0284d32d None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:04.734344 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e11177-ab15-4422-8749-7a8f0284d32d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:04.735766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e11177-ab15-4422-8749-7a8f0284d32d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:04.754956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 556/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:20:04 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:20:07.007826 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c29dd-86b8-43d0-9a6c-584011c47c95 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:07.008362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c29dd-86b8-43d0-9a6c-584011c47c95 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:07.008362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c29dd-86b8-43d0-9a6c-584011c47c95 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:07.009805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 555/1111] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:07.015083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48519f-b910-4684-8231-168ae0ea27aa None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:07.015465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48519f-b910-4684-8231-168ae0ea27aa None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:07.015643 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48519f-b910-4684-8231-168ae0ea27aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:07.033213 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-df48519f-b910-4684-8231-168ae0ea27aa None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:07.034370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-df48519f-b910-4684-8231-168ae0ea27aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:07.054947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:07.100775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 557/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:07.125025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c29dd-86b8-43d0-9a6c-584011c47c95 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:07.223204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c29dd-86b8-43d0-9a6c-584011c47c95 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:07.255754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ddbca-2c1e-4b92-ae69-76440bfcab47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:07.256603 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ddbca-2c1e-4b92-ae69-76440bfcab47 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:07.256911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ddbca-2c1e-4b92-ae69-76440bfcab47 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:07.257186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ddbca-2c1e-4b92-ae69-76440bfcab47 None admin] PATH_INFO: `/v3/roles/512083f4095a4f23a8dd4e8789fa20b3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:07.259251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ddbca-2c1e-4b92-ae69-76440bfcab47 None admin] RBAC: Authorizing `identity:get_role(role_id=512083f4095a4f23a8dd4e8789fa20b3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:07.260622 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ddbca-2c1e-4b92-ae69-76440bfcab47 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:07.262009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 556/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:20:07 2022] GET /identity/v3/roles/512083f4095a4f23a8dd4e8789fa20b3 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:07.267775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48519f-b910-4684-8231-168ae0ea27aa None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:07.363135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48519f-b910-4684-8231-168ae0ea27aa None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:07.396719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9abf57-556b-4538-9e40-becfd26c5d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:07.397855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9abf57-556b-4538-9e40-becfd26c5d37 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:07.398203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9abf57-556b-4538-9e40-becfd26c5d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:07.398721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9abf57-556b-4538-9e40-becfd26c5d37 None admin] PATH_INFO: `/v3/users/19538316b1724983a813fee02c8a6c43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:07.411214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9abf57-556b-4538-9e40-becfd26c5d37 None admin] RBAC: Authorizing `identity:get_user(user_id=19538316b1724983a813fee02c8a6c43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:07.412630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9abf57-556b-4538-9e40-becfd26c5d37 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:07.415220 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 558/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:20:07 2022] GET /identity/v3/users/19538316b1724983a813fee02c8a6c43 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:07.420878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ddbca-2c1e-4b92-ae69-76440bfcab47 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:07.430125 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:07.517424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ddbca-2c1e-4b92-ae69-76440bfcab47 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:07.550597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bb80b-4e69-45e7-a656-988b4fe42da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:07.551236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bb80b-4e69-45e7-a656-988b4fe42da0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:07.551516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bb80b-4e69-45e7-a656-988b4fe42da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:07.551791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bb80b-4e69-45e7-a656-988b4fe42da0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:07.617535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bb80b-4e69-45e7-a656-988b4fe42da0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:07.618975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94bb80b-4e69-45e7-a656-988b4fe42da0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:07.626330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:07.714161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 557/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:20:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:20:07.719991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9abf57-556b-4538-9e40-becfd26c5d37 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:07.735111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:07.817711 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9abf57-556b-4538-9e40-becfd26c5d37 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:07.850229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c5e0b-909d-473b-baf8-694792737648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:07.851081 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c5e0b-909d-473b-baf8-694792737648 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:07.852016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c5e0b-909d-473b-baf8-694792737648 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:07.852466 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c5e0b-909d-473b-baf8-694792737648 None admin] PATH_INFO: `/v3/projects/af91450ab07c4884ab2898e3018e35be` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:07.853665 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c5e0b-909d-473b-baf8-694792737648 None admin] RBAC: Authorizing `identity:get_project(project_id=af91450ab07c4884ab2898e3018e35be)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:07.855078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c5e0b-909d-473b-baf8-694792737648 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:07.856768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 559/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:20:07 2022] GET /identity/v3/projects/af91450ab07c4884ab2898e3018e35be => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:07.862790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bb80b-4e69-45e7-a656-988b4fe42da0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:07.959298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bb80b-4e69-45e7-a656-988b4fe42da0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:07.967237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:07.993404 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ff8b7-2e85-4bba-8ca8-042ca3692154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:07.994042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ff8b7-2e85-4bba-8ca8-042ca3692154 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:07.994321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ff8b7-2e85-4bba-8ca8-042ca3692154 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:07.994589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ff8b7-2e85-4bba-8ca8-042ca3692154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:07.995402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ff8b7-2e85-4bba-8ca8-042ca3692154 None admin] RBAC: Adding query filter params (role.id=512083f4095a4f23a8dd4e8789fa20b3, scope.project.id=af91450ab07c4884ab2898e3018e35be, user.id=19538316b1724983a813fee02c8a6c43) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:07.995711 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ff8b7-2e85-4bba-8ca8-042ca3692154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:07.997171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ff8b7-2e85-4bba-8ca8-042ca3692154 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:08.002385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 558/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:20:07 2022] GET /identity/v3/role_assignments?user.id=19538316b1724983a813fee02c8a6c43&scope.project.id=af91450ab07c4884ab2898e3018e35be&role.id=512083f4095a4f23a8dd4e8789fa20b3 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:10.174471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fc0d4-fcd6-4ca1-a753-3d45a3d8cc73 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.174990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fc0d4-fcd6-4ca1-a753-3d45a3d8cc73 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.174990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fc0d4-fcd6-4ca1-a753-3d45a3d8cc73 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.176296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 560/1118] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:20:10.182002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2d05-ac89-492f-bc5c-3a77ab4c7120 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.182413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2d05-ac89-492f-bc5c-3a77ab4c7120 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.182559 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2d05-ac89-492f-bc5c-3a77ab4c7120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.199747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9fac2d05-ac89-492f-bc5c-3a77ab4c7120 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:10.200983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9fac2d05-ac89-492f-bc5c-3a77ab4c7120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:10.266004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 559/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:10.287902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fc0d4-fcd6-4ca1-a753-3d45a3d8cc73 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:10.373915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:10.392900 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fc0d4-fcd6-4ca1-a753-3d45a3d8cc73 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:10.426547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57304325-8b08-4979-b456-f6d919bc3215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:10.427340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57304325-8b08-4979-b456-f6d919bc3215 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.427618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57304325-8b08-4979-b456-f6d919bc3215 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.427889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57304325-8b08-4979-b456-f6d919bc3215 None admin] PATH_INFO: `/v3/roles/512083f4095a4f23a8dd4e8789fa20b3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.429367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57304325-8b08-4979-b456-f6d919bc3215 None admin] RBAC: Authorizing `identity:get_role(role_id=512083f4095a4f23a8dd4e8789fa20b3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:10.431645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57304325-8b08-4979-b456-f6d919bc3215 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:10.433021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 561/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:20:10 2022] GET /identity/v3/roles/512083f4095a4f23a8dd4e8789fa20b3 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:10.438823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac2d05-ac89-492f-bc5c-3a77ab4c7120 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:10.532601 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:10.535831 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac2d05-ac89-492f-bc5c-3a77ab4c7120 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:10.570200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205d05a-78b8-463a-a0ef-6fd612a1be78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:10.571334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205d05a-78b8-463a-a0ef-6fd612a1be78 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.571617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205d05a-78b8-463a-a0ef-6fd612a1be78 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.571890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205d05a-78b8-463a-a0ef-6fd612a1be78 None admin] PATH_INFO: `/v3/users/19538316b1724983a813fee02c8a6c43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.573090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205d05a-78b8-463a-a0ef-6fd612a1be78 None admin] RBAC: Authorizing `identity:get_user(user_id=19538316b1724983a813fee02c8a6c43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:10.574508 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205d05a-78b8-463a-a0ef-6fd612a1be78 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:10.576096 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 560/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:20:10 2022] GET /identity/v3/users/19538316b1724983a813fee02c8a6c43 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:10.581763 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57304325-8b08-4979-b456-f6d919bc3215 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:10.678612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57304325-8b08-4979-b456-f6d919bc3215 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:10.711547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fa61f-8185-434f-9246-1e977e04aa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:10.712524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fa61f-8185-434f-9246-1e977e04aa98 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.712838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fa61f-8185-434f-9246-1e977e04aa98 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.713121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fa61f-8185-434f-9246-1e977e04aa98 None admin] PATH_INFO: `/v3/projects/af91450ab07c4884ab2898e3018e35be` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.714302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fa61f-8185-434f-9246-1e977e04aa98 None admin] RBAC: Authorizing `identity:get_project(project_id=af91450ab07c4884ab2898e3018e35be)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:10.715721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fa61f-8185-434f-9246-1e977e04aa98 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:10.717417 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 562/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:20:10 2022] GET /identity/v3/projects/af91450ab07c4884ab2898e3018e35be => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:20:10.723085 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205d05a-78b8-463a-a0ef-6fd612a1be78 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:10.819517 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205d05a-78b8-463a-a0ef-6fd612a1be78 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:10.852468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab44cb8-116c-4b87-bb18-fc54ca0402bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:10.853355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab44cb8-116c-4b87-bb18-fc54ca0402bc None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:10.853634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab44cb8-116c-4b87-bb18-fc54ca0402bc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:10.853902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab44cb8-116c-4b87-bb18-fc54ca0402bc None admin] PATH_INFO: `/v3/projects/af91450ab07c4884ab2898e3018e35be/users/19538316b1724983a813fee02c8a6c43/roles/512083f4095a4f23a8dd4e8789fa20b3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:10.856046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab44cb8-116c-4b87-bb18-fc54ca0402bc None admin] RBAC: Authorizing `identity:create_grant(project_id=af91450ab07c4884ab2898e3018e35be, user_id=19538316b1724983a813fee02c8a6c43, role_id=512083f4095a4f23a8dd4e8789fa20b3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:10.857488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab44cb8-116c-4b87-bb18-fc54ca0402bc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:10.870089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 561/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:20:10 2022] PUT /identity/v3/projects/af91450ab07c4884ab2898e3018e35be/users/19538316b1724983a813fee02c8a6c43/roles/512083f4095a4f23a8dd4e8789fa20b3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:13.052791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b272c-c70a-4a0e-8682-65075ad49a22 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:13.053331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b272c-c70a-4a0e-8682-65075ad49a22 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:13.053331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b272c-c70a-4a0e-8682-65075ad49a22 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:13.055240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 563/1124] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:13.060497 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a677d-7baf-4639-a9fe-d30b9214324a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:13.060909 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a677d-7baf-4639-a9fe-d30b9214324a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:13.061095 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a677d-7baf-4639-a9fe-d30b9214324a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:13.078089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ad8a677d-7baf-4639-a9fe-d30b9214324a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:13.079264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ad8a677d-7baf-4639-a9fe-d30b9214324a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:13.101214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:13.145051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 562/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:13.168473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b272c-c70a-4a0e-8682-65075ad49a22 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:13.187648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:13.268968 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b272c-c70a-4a0e-8682-65075ad49a22 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:13.302347 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28623f5-a4eb-4f43-b000-64ecb891d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:13.303196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28623f5-a4eb-4f43-b000-64ecb891d360 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:13.303484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28623f5-a4eb-4f43-b000-64ecb891d360 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:13.303763 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28623f5-a4eb-4f43-b000-64ecb891d360 None admin] PATH_INFO: `/v3/roles/512083f4095a4f23a8dd4e8789fa20b3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:13.305662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28623f5-a4eb-4f43-b000-64ecb891d360 None admin] RBAC: Authorizing `identity:get_role(role_id=512083f4095a4f23a8dd4e8789fa20b3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:13.307018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28623f5-a4eb-4f43-b000-64ecb891d360 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:13.308360 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 564/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:20:13 2022] GET /identity/v3/roles/512083f4095a4f23a8dd4e8789fa20b3 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:13.313962 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a677d-7baf-4639-a9fe-d30b9214324a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:13.410743 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a677d-7baf-4639-a9fe-d30b9214324a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:13.443485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117b63d-6e59-4de8-a00d-fd0ebc08f59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:13.444347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117b63d-6e59-4de8-a00d-fd0ebc08f59d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:13.444632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117b63d-6e59-4de8-a00d-fd0ebc08f59d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:13.444936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117b63d-6e59-4de8-a00d-fd0ebc08f59d None admin] PATH_INFO: `/v3/users/19538316b1724983a813fee02c8a6c43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:13.446656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117b63d-6e59-4de8-a00d-fd0ebc08f59d None admin] RBAC: Authorizing `identity:get_user(user_id=19538316b1724983a813fee02c8a6c43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:13.448077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117b63d-6e59-4de8-a00d-fd0ebc08f59d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:13.449710 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 563/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:20:13 2022] GET /identity/v3/users/19538316b1724983a813fee02c8a6c43 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:13.455360 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28623f5-a4eb-4f43-b000-64ecb891d360 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:13.538109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:13.553403 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28623f5-a4eb-4f43-b000-64ecb891d360 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:13.589311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d06bb-6d4b-416a-a82c-4f998982b808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:13.589956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d06bb-6d4b-416a-a82c-4f998982b808 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:13.590274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d06bb-6d4b-416a-a82c-4f998982b808 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:13.590555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d06bb-6d4b-416a-a82c-4f998982b808 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:13.656763 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d06bb-6d4b-416a-a82c-4f998982b808 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:13.658230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d06bb-6d4b-416a-a82c-4f998982b808 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:13.738279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:13.753355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 565/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:20:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:20:13.759331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117b63d-6e59-4de8-a00d-fd0ebc08f59d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:13.786468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:13.857349 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117b63d-6e59-4de8-a00d-fd0ebc08f59d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:13.889928 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc088cbd-94c4-410a-96ee-cfc40346e626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:13.890788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc088cbd-94c4-410a-96ee-cfc40346e626 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:13.891073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc088cbd-94c4-410a-96ee-cfc40346e626 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:13.891350 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc088cbd-94c4-410a-96ee-cfc40346e626 None admin] PATH_INFO: `/v3/projects/af91450ab07c4884ab2898e3018e35be` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:13.892544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc088cbd-94c4-410a-96ee-cfc40346e626 None admin] RBAC: Authorizing `identity:get_project(project_id=af91450ab07c4884ab2898e3018e35be)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:13.894011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc088cbd-94c4-410a-96ee-cfc40346e626 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:13.895695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 564/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:20:13 2022] GET /identity/v3/projects/af91450ab07c4884ab2898e3018e35be => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:13.902570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d06bb-6d4b-416a-a82c-4f998982b808 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:13.998366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d06bb-6d4b-416a-a82c-4f998982b808 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:14.031899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455fada-8558-499c-a974-f9116bbd8fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:14.032546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455fada-8558-499c-a974-f9116bbd8fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:14.032865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455fada-8558-499c-a974-f9116bbd8fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:14.033146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455fada-8558-499c-a974-f9116bbd8fe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:14.033977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455fada-8558-499c-a974-f9116bbd8fe5 None admin] RBAC: Adding query filter params (role.id=512083f4095a4f23a8dd4e8789fa20b3, scope.project.id=af91450ab07c4884ab2898e3018e35be, user.id=19538316b1724983a813fee02c8a6c43) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:14.034292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455fada-8558-499c-a974-f9116bbd8fe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:14.035712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455fada-8558-499c-a974-f9116bbd8fe5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:14.041997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 566/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:20:13 2022] GET /identity/v3/role_assignments?user.id=19538316b1724983a813fee02c8a6c43&scope.project.id=af91450ab07c4884ab2898e3018e35be&role.id=512083f4095a4f23a8dd4e8789fa20b3 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:16.233547 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547e934-dc79-4e9a-b72c-7d59e6b7db3b None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:16.234058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547e934-dc79-4e9a-b72c-7d59e6b7db3b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:16.234168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547e934-dc79-4e9a-b72c-7d59e6b7db3b None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:16.235478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 565/1131] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:16.240580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f8a34-d336-4fb1-9f88-16967ff6cc9a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:16.241016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f8a34-d336-4fb1-9f88-16967ff6cc9a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:16.241165 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f8a34-d336-4fb1-9f88-16967ff6cc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:16.258166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a92f8a34-d336-4fb1-9f88-16967ff6cc9a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:16.259337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a92f8a34-d336-4fb1-9f88-16967ff6cc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:16.304249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:16.331681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 567/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:16.355224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547e934-dc79-4e9a-b72c-7d59e6b7db3b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:16.447581 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:16.455332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547e934-dc79-4e9a-b72c-7d59e6b7db3b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:16.488153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a96ba1-52f7-410e-9169-9852ae202871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:16.488911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a96ba1-52f7-410e-9169-9852ae202871 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:16.489197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a96ba1-52f7-410e-9169-9852ae202871 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:16.489475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a96ba1-52f7-410e-9169-9852ae202871 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:16.490635 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a96ba1-52f7-410e-9169-9852ae202871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:16.492065 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a96ba1-52f7-410e-9169-9852ae202871 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:16.494246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 566/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:20:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:16.499971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f8a34-d336-4fb1-9f88-16967ff6cc9a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:16.599236 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f8a34-d336-4fb1-9f88-16967ff6cc9a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:16.633712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05490050-ec96-424c-bafe-7d72696c7886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:16.634368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05490050-ec96-424c-bafe-7d72696c7886 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:16.634658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05490050-ec96-424c-bafe-7d72696c7886 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:16.634939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05490050-ec96-424c-bafe-7d72696c7886 None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:16.635668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05490050-ec96-424c-bafe-7d72696c7886 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:16.637153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05490050-ec96-424c-bafe-7d72696c7886 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:16.667000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 568/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:20:16 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:20:18.898827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d90c27-31b0-4e79-b5ee-36d5c132882a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:18.900271 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d90c27-31b0-4e79-b5ee-36d5c132882a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:18.900563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d90c27-31b0-4e79-b5ee-36d5c132882a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:18.901993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 567/1135] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:18.907133 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeba5db-4778-44f4-b1e2-29e83575fc41 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:18.907504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeba5db-4778-44f4-b1e2-29e83575fc41 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:18.907696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeba5db-4778-44f4-b1e2-29e83575fc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:18.924425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4aeba5db-4778-44f4-b1e2-29e83575fc41 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:18.925623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4aeba5db-4778-44f4-b1e2-29e83575fc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:18.951473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:18.991098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 569/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:19.016513 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d90c27-31b0-4e79-b5ee-36d5c132882a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:19.115415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d90c27-31b0-4e79-b5ee-36d5c132882a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:19.147934 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a203d-c74a-44f7-a275-369f97081d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:19.149593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a203d-c74a-44f7-a275-369f97081d6f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:19.149878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a203d-c74a-44f7-a275-369f97081d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:19.150157 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a203d-c74a-44f7-a275-369f97081d6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:19.151329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a203d-c74a-44f7-a275-369f97081d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:19.152849 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a203d-c74a-44f7-a275-369f97081d6f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:19.154443 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 568/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:20:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:19.160090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeba5db-4778-44f4-b1e2-29e83575fc41 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:19.256466 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeba5db-4778-44f4-b1e2-29e83575fc41 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:19.290407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279ed7d-b94a-4623-bc12-08db08926a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:19.291055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279ed7d-b94a-4623-bc12-08db08926a98 None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:19.291336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279ed7d-b94a-4623-bc12-08db08926a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:19.291610 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279ed7d-b94a-4623-bc12-08db08926a98 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:19.292312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279ed7d-b94a-4623-bc12-08db08926a98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:19.293778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279ed7d-b94a-4623-bc12-08db08926a98 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:19.313175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 570/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:20:19 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:21.583245 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e80c6-39d2-4403-894b-f2e768abe502 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.583769 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e80c6-39d2-4403-894b-f2e768abe502 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.583865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e80c6-39d2-4403-894b-f2e768abe502 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.585223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 569/1139] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:21.591189 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf465e-3340-49ec-ab5a-805879a14289 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.591604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf465e-3340-49ec-ab5a-805879a14289 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.591754 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf465e-3340-49ec-ab5a-805879a14289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.610340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-09bf465e-3340-49ec-ab5a-805879a14289 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:21.611551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-09bf465e-3340-49ec-ab5a-805879a14289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:21.625128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:21.679116 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 571/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:21.702809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e80c6-39d2-4403-894b-f2e768abe502 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:21.732783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:21.803098 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e80c6-39d2-4403-894b-f2e768abe502 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:21.836060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94433a29-1514-4923-a5d5-a46eed8d9c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:21.837062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94433a29-1514-4923-a5d5-a46eed8d9c24 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.837364 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94433a29-1514-4923-a5d5-a46eed8d9c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.837642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94433a29-1514-4923-a5d5-a46eed8d9c24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.847893 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94433a29-1514-4923-a5d5-a46eed8d9c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-94433a29-1514-4923-a5d5-a46eed8d9c24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:21.855572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:21.856652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:21.857878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:21.857878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:21.857878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:21.857878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:21.857878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:21.857878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:21.857878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:21.857878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:21.857878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:21.857878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:21.857878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:21.857878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:20:21.857878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 570/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:20:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:21.862657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf465e-3340-49ec-ab5a-805879a14289 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:21.960971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf465e-3340-49ec-ab5a-805879a14289 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:21.994571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85028b3-6676-4913-b146-9b1747f05469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:21.995225 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85028b3-6676-4913-b146-9b1747f05469 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:21.995506 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85028b3-6676-4913-b146-9b1747f05469 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:21.995778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85028b3-6676-4913-b146-9b1747f05469 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:21.996515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85028b3-6676-4913-b146-9b1747f05469 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:21.996850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85028b3-6676-4913-b146-9b1747f05469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:21.998207 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85028b3-6676-4913-b146-9b1747f05469 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:22.005940 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 572/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:20:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:22.011785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94433a29-1514-4923-a5d5-a46eed8d9c24 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:22.100024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:22.110361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94433a29-1514-4923-a5d5-a46eed8d9c24 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:22.142930 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb49dd-6fc0-4b15-82b0-a521fa80cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:22.143794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb49dd-6fc0-4b15-82b0-a521fa80cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:22.144079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb49dd-6fc0-4b15-82b0-a521fa80cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:22.144358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb49dd-6fc0-4b15-82b0-a521fa80cfc2 None admin] PATH_INFO: `/v3/users/fdf9247917c848dd8f58bf0f111b9ec9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:22.157875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb49dd-6fc0-4b15-82b0-a521fa80cfc2 None admin] RBAC: Authorizing `identity:get_user(user_id=fdf9247917c848dd8f58bf0f111b9ec9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:22.159320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb49dd-6fc0-4b15-82b0-a521fa80cfc2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:22.161034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 571/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:20:22 2022] GET /identity/v3/users/fdf9247917c848dd8f58bf0f111b9ec9 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:22.167728 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85028b3-6676-4913-b146-9b1747f05469 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:22.180140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:22.266668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85028b3-6676-4913-b146-9b1747f05469 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:22.299492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97a33b-922f-4c9b-8979-0baaec264429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:22.300128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97a33b-922f-4c9b-8979-0baaec264429 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:22.300410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97a33b-922f-4c9b-8979-0baaec264429 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:22.300684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97a33b-922f-4c9b-8979-0baaec264429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:22.365571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97a33b-922f-4c9b-8979-0baaec264429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:22.366941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97a33b-922f-4c9b-8979-0baaec264429 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:22.377823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:22.463617 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 573/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:20:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:20:22.469392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb49dd-6fc0-4b15-82b0-a521fa80cfc2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:22.565687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb49dd-6fc0-4b15-82b0-a521fa80cfc2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:22.599004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89396496-4fc3-433f-b774-f3dab1d5bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:22.599851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89396496-4fc3-433f-b774-f3dab1d5bda7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:22.600133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89396496-4fc3-433f-b774-f3dab1d5bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:22.600407 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89396496-4fc3-433f-b774-f3dab1d5bda7 None admin] PATH_INFO: `/v3/projects/8de41c85222f4ca39cddb1646fac49a9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:22.601608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89396496-4fc3-433f-b774-f3dab1d5bda7 None admin] RBAC: Authorizing `identity:get_project(project_id=8de41c85222f4ca39cddb1646fac49a9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:22.603073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89396496-4fc3-433f-b774-f3dab1d5bda7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:22.604731 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 572/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:20:22 2022] GET /identity/v3/projects/8de41c85222f4ca39cddb1646fac49a9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:22.611632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97a33b-922f-4c9b-8979-0baaec264429 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:22.708447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97a33b-922f-4c9b-8979-0baaec264429 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:22.718799 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:22.741576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e99a83-cdf6-461a-b82a-86f5fb2e510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:22.742219 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e99a83-cdf6-461a-b82a-86f5fb2e510a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:22.742505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e99a83-cdf6-461a-b82a-86f5fb2e510a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:22.743291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e99a83-cdf6-461a-b82a-86f5fb2e510a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:22.744149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e99a83-cdf6-461a-b82a-86f5fb2e510a None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=8de41c85222f4ca39cddb1646fac49a9, user.id=fdf9247917c848dd8f58bf0f111b9ec9) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:22.744463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e99a83-cdf6-461a-b82a-86f5fb2e510a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:22.745919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e99a83-cdf6-461a-b82a-86f5fb2e510a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:22.751206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 574/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:20:22 2022] GET /identity/v3/role_assignments?user.id=fdf9247917c848dd8f58bf0f111b9ec9&scope.project.id=8de41c85222f4ca39cddb1646fac49a9&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:24.900475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a906c30-962f-4851-a9fc-5669e6d57b99 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:24.900967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a906c30-962f-4851-a9fc-5669e6d57b99 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:24.901089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a906c30-962f-4851-a9fc-5669e6d57b99 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:24.902480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 573/1147] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:24.907829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd73d2-6382-4a99-85e8-e028b76cd3dc None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:24.908221 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd73d2-6382-4a99-85e8-e028b76cd3dc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:24.908390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd73d2-6382-4a99-85e8-e028b76cd3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:24.925973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-97bd73d2-6382-4a99-85e8-e028b76cd3dc None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:24.927153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-97bd73d2-6382-4a99-85e8-e028b76cd3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:24.994764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 575/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:25.017779 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a906c30-962f-4851-a9fc-5669e6d57b99 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:25.035756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:25.116496 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a906c30-962f-4851-a9fc-5669e6d57b99 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:25.150494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551bed4-9702-41e6-b681-f61d6b4712b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:25.151212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551bed4-9702-41e6-b681-f61d6b4712b1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:25.151494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551bed4-9702-41e6-b681-f61d6b4712b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:25.151768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551bed4-9702-41e6-b681-f61d6b4712b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.161674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551bed4-9702-41e6-b681-f61d6b4712b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0551bed4-9702-41e6-b681-f61d6b4712b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:25.169654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:25.170756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:25.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:25.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:25.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:25.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:25.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:25.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:25.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:25.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:25.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:25.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:25.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:25.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:20:25.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 574/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:20:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:25.176779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd73d2-6382-4a99-85e8-e028b76cd3dc None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:25.273536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd73d2-6382-4a99-85e8-e028b76cd3dc None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:25.276261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:25.310094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db478b6-a938-4357-8249-ead4e54028b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:25.310821 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db478b6-a938-4357-8249-ead4e54028b1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:25.311112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db478b6-a938-4357-8249-ead4e54028b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:25.311396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db478b6-a938-4357-8249-ead4e54028b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.312151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db478b6-a938-4357-8249-ead4e54028b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:25.312469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db478b6-a938-4357-8249-ead4e54028b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:25.313882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db478b6-a938-4357-8249-ead4e54028b1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:25.322600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 576/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:20:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:25.328371 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551bed4-9702-41e6-b681-f61d6b4712b1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:25.407661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:25.430713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551bed4-9702-41e6-b681-f61d6b4712b1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:25.463557 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a9309-ede8-4dd7-a0e3-e44756102336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:25.464409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a9309-ede8-4dd7-a0e3-e44756102336 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:25.464690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a9309-ede8-4dd7-a0e3-e44756102336 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:25.464997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a9309-ede8-4dd7-a0e3-e44756102336 None admin] PATH_INFO: `/v3/users/fdf9247917c848dd8f58bf0f111b9ec9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.466162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a9309-ede8-4dd7-a0e3-e44756102336 None admin] RBAC: Authorizing `identity:get_user(user_id=fdf9247917c848dd8f58bf0f111b9ec9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:25.467581 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a9309-ede8-4dd7-a0e3-e44756102336 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:25.469218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 575/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:20:25 2022] GET /identity/v3/users/fdf9247917c848dd8f58bf0f111b9ec9 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:25.474904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db478b6-a938-4357-8249-ead4e54028b1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:25.575599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db478b6-a938-4357-8249-ead4e54028b1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:25.608442 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f00a0f-538b-4eaa-8841-4c23b046cbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:25.609320 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f00a0f-538b-4eaa-8841-4c23b046cbab None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:25.609603 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f00a0f-538b-4eaa-8841-4c23b046cbab None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:25.609877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f00a0f-538b-4eaa-8841-4c23b046cbab None admin] PATH_INFO: `/v3/projects/8de41c85222f4ca39cddb1646fac49a9` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.611037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f00a0f-538b-4eaa-8841-4c23b046cbab None admin] RBAC: Authorizing `identity:get_project(project_id=8de41c85222f4ca39cddb1646fac49a9)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:25.612446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f00a0f-538b-4eaa-8841-4c23b046cbab None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:25.614135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 577/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:20:25 2022] GET /identity/v3/projects/8de41c85222f4ca39cddb1646fac49a9 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:25.621540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a9309-ede8-4dd7-a0e3-e44756102336 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:25.720174 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a9309-ede8-4dd7-a0e3-e44756102336 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:25.752108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8653ba6-e820-4b53-9c3a-f97f5ade71df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:25.753016 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653ba6-e820-4b53-9c3a-f97f5ade71df None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:25.753295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653ba6-e820-4b53-9c3a-f97f5ade71df None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:25.753564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8653ba6-e820-4b53-9c3a-f97f5ade71df None admin] PATH_INFO: `/v3/projects/8de41c85222f4ca39cddb1646fac49a9/users/fdf9247917c848dd8f58bf0f111b9ec9/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:25.755480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8653ba6-e820-4b53-9c3a-f97f5ade71df None admin] RBAC: Authorizing `identity:create_grant(project_id=8de41c85222f4ca39cddb1646fac49a9, user_id=fdf9247917c848dd8f58bf0f111b9ec9, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:25.756925 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8653ba6-e820-4b53-9c3a-f97f5ade71df None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:25.770618 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 576/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:20:25 2022] PUT /identity/v3/projects/8de41c85222f4ca39cddb1646fac49a9/users/fdf9247917c848dd8f58bf0f111b9ec9/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:20:27.957641 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcef68-74ab-4cf7-a9e8-bebc27ee3631 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:27.958143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcef68-74ab-4cf7-a9e8-bebc27ee3631 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:27.958241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcef68-74ab-4cf7-a9e8-bebc27ee3631 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:27.960089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 578/1154] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:27.965275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfea13-e444-4f60-ae67-9d3edbb83aa7 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:27.965702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfea13-e444-4f60-ae67-9d3edbb83aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:27.965832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfea13-e444-4f60-ae67-9d3edbb83aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:27.971682 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:27.983718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-73bfea13-e444-4f60-ae67-9d3edbb83aa7 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:27.984925 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-73bfea13-e444-4f60-ae67-9d3edbb83aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:28.050638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 577/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:28.073750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcef68-74ab-4cf7-a9e8-bebc27ee3631 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:28.109672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:28.175828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcef68-74ab-4cf7-a9e8-bebc27ee3631 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:28.209946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43617af-fe2c-441e-899d-a712d3e65e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:28.210732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43617af-fe2c-441e-899d-a712d3e65e87 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.211017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43617af-fe2c-441e-899d-a712d3e65e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.211294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43617af-fe2c-441e-899d-a712d3e65e87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.221166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43617af-fe2c-441e-899d-a712d3e65e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b43617af-fe2c-441e-899d-a712d3e65e87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:28.229312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:28.230500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:28.231604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:28.231604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:28.231604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:28.231604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:28.231604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:28.231604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:28.231604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:28.231604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:28.231604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:28.231604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:28.231604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:28.231604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:20:28.231604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 579/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:20:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:28.236448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfea13-e444-4f60-ae67-9d3edbb83aa7 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:28.336049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfea13-e444-4f60-ae67-9d3edbb83aa7 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:28.369287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c41e-8862-4c47-8114-4506d01302ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:28.369944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c41e-8862-4c47-8114-4506d01302ac None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.370230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c41e-8862-4c47-8114-4506d01302ac None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.370508 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c41e-8862-4c47-8114-4506d01302ac None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.371257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049c41e-8862-4c47-8114-4506d01302ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:28.371568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049c41e-8862-4c47-8114-4506d01302ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:28.373047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049c41e-8862-4c47-8114-4506d01302ac None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:28.374385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:28.382334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 578/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:20:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:28.388107 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43617af-fe2c-441e-899d-a712d3e65e87 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:28.480667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:28.487854 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43617af-fe2c-441e-899d-a712d3e65e87 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:28.520717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f14a2-ed38-4ea0-a926-82310077b751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:28.521902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f14a2-ed38-4ea0-a926-82310077b751 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.522185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f14a2-ed38-4ea0-a926-82310077b751 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.522463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f14a2-ed38-4ea0-a926-82310077b751 None admin] PATH_INFO: `/v3/users/fdf9247917c848dd8f58bf0f111b9ec9` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.523650 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f14a2-ed38-4ea0-a926-82310077b751 None admin] RBAC: Authorizing `identity:get_user(user_id=fdf9247917c848dd8f58bf0f111b9ec9)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:28.525097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f14a2-ed38-4ea0-a926-82310077b751 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:28.526712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 580/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:20:28 2022] GET /identity/v3/users/fdf9247917c848dd8f58bf0f111b9ec9 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:28.532265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c41e-8862-4c47-8114-4506d01302ac None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:28.630233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c41e-8862-4c47-8114-4506d01302ac None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:28.663992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83158b8-b418-4703-9330-96e0d47f0088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:28.664621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83158b8-b418-4703-9330-96e0d47f0088 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.664927 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83158b8-b418-4703-9330-96e0d47f0088 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.665202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83158b8-b418-4703-9330-96e0d47f0088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.722122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:28.729545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83158b8-b418-4703-9330-96e0d47f0088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:28.731085 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83158b8-b418-4703-9330-96e0d47f0088 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:28.824029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 579/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:20:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:20:28.829763 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f14a2-ed38-4ea0-a926-82310077b751 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:28.930463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f14a2-ed38-4ea0-a926-82310077b751 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:28.963566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb967a76-3f81-42cd-876c-2ed1bde86e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:28.964417 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb967a76-3f81-42cd-876c-2ed1bde86e5e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:28.964699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb967a76-3f81-42cd-876c-2ed1bde86e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:28.965005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb967a76-3f81-42cd-876c-2ed1bde86e5e None admin] PATH_INFO: `/v3/projects/8de41c85222f4ca39cddb1646fac49a9` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:28.966179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb967a76-3f81-42cd-876c-2ed1bde86e5e None admin] RBAC: Authorizing `identity:get_project(project_id=8de41c85222f4ca39cddb1646fac49a9)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:28.967613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb967a76-3f81-42cd-876c-2ed1bde86e5e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:28.969310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 581/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:20:28 2022] GET /identity/v3/projects/8de41c85222f4ca39cddb1646fac49a9 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:28.975467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83158b8-b418-4703-9330-96e0d47f0088 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:29.066414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:29.073185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83158b8-b418-4703-9330-96e0d47f0088 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:29.106576 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4aaf4-b046-4219-a50b-004659958bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:29.107220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4aaf4-b046-4219-a50b-004659958bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:29.107505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4aaf4-b046-4219-a50b-004659958bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:29.107785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4aaf4-b046-4219-a50b-004659958bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:29.108612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4aaf4-b046-4219-a50b-004659958bb2 None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=8de41c85222f4ca39cddb1646fac49a9, user.id=fdf9247917c848dd8f58bf0f111b9ec9) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:29.108965 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4aaf4-b046-4219-a50b-004659958bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:29.110400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4aaf4-b046-4219-a50b-004659958bb2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:29.116471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 580/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:20:28 2022] GET /identity/v3/role_assignments?user.id=fdf9247917c848dd8f58bf0f111b9ec9&scope.project.id=8de41c85222f4ca39cddb1646fac49a9&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:31.311886 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e565d9-bfb8-4214-b403-1d5567b98c57 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:31.312438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e565d9-bfb8-4214-b403-1d5567b98c57 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:31.312438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e565d9-bfb8-4214-b403-1d5567b98c57 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:31.313837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 582/1162] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:31.319220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dab919-70f7-468d-80b9-0dfe13858205 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:31.319654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dab919-70f7-468d-80b9-0dfe13858205 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:31.319777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dab919-70f7-468d-80b9-0dfe13858205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:31.336732 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a0dab919-70f7-468d-80b9-0dfe13858205 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:31.337924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a0dab919-70f7-468d-80b9-0dfe13858205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:31.402100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 581/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:31.424546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e565d9-bfb8-4214-b403-1d5567b98c57 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:31.455196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:31.525084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e565d9-bfb8-4214-b403-1d5567b98c57 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:31.558182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595210b8-584a-4bd6-adb3-e08acb516e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:31.558819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595210b8-584a-4bd6-adb3-e08acb516e2d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:31.559104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595210b8-584a-4bd6-adb3-e08acb516e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:31.559382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595210b8-584a-4bd6-adb3-e08acb516e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:31.624011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595210b8-584a-4bd6-adb3-e08acb516e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:31.625414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595210b8-584a-4bd6-adb3-e08acb516e2d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:31.662671 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:31.731344 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 583/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:20:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:20:31.737374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dab919-70f7-468d-80b9-0dfe13858205 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:31.822905 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:31.833065 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dab919-70f7-468d-80b9-0dfe13858205 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:31.866653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2efc9e5-98a4-45e7-9a9f-b3ca160d17e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:31.867441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efc9e5-98a4-45e7-9a9f-b3ca160d17e1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:31.867720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efc9e5-98a4-45e7-9a9f-b3ca160d17e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:31.867987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2efc9e5-98a4-45e7-9a9f-b3ca160d17e1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:31.874513 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efc9e5-98a4-45e7-9a9f-b3ca160d17e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:31.875884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2efc9e5-98a4-45e7-9a9f-b3ca160d17e1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e2efc9e5-98a4-45e7-9a9f-b3ca160d17e1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:31.889720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:31.890944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:20:31.892180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 582/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Thu May 26 12:20:31 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:31.897376 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595210b8-584a-4bd6-adb3-e08acb516e2d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:31.997064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595210b8-584a-4bd6-adb3-e08acb516e2d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:32.029163 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:32.035770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edc4b3-c1af-450c-af81-a7f801ed56af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:32.036441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edc4b3-c1af-450c-af81-a7f801ed56af None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:32.036751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edc4b3-c1af-450c-af81-a7f801ed56af None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:32.037041 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edc4b3-c1af-450c-af81-a7f801ed56af None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:32.037770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edc4b3-c1af-450c-af81-a7f801ed56af None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:32.038084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edc4b3-c1af-450c-af81-a7f801ed56af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:32.039455 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edc4b3-c1af-450c-af81-a7f801ed56af None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:32.046657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 584/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Thu May 26 12:20:31 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:34.224609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a089-6fea-4602-b8bc-61bc02298a97 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:34.225213 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a089-6fea-4602-b8bc-61bc02298a97 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:34.225213 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a089-6fea-4602-b8bc-61bc02298a97 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:34.226588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 583/1167] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:34.231649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d1b93-e154-4db2-aef6-fe71cd27685c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:34.232059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d1b93-e154-4db2-aef6-fe71cd27685c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:34.232208 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d1b93-e154-4db2-aef6-fe71cd27685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:34.249313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b75d1b93-e154-4db2-aef6-fe71cd27685c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:34.250511 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b75d1b93-e154-4db2-aef6-fe71cd27685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:34.316343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 585/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:34.339265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a089-6fea-4602-b8bc-61bc02298a97 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:34.440190 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94a089-6fea-4602-b8bc-61bc02298a97 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:34.472825 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38115624-fd4f-4085-96b7-d90e62cc9a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:34.473477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38115624-fd4f-4085-96b7-d90e62cc9a2e None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:34.473764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38115624-fd4f-4085-96b7-d90e62cc9a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:34.474041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38115624-fd4f-4085-96b7-d90e62cc9a2e None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:34.474833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38115624-fd4f-4085-96b7-d90e62cc9a2e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:34.476150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38115624-fd4f-4085-96b7-d90e62cc9a2e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:34.491057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 584/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Thu May 26 12:20:34 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:20:36.711074 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596db02-fe68-4052-bf82-03331ad03b37 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:36.711580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596db02-fe68-4052-bf82-03331ad03b37 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:36.711698 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596db02-fe68-4052-bf82-03331ad03b37 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:36.713035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 586/1170] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:36.718851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ae97-9e31-42a2-9cf4-340b56bda7c8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:36.719239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ae97-9e31-42a2-9cf4-340b56bda7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:36.719429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ae97-9e31-42a2-9cf4-340b56bda7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:36.735912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-33a2ae97-9e31-42a2-9cf4-340b56bda7c8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:36.737138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-33a2ae97-9e31-42a2-9cf4-340b56bda7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:36.739900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:36.806338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 585/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:36.831086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596db02-fe68-4052-bf82-03331ad03b37 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:36.939275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596db02-fe68-4052-bf82-03331ad03b37 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:36.963787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:36.975304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4db9c-a177-46a3-850f-8cd33d22f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:36.976178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4db9c-a177-46a3-850f-8cd33d22f023 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:36.976462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4db9c-a177-46a3-850f-8cd33d22f023 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:36.976787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4db9c-a177-46a3-850f-8cd33d22f023 None admin] PATH_INFO: `/v3/domains/3c831931a6424292ada3d84168615c97` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:36.988094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4db9c-a177-46a3-850f-8cd33d22f023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3c831931a6424292ada3d84168615c97)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:36.989602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4db9c-a177-46a3-850f-8cd33d22f023 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:36.991290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 587/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Thu May 26 12:20:36 2022] GET /identity/v3/domains/3c831931a6424292ada3d84168615c97 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:36.997211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2ae97-9e31-42a2-9cf4-340b56bda7c8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:37.094285 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2ae97-9e31-42a2-9cf4-340b56bda7c8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:37.127787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14b167-3945-40ed-84bb-d65cc8062b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:37.128434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14b167-3945-40ed-84bb-d65cc8062b50 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:37.128742 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14b167-3945-40ed-84bb-d65cc8062b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:37.129012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14b167-3945-40ed-84bb-d65cc8062b50 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:37.129709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14b167-3945-40ed-84bb-d65cc8062b50 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:37.131132 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14b167-3945-40ed-84bb-d65cc8062b50 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:37.141204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:37.157120 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 586/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:20:36 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:39.401326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b1cdf-bb5f-430c-b3d6-8e0a7a34e594 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:39.401881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b1cdf-bb5f-430c-b3d6-8e0a7a34e594 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:39.401881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b1cdf-bb5f-430c-b3d6-8e0a7a34e594 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:39.403827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 588/1174] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:39.409030 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fcaad-2584-4e02-9bf8-8bc93006c135 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:39.409428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fcaad-2584-4e02-9bf8-8bc93006c135 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:39.409593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fcaad-2584-4e02-9bf8-8bc93006c135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:39.426104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-396fcaad-2584-4e02-9bf8-8bc93006c135 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:39.427293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-396fcaad-2584-4e02-9bf8-8bc93006c135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:39.498160 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 587/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:39.525692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b1cdf-bb5f-430c-b3d6-8e0a7a34e594 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:39.625577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b1cdf-bb5f-430c-b3d6-8e0a7a34e594 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:39.658904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81828b-5ec3-41a4-9b32-babcbd877c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:39.659692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81828b-5ec3-41a4-9b32-babcbd877c4c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:39.659976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81828b-5ec3-41a4-9b32-babcbd877c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:39.660251 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81828b-5ec3-41a4-9b32-babcbd877c4c None admin] PATH_INFO: `/v3/domains/3c831931a6424292ada3d84168615c97` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:39.661430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81828b-5ec3-41a4-9b32-babcbd877c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=3c831931a6424292ada3d84168615c97)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:39.662841 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81828b-5ec3-41a4-9b32-babcbd877c4c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:39.664411 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 589/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Thu May 26 12:20:39 2022] GET /identity/v3/domains/3c831931a6424292ada3d84168615c97 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:39.670762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fcaad-2584-4e02-9bf8-8bc93006c135 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:39.767293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fcaad-2584-4e02-9bf8-8bc93006c135 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:39.789743 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:39.803166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b13181-2136-4828-8723-f60b1e6ec786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:39.803836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b13181-2136-4828-8723-f60b1e6ec786 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:39.804116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b13181-2136-4828-8723-f60b1e6ec786 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:39.804388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b13181-2136-4828-8723-f60b1e6ec786 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:39.805135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b13181-2136-4828-8723-f60b1e6ec786 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:39.806546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b13181-2136-4828-8723-f60b1e6ec786 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:39.826672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 588/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:20:39 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:20:42.049551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88037b3-a9e1-4346-88ff-6b1ed9c5d242 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.050082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88037b3-a9e1-4346-88ff-6b1ed9c5d242 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.050174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88037b3-a9e1-4346-88ff-6b1ed9c5d242 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.051476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 590/1178] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:42.056608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c598d-bcf7-4210-b66d-25482fb1dcac None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.057074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c598d-bcf7-4210-b66d-25482fb1dcac None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.057195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c598d-bcf7-4210-b66d-25482fb1dcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.075191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1a8c598d-bcf7-4210-b66d-25482fb1dcac None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:42.076355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1a8c598d-bcf7-4210-b66d-25482fb1dcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:42.141943 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 589/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:42.164832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88037b3-a9e1-4346-88ff-6b1ed9c5d242 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:42.217424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:42.264803 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88037b3-a9e1-4346-88ff-6b1ed9c5d242 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:42.297608 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad605937-dcb8-4bd1-9856-ac7e9b8ba3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:42.298381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad605937-dcb8-4bd1-9856-ac7e9b8ba3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.298664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad605937-dcb8-4bd1-9856-ac7e9b8ba3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.298937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad605937-dcb8-4bd1-9856-ac7e9b8ba3e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.308816 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad605937-dcb8-4bd1-9856-ac7e9b8ba3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-ad605937-dcb8-4bd1-9856-ac7e9b8ba3e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:42.316282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:42.317396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:42.318438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:42.318438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:42.318438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:42.318438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:42.318438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:42.318438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:42.318438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:42.318438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:42.318438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:42.318438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:42.318438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:42.318438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:20:42.318438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 591/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:20:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:42.324014 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c598d-bcf7-4210-b66d-25482fb1dcac None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:42.421451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c598d-bcf7-4210-b66d-25482fb1dcac None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:42.430282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:42.459551 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647874e7-dc4c-41ac-bc3a-6861aaf55e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:42.460228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647874e7-dc4c-41ac-bc3a-6861aaf55e8e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.460517 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647874e7-dc4c-41ac-bc3a-6861aaf55e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.460824 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647874e7-dc4c-41ac-bc3a-6861aaf55e8e None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.461978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647874e7-dc4c-41ac-bc3a-6861aaf55e8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:42.462291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647874e7-dc4c-41ac-bc3a-6861aaf55e8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:42.463901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647874e7-dc4c-41ac-bc3a-6861aaf55e8e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:42.472616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 590/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:20:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:42.478495 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad605937-dcb8-4bd1-9856-ac7e9b8ba3e0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:42.578049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad605937-dcb8-4bd1-9856-ac7e9b8ba3e0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:42.590526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:42.611704 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46301a9e-b4ed-41d3-9417-3366a9e1b403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:42.612570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46301a9e-b4ed-41d3-9417-3366a9e1b403 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.612890 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46301a9e-b4ed-41d3-9417-3366a9e1b403 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.613169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46301a9e-b4ed-41d3-9417-3366a9e1b403 None admin] PATH_INFO: `/v3/users/32b7b51f81094431a1a308dd9b4de3b3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.627137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46301a9e-b4ed-41d3-9417-3366a9e1b403 None admin] RBAC: Authorizing `identity:get_user(user_id=32b7b51f81094431a1a308dd9b4de3b3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:42.628568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46301a9e-b4ed-41d3-9417-3366a9e1b403 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:42.630252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 592/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:20:42 2022] GET /identity/v3/users/32b7b51f81094431a1a308dd9b4de3b3 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:42.637138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647874e7-dc4c-41ac-bc3a-6861aaf55e8e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:42.731424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647874e7-dc4c-41ac-bc3a-6861aaf55e8e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:42.766771 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60f841-619d-4700-b612-e1752275128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:42.767413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60f841-619d-4700-b612-e1752275128f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:42.767694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60f841-619d-4700-b612-e1752275128f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:42.767965 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60f841-619d-4700-b612-e1752275128f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:42.809599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:42.837437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60f841-619d-4700-b612-e1752275128f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:42.839186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60f841-619d-4700-b612-e1752275128f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:42.933728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 591/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:20:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:20:42.939487 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46301a9e-b4ed-41d3-9417-3366a9e1b403 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:43.035874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46301a9e-b4ed-41d3-9417-3366a9e1b403 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:43.068381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94007afe-4e53-4374-8cc1-c9325872a0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:43.069266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94007afe-4e53-4374-8cc1-c9325872a0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:43.069549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94007afe-4e53-4374-8cc1-c9325872a0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:43.069824 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94007afe-4e53-4374-8cc1-c9325872a0d2 None admin] PATH_INFO: `/v3/projects/857584a69c244a67907cbe9493150017` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:43.070996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94007afe-4e53-4374-8cc1-c9325872a0d2 None admin] RBAC: Authorizing `identity:get_project(project_id=857584a69c244a67907cbe9493150017)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:43.072420 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94007afe-4e53-4374-8cc1-c9325872a0d2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:43.074755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 593/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:20:42 2022] GET /identity/v3/projects/857584a69c244a67907cbe9493150017 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:43.080632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60f841-619d-4700-b612-e1752275128f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:43.147963 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:43.179465 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60f841-619d-4700-b612-e1752275128f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:43.212574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8f11e-85a6-4f29-87e6-959e8313a131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:43.213287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8f11e-85a6-4f29-87e6-959e8313a131 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:43.213568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8f11e-85a6-4f29-87e6-959e8313a131 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:43.213836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8f11e-85a6-4f29-87e6-959e8313a131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:43.214649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8f11e-85a6-4f29-87e6-959e8313a131 None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=857584a69c244a67907cbe9493150017, user.id=32b7b51f81094431a1a308dd9b4de3b3) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:43.214960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8f11e-85a6-4f29-87e6-959e8313a131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:43.216368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8f11e-85a6-4f29-87e6-959e8313a131 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:43.221665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 592/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:20:43 2022] GET /identity/v3/role_assignments?user.id=32b7b51f81094431a1a308dd9b4de3b3&scope.project.id=857584a69c244a67907cbe9493150017&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:45.370833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78ec5f-cb85-4c65-8137-3c3a965a33a3 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.371359 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78ec5f-cb85-4c65-8137-3c3a965a33a3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.371482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78ec5f-cb85-4c65-8137-3c3a965a33a3 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.372903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 594/1186] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:45.377945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3facaa2-9ce1-46d9-94e7-91ec2e1b9fc4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.378336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3facaa2-9ce1-46d9-94e7-91ec2e1b9fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.378506 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3facaa2-9ce1-46d9-94e7-91ec2e1b9fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.395657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e3facaa2-9ce1-46d9-94e7-91ec2e1b9fc4 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:45.396866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e3facaa2-9ce1-46d9-94e7-91ec2e1b9fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:45.462818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 593/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:20:45.484783 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78ec5f-cb85-4c65-8137-3c3a965a33a3 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:45.525972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:45.586760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78ec5f-cb85-4c65-8137-3c3a965a33a3 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:45.621187 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ea937-8fa3-43d3-acfb-799b52acaa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:45.621915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ea937-8fa3-43d3-acfb-799b52acaa67 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.622203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ea937-8fa3-43d3-acfb-799b52acaa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.622482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ea937-8fa3-43d3-acfb-799b52acaa67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.632358 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ea937-8fa3-43d3-acfb-799b52acaa67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-9b0ea937-8fa3-43d3-acfb-799b52acaa67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:45.640906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:45.642014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:45.643352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:45.643352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:45.643352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:45.643352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:45.643352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:45.643352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:45.643352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:45.643352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:45.643352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:45.643352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:45.643352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:45.643352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:20:45.643352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 595/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:20:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:45.648003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3facaa2-9ce1-46d9-94e7-91ec2e1b9fc4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:45.711055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:45.748303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3facaa2-9ce1-46d9-94e7-91ec2e1b9fc4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:45.781953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0e7fc-ec0c-4148-88a5-57b8e3b46f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:45.782616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e7fc-ec0c-4148-88a5-57b8e3b46f97 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.782898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e7fc-ec0c-4148-88a5-57b8e3b46f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.783174 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e7fc-ec0c-4148-88a5-57b8e3b46f97 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.783908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0e7fc-ec0c-4148-88a5-57b8e3b46f97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:45.784213 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0e7fc-ec0c-4148-88a5-57b8e3b46f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:45.785611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0e7fc-ec0c-4148-88a5-57b8e3b46f97 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:45.793861 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 594/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:20:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:45.799801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ea937-8fa3-43d3-acfb-799b52acaa67 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:45.895795 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:45.900436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ea937-8fa3-43d3-acfb-799b52acaa67 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:45.934140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27648ab2-da44-4d2f-98a1-fc6085c4395e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:45.935015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27648ab2-da44-4d2f-98a1-fc6085c4395e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:45.935322 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27648ab2-da44-4d2f-98a1-fc6085c4395e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:45.935600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27648ab2-da44-4d2f-98a1-fc6085c4395e None admin] PATH_INFO: `/v3/users/32b7b51f81094431a1a308dd9b4de3b3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:45.936805 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27648ab2-da44-4d2f-98a1-fc6085c4395e None admin] RBAC: Authorizing `identity:get_user(user_id=32b7b51f81094431a1a308dd9b4de3b3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:45.938234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27648ab2-da44-4d2f-98a1-fc6085c4395e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:45.939839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 596/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:20:45 2022] GET /identity/v3/users/32b7b51f81094431a1a308dd9b4de3b3 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:45.945555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0e7fc-ec0c-4148-88a5-57b8e3b46f97 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:46.042335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0e7fc-ec0c-4148-88a5-57b8e3b46f97 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:46.066947 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:46.075785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b97c7-a291-4a65-85fd-e4a6c3590fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:46.076648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b97c7-a291-4a65-85fd-e4a6c3590fba None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:46.076960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b97c7-a291-4a65-85fd-e4a6c3590fba None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:46.077238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b97c7-a291-4a65-85fd-e4a6c3590fba None admin] PATH_INFO: `/v3/projects/857584a69c244a67907cbe9493150017` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:46.078462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b97c7-a291-4a65-85fd-e4a6c3590fba None admin] RBAC: Authorizing `identity:get_project(project_id=857584a69c244a67907cbe9493150017)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:46.079901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b97c7-a291-4a65-85fd-e4a6c3590fba None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:46.081666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 595/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:20:45 2022] GET /identity/v3/projects/857584a69c244a67907cbe9493150017 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:46.087916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27648ab2-da44-4d2f-98a1-fc6085c4395e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:46.186507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27648ab2-da44-4d2f-98a1-fc6085c4395e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:46.219050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011695b3-8adf-43df-8a4c-e2e5746ce964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:46.219930 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011695b3-8adf-43df-8a4c-e2e5746ce964 None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:46.220214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011695b3-8adf-43df-8a4c-e2e5746ce964 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:46.220491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011695b3-8adf-43df-8a4c-e2e5746ce964 None admin] PATH_INFO: `/v3/projects/857584a69c244a67907cbe9493150017/users/32b7b51f81094431a1a308dd9b4de3b3/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:46.222466 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011695b3-8adf-43df-8a4c-e2e5746ce964 None admin] RBAC: Authorizing `identity:create_grant(project_id=857584a69c244a67907cbe9493150017, user_id=32b7b51f81094431a1a308dd9b4de3b3, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:46.223889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011695b3-8adf-43df-8a4c-e2e5746ce964 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:46.237047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 597/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:20:46 2022] PUT /identity/v3/projects/857584a69c244a67907cbe9493150017/users/32b7b51f81094431a1a308dd9b4de3b3/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:20:48.411415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebe8c9-8fd9-4dce-bca4-0881383fd7d8 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:48.411938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebe8c9-8fd9-4dce-bca4-0881383fd7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:48.412031 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebe8c9-8fd9-4dce-bca4-0881383fd7d8 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:48.413890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 596/1193] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:20:48.419037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0c00b-cb75-4cf7-bc74-814e11fb668f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:48.419418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0c00b-cb75-4cf7-bc74-814e11fb668f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:48.419609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0c00b-cb75-4cf7-bc74-814e11fb668f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:48.437044 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4be0c00b-cb75-4cf7-bc74-814e11fb668f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:20:48.438275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4be0c00b-cb75-4cf7-bc74-814e11fb668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:20:48.458237 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:48.505227 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 598/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:20:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:20:48.529431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebe8c9-8fd9-4dce-bca4-0881383fd7d8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:48.628758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebe8c9-8fd9-4dce-bca4-0881383fd7d8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:48.662371 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83087441-c6fe-47e2-98e5-1ffbc98834b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:48.663857 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83087441-c6fe-47e2-98e5-1ffbc98834b0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:48.664144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83087441-c6fe-47e2-98e5-1ffbc98834b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:48.664422 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83087441-c6fe-47e2-98e5-1ffbc98834b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:48.674517 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83087441-c6fe-47e2-98e5-1ffbc98834b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-83087441-c6fe-47e2-98e5-1ffbc98834b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:20:48.682093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:20:48.683204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:20:48.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:20:48.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:20:48.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:20:48.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:20:48.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:20:48.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:20:48.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:20:48.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:20:48.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:20:48.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:20:48.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:20:48.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:20:48.684103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 597/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:20:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:20:48.689154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0c00b-cb75-4cf7-bc74-814e11fb668f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:48.785501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0c00b-cb75-4cf7-bc74-814e11fb668f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:48.820265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0de810-ce1d-45ab-b649-194a7ef7b671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:48.820956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0de810-ce1d-45ab-b649-194a7ef7b671 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:48.821247 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0de810-ce1d-45ab-b649-194a7ef7b671 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:48.821529 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0de810-ce1d-45ab-b649-194a7ef7b671 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:48.822279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0de810-ce1d-45ab-b649-194a7ef7b671 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:48.822592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0de810-ce1d-45ab-b649-194a7ef7b671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:48.823960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0de810-ce1d-45ab-b649-194a7ef7b671 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:48.831829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 599/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:20:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:48.838095 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83087441-c6fe-47e2-98e5-1ffbc98834b0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:48.893264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:48.937151 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83087441-c6fe-47e2-98e5-1ffbc98834b0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:48.969961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68b98c-8a04-4d65-b16a-98424eb4d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:48.970816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68b98c-8a04-4d65-b16a-98424eb4d80e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:48.971099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68b98c-8a04-4d65-b16a-98424eb4d80e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:48.971373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68b98c-8a04-4d65-b16a-98424eb4d80e None admin] PATH_INFO: `/v3/users/32b7b51f81094431a1a308dd9b4de3b3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:48.972544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68b98c-8a04-4d65-b16a-98424eb4d80e None admin] RBAC: Authorizing `identity:get_user(user_id=32b7b51f81094431a1a308dd9b4de3b3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:48.974010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68b98c-8a04-4d65-b16a-98424eb4d80e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:48.975669 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 598/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Thu May 26 12:20:48 2022] GET /identity/v3/users/32b7b51f81094431a1a308dd9b4de3b3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:48.981397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0de810-ce1d-45ab-b649-194a7ef7b671 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:49.000267 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:49.079684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0de810-ce1d-45ab-b649-194a7ef7b671 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:49.113086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb362f4-95b5-49ef-96e8-00849da0bbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:49.113731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb362f4-95b5-49ef-96e8-00849da0bbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.114019 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb362f4-95b5-49ef-96e8-00849da0bbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.114297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb362f4-95b5-49ef-96e8-00849da0bbf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.183088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb362f4-95b5-49ef-96e8-00849da0bbf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:49.184557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb362f4-95b5-49ef-96e8-00849da0bbf8 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:49.202867 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:49.281672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 600/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:20:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:20:49.287637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68b98c-8a04-4d65-b16a-98424eb4d80e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:49.384133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68b98c-8a04-4d65-b16a-98424eb4d80e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:49.405865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:49.418191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45467bdb-d6f9-439e-beba-57c3481ef091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:49.419041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45467bdb-d6f9-439e-beba-57c3481ef091 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.419322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45467bdb-d6f9-439e-beba-57c3481ef091 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.419594 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45467bdb-d6f9-439e-beba-57c3481ef091 None admin] PATH_INFO: `/v3/projects/857584a69c244a67907cbe9493150017` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.420792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45467bdb-d6f9-439e-beba-57c3481ef091 None admin] RBAC: Authorizing `identity:get_project(project_id=857584a69c244a67907cbe9493150017)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:49.422225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45467bdb-d6f9-439e-beba-57c3481ef091 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:49.423875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 599/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Thu May 26 12:20:49 2022] GET /identity/v3/projects/857584a69c244a67907cbe9493150017 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:49.430368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb362f4-95b5-49ef-96e8-00849da0bbf8 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:20:49.530035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb362f4-95b5-49ef-96e8-00849da0bbf8 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:20:49.547253 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:49.564096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51554290-775e-47f6-aa4f-b850619bbbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:20:49.564762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51554290-775e-47f6-aa4f-b850619bbbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:20:49.565049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51554290-775e-47f6-aa4f-b850619bbbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:20:49.565325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51554290-775e-47f6-aa4f-b850619bbbb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:20:49.566142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51554290-775e-47f6-aa4f-b850619bbbb5 None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=857584a69c244a67907cbe9493150017, user.id=32b7b51f81094431a1a308dd9b4de3b3) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:20:49.566453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51554290-775e-47f6-aa4f-b850619bbbb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:20:49.567883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51554290-775e-47f6-aa4f-b850619bbbb5 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:20:49.574072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 601/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:20:49 2022] GET /identity/v3/role_assignments?user.id=32b7b51f81094431a1a308dd9b4de3b3&scope.project.id=857584a69c244a67907cbe9493150017&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:20:59.414132 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:20:59.571475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=9 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:50.272856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed69f1-120e-49a2-8cd1-2d361e6f0da9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.273513 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed69f1-120e-49a2-8cd1-2d361e6f0da9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.273513 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed69f1-120e-49a2-8cd1-2d361e6f0da9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.275042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 600/1201] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:50.284001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568792a0-fec6-4387-b2a0-ff3b5b2e8f00 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.284564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568792a0-fec6-4387-b2a0-ff3b5b2e8f00 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.284564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568792a0-fec6-4387-b2a0-ff3b5b2e8f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.308350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-568792a0-fec6-4387-b2a0-ff3b5b2e8f00 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:50.309877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-568792a0-fec6-4387-b2a0-ff3b5b2e8f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:50.405081 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 602/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:21:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:50.427129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed69f1-120e-49a2-8cd1-2d361e6f0da9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:50.572433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed69f1-120e-49a2-8cd1-2d361e6f0da9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:50.621364 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbea52e-00ce-4c7e-a6ce-2fe17e22bf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:50.622385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea52e-00ce-4c7e-a6ce-2fe17e22bf09 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.622944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea52e-00ce-4c7e-a6ce-2fe17e22bf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.623160 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea52e-00ce-4c7e-a6ce-2fe17e22bf09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.634716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbea52e-00ce-4c7e-a6ce-2fe17e22bf09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:50.636308 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbea52e-00ce-4c7e-a6ce-2fe17e22bf09 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8bbea52e-00ce-4c7e-a6ce-2fe17e22bf09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:50.658671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:50.659959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:50.661004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:50.661004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:50.661004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:50.661004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:21:50.661004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 601/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:50.666261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568792a0-fec6-4387-b2a0-ff3b5b2e8f00 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:50.808742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568792a0-fec6-4387-b2a0-ff3b5b2e8f00 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:50.856785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:50.869898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45916d-22ec-4f9c-a0e4-e98d557447a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:50.870632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45916d-22ec-4f9c-a0e4-e98d557447a7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:50.870937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45916d-22ec-4f9c-a0e4-e98d557447a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:50.871197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45916d-22ec-4f9c-a0e4-e98d557447a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:50.872249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45916d-22ec-4f9c-a0e4-e98d557447a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:50.872641 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45916d-22ec-4f9c-a0e4-e98d557447a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:50.875494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45916d-22ec-4f9c-a0e4-e98d557447a7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:50.888400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 603/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:50.894194 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbea52e-00ce-4c7e-a6ce-2fe17e22bf09 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:50.973727 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:51.042160 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbea52e-00ce-4c7e-a6ce-2fe17e22bf09 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:51.098533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4df4b-2801-4bff-b048-2aa0d5059db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:51.099216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4df4b-2801-4bff-b048-2aa0d5059db9 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:51.099510 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4df4b-2801-4bff-b048-2aa0d5059db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:51.099871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4df4b-2801-4bff-b048-2aa0d5059db9 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:51.100700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4df4b-2801-4bff-b048-2aa0d5059db9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:51.102718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4df4b-2801-4bff-b048-2aa0d5059db9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:51.137922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 602/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Thu May 26 12:21:50 2022] POST /identity/v3/users => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:21:53.675794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110caa7d-5ade-476b-96a4-ee5cb6b4e40c None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:53.676348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110caa7d-5ade-476b-96a4-ee5cb6b4e40c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:53.676348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110caa7d-5ade-476b-96a4-ee5cb6b4e40c None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:53.677738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 604/1206] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:53.683053 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233892e6-1ea7-48e8-b0db-566601c9714c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:53.684064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233892e6-1ea7-48e8-b0db-566601c9714c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:53.684167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233892e6-1ea7-48e8-b0db-566601c9714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:53.702337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-233892e6-1ea7-48e8-b0db-566601c9714c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:53.703548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-233892e6-1ea7-48e8-b0db-566601c9714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:53.792907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 603/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:21:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:53.816985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110caa7d-5ade-476b-96a4-ee5cb6b4e40c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:53.970073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110caa7d-5ade-476b-96a4-ee5cb6b4e40c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:54.022738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7dbe6-8e3f-413d-8dca-744b662b20f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:54.023557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7dbe6-8e3f-413d-8dca-744b662b20f3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:54.023843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7dbe6-8e3f-413d-8dca-744b662b20f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:54.024121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7dbe6-8e3f-413d-8dca-744b662b20f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:54.038651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7dbe6-8e3f-413d-8dca-744b662b20f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0bb7dbe6-8e3f-413d-8dca-744b662b20f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:54.050005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:54.051433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:54.052425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:54.052425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:54.052425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:54.052425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:54.052425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:54.052425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:54.052425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:54.052425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:54.052425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:54.052425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:54.052425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:54.052425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:21:54.052425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 605/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:21:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:54.058290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233892e6-1ea7-48e8-b0db-566601c9714c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:54.109026 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:54.197763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233892e6-1ea7-48e8-b0db-566601c9714c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:54.243251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2b89-1d27-4e18-92cf-fc642d637678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:54.244396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2b89-1d27-4e18-92cf-fc642d637678 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:54.244934 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2b89-1d27-4e18-92cf-fc642d637678 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:54.245417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2b89-1d27-4e18-92cf-fc642d637678 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:54.246314 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c2b89-1d27-4e18-92cf-fc642d637678 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:54.246872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c2b89-1d27-4e18-92cf-fc642d637678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:54.248422 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c2b89-1d27-4e18-92cf-fc642d637678 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:54.263263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 604/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:21:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:54.270242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7dbe6-8e3f-413d-8dca-744b662b20f3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:54.345690 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:54.412230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7dbe6-8e3f-413d-8dca-744b662b20f3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:54.460350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38566e1e-8dde-42a2-9574-d4a70d9834d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:54.460741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566e1e-8dde-42a2-9574-d4a70d9834d7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:54.461016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566e1e-8dde-42a2-9574-d4a70d9834d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:54.461313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38566e1e-8dde-42a2-9574-d4a70d9834d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:54.477750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38566e1e-8dde-42a2-9574-d4a70d9834d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:54.480397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38566e1e-8dde-42a2-9574-d4a70d9834d7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-38566e1e-8dde-42a2-9574-d4a70d9834d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:54.503810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:54.505577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:54.507241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:54.507241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:54.507241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:54.507241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:21:54.507241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 606/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:54.512431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2b89-1d27-4e18-92cf-fc642d637678 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:54.649093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:54.651885 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2b89-1d27-4e18-92cf-fc642d637678 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:54.700032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d859dc-1fc0-491a-bd60-c1fd97267bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:54.700756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d859dc-1fc0-491a-bd60-c1fd97267bce None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:54.701005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d859dc-1fc0-491a-bd60-c1fd97267bce None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:54.701482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d859dc-1fc0-491a-bd60-c1fd97267bce None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:54.702422 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d859dc-1fc0-491a-bd60-c1fd97267bce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:54.702833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d859dc-1fc0-491a-bd60-c1fd97267bce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:54.704450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d859dc-1fc0-491a-bd60-c1fd97267bce None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:54.718714 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 605/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:54.725061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38566e1e-8dde-42a2-9574-d4a70d9834d7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:54.844028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38566e1e-8dde-42a2-9574-d4a70d9834d7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:54.845986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:54.892399 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce26b02-dbeb-465a-9201-be0981255526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:54.893396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce26b02-dbeb-465a-9201-be0981255526 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:54.893755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce26b02-dbeb-465a-9201-be0981255526 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:54.894039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce26b02-dbeb-465a-9201-be0981255526 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:54.905465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce26b02-dbeb-465a-9201-be0981255526 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:54.907271 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce26b02-dbeb-465a-9201-be0981255526 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-9ce26b02-dbeb-465a-9201-be0981255526 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:54.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:54.926870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:54.927880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:54.927880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:54.927880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:54.927880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:54.927880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:54.927880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:54.927880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:54.927880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:54.927880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:21:54.927880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:21:54.927880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 607/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:21:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:54.933158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d859dc-1fc0-491a-bd60-c1fd97267bce None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:55.069167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d859dc-1fc0-491a-bd60-c1fd97267bce None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:55.114852 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551c801-72c7-4261-b961-fb4ac2683057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:55.115562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551c801-72c7-4261-b961-fb4ac2683057 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.115920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551c801-72c7-4261-b961-fb4ac2683057 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.116270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551c801-72c7-4261-b961-fb4ac2683057 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.117286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551c801-72c7-4261-b961-fb4ac2683057 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:55.117674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551c801-72c7-4261-b961-fb4ac2683057 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:55.119558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551c801-72c7-4261-b961-fb4ac2683057 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:55.147974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 606/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Thu May 26 12:21:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:55.149787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce26b02-dbeb-465a-9201-be0981255526 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:55.275551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce26b02-dbeb-465a-9201-be0981255526 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:55.314201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d95335-3e1d-4e83-a028-123a41dcbe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:55.314891 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d95335-3e1d-4e83-a028-123a41dcbe2e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.315186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d95335-3e1d-4e83-a028-123a41dcbe2e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.315457 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d95335-3e1d-4e83-a028-123a41dcbe2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.350989 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:55.396330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d95335-3e1d-4e83-a028-123a41dcbe2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:55.397926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d95335-3e1d-4e83-a028-123a41dcbe2e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:55.529732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 608/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:21:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:21:55.531643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551c801-72c7-4261-b961-fb4ac2683057 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:55.552705 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:55.650063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551c801-72c7-4261-b961-fb4ac2683057 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:55.688686 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaf452-cfc5-4f0b-a5fd-880a6986db8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:55.689654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaf452-cfc5-4f0b-a5fd-880a6986db8b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.690042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaf452-cfc5-4f0b-a5fd-880a6986db8b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.690415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbaf452-cfc5-4f0b-a5fd-880a6986db8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.702723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbaf452-cfc5-4f0b-a5fd-880a6986db8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:55.704280 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbaf452-cfc5-4f0b-a5fd-880a6986db8b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-efbaf452-cfc5-4f0b-a5fd-880a6986db8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:55.723456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:55.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:55.726781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:55.726781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:55.726781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:55.726781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:21:55.726781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 607/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:55.731023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d95335-3e1d-4e83-a028-123a41dcbe2e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:55.800698 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:55.845366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d95335-3e1d-4e83-a028-123a41dcbe2e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:55.891753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961629f-01f4-4c54-91be-1b8451377211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:55.892428 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961629f-01f4-4c54-91be-1b8451377211 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:55.892722 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961629f-01f4-4c54-91be-1b8451377211 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:55.893016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961629f-01f4-4c54-91be-1b8451377211 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:55.893752 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961629f-01f4-4c54-91be-1b8451377211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:55.894058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961629f-01f4-4c54-91be-1b8451377211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:55.895433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961629f-01f4-4c54-91be-1b8451377211 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:55.909066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 609/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:55.914702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaf452-cfc5-4f0b-a5fd-880a6986db8b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:55.999377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:56.035644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbaf452-cfc5-4f0b-a5fd-880a6986db8b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:56.074895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d429d-b483-4037-ac3c-2d12f5a1da36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:56.075961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d429d-b483-4037-ac3c-2d12f5a1da36 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:56.076250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d429d-b483-4037-ac3c-2d12f5a1da36 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:56.076531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d429d-b483-4037-ac3c-2d12f5a1da36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:56.083711 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d429d-b483-4037-ac3c-2d12f5a1da36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:56.085340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5d429d-b483-4037-ac3c-2d12f5a1da36 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ae5d429d-b483-4037-ac3c-2d12f5a1da36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:21:56.100129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:56.101281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:56.102332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:21:56.102332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:21:56.102332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:21:56.102332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:21:56.102332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:21:56.102332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:21:56.102332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:21:56.102332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:21:56.102332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 608/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:21:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:56.109587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961629f-01f4-4c54-91be-1b8451377211 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:56.233805 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961629f-01f4-4c54-91be-1b8451377211 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:56.259207 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:56.271071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec602d-add8-4321-a9a4-99990c62d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:56.271737 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec602d-add8-4321-a9a4-99990c62d89c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:56.272021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec602d-add8-4321-a9a4-99990c62d89c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:56.272299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec602d-add8-4321-a9a4-99990c62d89c None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:56.273122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec602d-add8-4321-a9a4-99990c62d89c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:56.273434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec602d-add8-4321-a9a4-99990c62d89c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:56.274900 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec602d-add8-4321-a9a4-99990c62d89c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:56.293337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 610/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:21:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:56.299601 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d429d-b483-4037-ac3c-2d12f5a1da36 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:56.409645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d429d-b483-4037-ac3c-2d12f5a1da36 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:56.442207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:56.449251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca62afe-171f-41ac-8bcb-0a5e68a46f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:56.450016 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca62afe-171f-41ac-8bcb-0a5e68a46f38 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:56.450458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca62afe-171f-41ac-8bcb-0a5e68a46f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:56.451017 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca62afe-171f-41ac-8bcb-0a5e68a46f38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:56.451984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca62afe-171f-41ac-8bcb-0a5e68a46f38 None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=b39eb81eb6a64556a4079115d27f1624) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:56.452309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca62afe-171f-41ac-8bcb-0a5e68a46f38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:56.454176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca62afe-171f-41ac-8bcb-0a5e68a46f38 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:56.472761 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 609/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:21:56 2022] GET /identity/v3/role_assignments?user.id=b39eb81eb6a64556a4079115d27f1624&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:58.916122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9ae4-9c00-4d78-b562-a1e232b1b5be None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:58.916792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9ae4-9c00-4d78-b562-a1e232b1b5be None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:58.916792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe9ae4-9c00-4d78-b562-a1e232b1b5be None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:58.918742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 611/1220] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:21:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:21:58.924115 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04278c-f1a1-4ccf-9e56-b6cc89be59cd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:58.924549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04278c-f1a1-4ccf-9e56-b6cc89be59cd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:58.924687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04278c-f1a1-4ccf-9e56-b6cc89be59cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:58.943572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0a04278c-f1a1-4ccf-9e56-b6cc89be59cd None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:21:58.944888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0a04278c-f1a1-4ccf-9e56-b6cc89be59cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:21:59.018319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 610/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:21:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:21:59.041310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9ae4-9c00-4d78-b562-a1e232b1b5be None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:59.150762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe9ae4-9c00-4d78-b562-a1e232b1b5be None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:59.186714 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d43170-f535-4ab6-a705-7b766f6e15b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:59.187516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d43170-f535-4ab6-a705-7b766f6e15b3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:59.187800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d43170-f535-4ab6-a705-7b766f6e15b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:59.188073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d43170-f535-4ab6-a705-7b766f6e15b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:59.199772 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d43170-f535-4ab6-a705-7b766f6e15b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-80d43170-f535-4ab6-a705-7b766f6e15b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:21:59.207525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:59.208773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:59.210092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:59.210092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:59.210092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:59.210092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:59.210092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:21:59.210092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:21:59.210092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:21:59.210092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:21:59.210092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:21:59.210092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:21:59.210092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:21:59.210092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:21:59.210092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 612/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:21:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:59.215716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04278c-f1a1-4ccf-9e56-b6cc89be59cd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:59.321636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04278c-f1a1-4ccf-9e56-b6cc89be59cd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:59.349039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:59.359988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636740a6-e239-416c-a9f1-4009c77c3880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:59.360657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636740a6-e239-416c-a9f1-4009c77c3880 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:59.360974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636740a6-e239-416c-a9f1-4009c77c3880 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:59.361254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636740a6-e239-416c-a9f1-4009c77c3880 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:59.362097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636740a6-e239-416c-a9f1-4009c77c3880 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:59.362420 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636740a6-e239-416c-a9f1-4009c77c3880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:59.363865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636740a6-e239-416c-a9f1-4009c77c3880 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:59.373134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 611/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:21:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:59.379499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d43170-f535-4ab6-a705-7b766f6e15b3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:59.428260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:59.491944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d43170-f535-4ab6-a705-7b766f6e15b3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:59.532809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af389be-b5ce-4c06-ba67-bb7757dcd8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:59.533767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af389be-b5ce-4c06-ba67-bb7757dcd8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:59.534067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af389be-b5ce-4c06-ba67-bb7757dcd8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:59.534429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af389be-b5ce-4c06-ba67-bb7757dcd8d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:59.546912 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af389be-b5ce-4c06-ba67-bb7757dcd8d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:59.548505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af389be-b5ce-4c06-ba67-bb7757dcd8d1 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-7af389be-b5ce-4c06-ba67-bb7757dcd8d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:21:59.569995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:59.571192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:59.577874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:21:59.577874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:21:59.577874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:21:59.577874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:21:59.577874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 613/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:59.578309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636740a6-e239-416c-a9f1-4009c77c3880 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:59.707672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636740a6-e239-416c-a9f1-4009c77c3880 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:59.746955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a35656-f206-4b98-9fb6-241e5c329da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:59.747623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a35656-f206-4b98-9fb6-241e5c329da2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:59.747912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a35656-f206-4b98-9fb6-241e5c329da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:59.748186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a35656-f206-4b98-9fb6-241e5c329da2 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:59.748937 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a35656-f206-4b98-9fb6-241e5c329da2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:21:59.749251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a35656-f206-4b98-9fb6-241e5c329da2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:59.750677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a35656-f206-4b98-9fb6-241e5c329da2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:59.764454 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 612/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:21:59.770646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af389be-b5ce-4c06-ba67-bb7757dcd8d1 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:21:59.872805 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:21:59.889314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af389be-b5ce-4c06-ba67-bb7757dcd8d1 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:21:59.927106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c8733-b093-4f6a-bc3b-9ca2fda984e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:21:59.927943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c8733-b093-4f6a-bc3b-9ca2fda984e7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:21:59.928211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c8733-b093-4f6a-bc3b-9ca2fda984e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:21:59.928494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c8733-b093-4f6a-bc3b-9ca2fda984e7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:21:59.937284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c8733-b093-4f6a-bc3b-9ca2fda984e7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:21:59.938721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c8733-b093-4f6a-bc3b-9ca2fda984e7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-b92c8733-b093-4f6a-bc3b-9ca2fda984e7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:21:59.953540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:21:59.954762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:21:59.960446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:21:59.960446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:21:59.960446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:21:59.960446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:21:59.960446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:21:59.960446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:21:59.960446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:21:59.960446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:21:59.960446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:21:59.960446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:21:59.960446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 614/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:21:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:21:59.961135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a35656-f206-4b98-9fb6-241e5c329da2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:00.012927 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:00.075192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a35656-f206-4b98-9fb6-241e5c329da2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:00.114160 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8443c-f634-4e40-874e-72db4a7bb484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:00.114933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8443c-f634-4e40-874e-72db4a7bb484 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.115283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8443c-f634-4e40-874e-72db4a7bb484 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.115579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8443c-f634-4e40-874e-72db4a7bb484 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.116472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8443c-f634-4e40-874e-72db4a7bb484 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:00.116812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8443c-f634-4e40-874e-72db4a7bb484 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:00.118290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8443c-f634-4e40-874e-72db4a7bb484 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:00.138297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 613/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Thu May 26 12:21:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:00.144121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c8733-b093-4f6a-bc3b-9ca2fda984e7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:00.258290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c8733-b093-4f6a-bc3b-9ca2fda984e7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:00.303802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a676fa-9098-40c1-8702-b4cfdd6540a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:00.304604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a676fa-9098-40c1-8702-b4cfdd6540a0 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.304924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a676fa-9098-40c1-8702-b4cfdd6540a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.305282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a676fa-9098-40c1-8702-b4cfdd6540a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.317852 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a676fa-9098-40c1-8702-b4cfdd6540a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:00.319677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a676fa-9098-40c1-8702-b4cfdd6540a0 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-f1a676fa-9098-40c1-8702-b4cfdd6540a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:00.341512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:00.342863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:00.344276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:00.344276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:00.344276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:00.344276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:00.344276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 615/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:00.348667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8443c-f634-4e40-874e-72db4a7bb484 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:00.458359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8443c-f634-4e40-874e-72db4a7bb484 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:00.461249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:00.501607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d49c6-4e80-4f23-ba24-4e4043e4dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:00.502397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d49c6-4e80-4f23-ba24-4e4043e4dbfd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.502687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d49c6-4e80-4f23-ba24-4e4043e4dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.503089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d49c6-4e80-4f23-ba24-4e4043e4dbfd None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.503865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d49c6-4e80-4f23-ba24-4e4043e4dbfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:00.504170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d49c6-4e80-4f23-ba24-4e4043e4dbfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:00.505846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d49c6-4e80-4f23-ba24-4e4043e4dbfd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:00.519554 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 614/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:00.526312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a676fa-9098-40c1-8702-b4cfdd6540a0 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:00.537416 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:00.654707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a676fa-9098-40c1-8702-b4cfdd6540a0 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:00.697068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d7f3b-d79a-4563-b5bb-5d8342a3357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:00.698237 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d7f3b-d79a-4563-b5bb-5d8342a3357a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.698501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d7f3b-d79a-4563-b5bb-5d8342a3357a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.698781 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d7f3b-d79a-4563-b5bb-5d8342a3357a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.706895 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d7f3b-d79a-4563-b5bb-5d8342a3357a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:00.708602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d7f3b-d79a-4563-b5bb-5d8342a3357a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-120d7f3b-d79a-4563-b5bb-5d8342a3357a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:22:00.725712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:00.726915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:00.734222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:22:00.734222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:22:00.734222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:22:00.734222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:22:00.734222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:22:00.734222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:22:00.734222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:00.734222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:00.734222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 616/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:22:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:00.734989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d49c6-4e80-4f23-ba24-4e4043e4dbfd None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:00.853251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d49c6-4e80-4f23-ba24-4e4043e4dbfd None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:00.893288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e41f9f-3839-4def-891f-c12e9ec2d700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:00.894059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e41f9f-3839-4def-891f-c12e9ec2d700 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:00.894369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e41f9f-3839-4def-891f-c12e9ec2d700 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:00.894654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e41f9f-3839-4def-891f-c12e9ec2d700 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:00.895489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e41f9f-3839-4def-891f-c12e9ec2d700 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:00.895802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e41f9f-3839-4def-891f-c12e9ec2d700 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:00.897297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e41f9f-3839-4def-891f-c12e9ec2d700 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:00.910665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 615/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:22:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:00.916592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d7f3b-d79a-4563-b5bb-5d8342a3357a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:00.996241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:01.035292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d7f3b-d79a-4563-b5bb-5d8342a3357a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:01.073440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dd2f3-7ce9-4ef5-9fa7-26a4284509ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:01.074333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dd2f3-7ce9-4ef5-9fa7-26a4284509ff None admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:01.074635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dd2f3-7ce9-4ef5-9fa7-26a4284509ff None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:01.074909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dd2f3-7ce9-4ef5-9fa7-26a4284509ff None admin] PATH_INFO: `/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/b39eb81eb6a64556a4079115d27f1624/roles/11b992de70b244678ed4f0e082d92e7f` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:01.090860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dd2f3-7ce9-4ef5-9fa7-26a4284509ff None admin] RBAC: Authorizing `identity:create_grant(project_id=b341d104240e4b4cb61d365e8167f6a8, user_id=b39eb81eb6a64556a4079115d27f1624, role_id=11b992de70b244678ed4f0e082d92e7f)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:01.093403 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dd2f3-7ce9-4ef5-9fa7-26a4284509ff None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:01.106932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 617/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:22:00 2022] PUT /identity/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/b39eb81eb6a64556a4079115d27f1624/roles/11b992de70b244678ed4f0e082d92e7f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:22:03.430540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb6281-805d-4d03-873f-620603715816 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:03.431087 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb6281-805d-4d03-873f-620603715816 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:03.431087 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb6281-805d-4d03-873f-620603715816 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:03.433358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 616/1233] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:22:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:03.438991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52120c61-4be3-4f3a-bbb0-72d5045e3576 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:03.439493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52120c61-4be3-4f3a-bbb0-72d5045e3576 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:03.439715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52120c61-4be3-4f3a-bbb0-72d5045e3576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:03.459616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-52120c61-4be3-4f3a-bbb0-72d5045e3576 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:03.461108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-52120c61-4be3-4f3a-bbb0-72d5045e3576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:03.540022 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 618/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:22:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:03.566848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb6281-805d-4d03-873f-620603715816 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:03.606064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:03.693002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb6281-805d-4d03-873f-620603715816 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:03.734380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09f323-f262-4a2d-ae7e-471abd0b611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:03.735424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f323-f262-4a2d-ae7e-471abd0b611d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:03.735718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f323-f262-4a2d-ae7e-471abd0b611d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:03.736000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09f323-f262-4a2d-ae7e-471abd0b611d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:03.748309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09f323-f262-4a2d-ae7e-471abd0b611d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-af09f323-f262-4a2d-ae7e-471abd0b611d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:03.755877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:03.756882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:03.758410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:03.758410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:03.758410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:03.758410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:03.758410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:03.758410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:03.758410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:03.758410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:03.758410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:03.758410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:03.758410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:22:03.758410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:22:03.758410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 617/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Thu May 26 12:22:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:03.763089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52120c61-4be3-4f3a-bbb0-72d5045e3576 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:03.814910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:03.875741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52120c61-4be3-4f3a-bbb0-72d5045e3576 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:03.912945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53ec22-9cda-472d-92cb-f7a2d94a9f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:03.913618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53ec22-9cda-472d-92cb-f7a2d94a9f17 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:03.913899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53ec22-9cda-472d-92cb-f7a2d94a9f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:03.914175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53ec22-9cda-472d-92cb-f7a2d94a9f17 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:03.914921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53ec22-9cda-472d-92cb-f7a2d94a9f17 None admin] RBAC: Adding query filter params (name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:03.915231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53ec22-9cda-472d-92cb-f7a2d94a9f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:03.917609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53ec22-9cda-472d-92cb-f7a2d94a9f17 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:03.926812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 619/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Thu May 26 12:22:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:03.932349 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09f323-f262-4a2d-ae7e-471abd0b611d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:04.029240 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:04.049346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09f323-f262-4a2d-ae7e-471abd0b611d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:04.089747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca327b57-82aa-46db-badd-dc05e3f85996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:04.090508 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca327b57-82aa-46db-badd-dc05e3f85996 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:04.090784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca327b57-82aa-46db-badd-dc05e3f85996 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:04.091074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca327b57-82aa-46db-badd-dc05e3f85996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:04.102385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca327b57-82aa-46db-badd-dc05e3f85996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:04.104309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca327b57-82aa-46db-badd-dc05e3f85996 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ca327b57-82aa-46db-badd-dc05e3f85996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:04.123845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:04.125010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:04.130719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:04.130719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:04.130719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:04.130719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:22:04.130719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 618/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:04.131111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53ec22-9cda-472d-92cb-f7a2d94a9f17 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:04.234656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53ec22-9cda-472d-92cb-f7a2d94a9f17 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:04.243442 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:04.270227 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ef203-8f90-4c1d-9d4b-e920421347d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:04.270888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ef203-8f90-4c1d-9d4b-e920421347d7 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:04.271170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ef203-8f90-4c1d-9d4b-e920421347d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:04.271444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ef203-8f90-4c1d-9d4b-e920421347d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:04.272162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ef203-8f90-4c1d-9d4b-e920421347d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:04.272466 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ef203-8f90-4c1d-9d4b-e920421347d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:04.273854 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ef203-8f90-4c1d-9d4b-e920421347d7 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:04.286238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 620/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:04.292544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca327b57-82aa-46db-badd-dc05e3f85996 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:04.403303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca327b57-82aa-46db-badd-dc05e3f85996 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:04.440863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cba22b-0035-46d5-a7d9-010fc28a0f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:04.441874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cba22b-0035-46d5-a7d9-010fc28a0f5d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:04.442084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cba22b-0035-46d5-a7d9-010fc28a0f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:04.442198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cba22b-0035-46d5-a7d9-010fc28a0f5d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:04.444907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:04.450881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cba22b-0035-46d5-a7d9-010fc28a0f5d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:04.452690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cba22b-0035-46d5-a7d9-010fc28a0f5d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-56cba22b-0035-46d5-a7d9-010fc28a0f5d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:22:04.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:04.471791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:04.473107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:04.473107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:04.473107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:22:04.473107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:22:04.473107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:22:04.473107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:22:04.473107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:22:04.473107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:22:04.473107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:22:04.473107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:22:04.473107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 619/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:22:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:04.477958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ef203-8f90-4c1d-9d4b-e920421347d7 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:04.597531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ef203-8f90-4c1d-9d4b-e920421347d7 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:04.643368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc6fa6-91e0-4773-9192-ac9cf136b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:04.644691 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6fa6-91e0-4773-9192-ac9cf136b960 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:04.645106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6fa6-91e0-4773-9192-ac9cf136b960 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:04.645664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6fa6-91e0-4773-9192-ac9cf136b960 None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:04.647016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc6fa6-91e0-4773-9192-ac9cf136b960 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:04.647555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc6fa6-91e0-4773-9192-ac9cf136b960 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:04.649752 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc6fa6-91e0-4773-9192-ac9cf136b960 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:04.675419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 621/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Thu May 26 12:22:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:04.683572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cba22b-0035-46d5-a7d9-010fc28a0f5d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:04.799070 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cba22b-0035-46d5-a7d9-010fc28a0f5d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:04.836458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb07a1-495e-4202-ac17-103e6ce1d3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:04.837275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb07a1-495e-4202-ac17-103e6ce1d3da None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:04.837835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb07a1-495e-4202-ac17-103e6ce1d3da None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:04.838356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb07a1-495e-4202-ac17-103e6ce1d3da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:04.909000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:04.916663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb07a1-495e-4202-ac17-103e6ce1d3da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:04.918276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb07a1-495e-4202-ac17-103e6ce1d3da None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.035806 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 620/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:22:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:22:05.043005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc6fa6-91e0-4773-9192-ac9cf136b960 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:05.073908 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:05.152129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc6fa6-91e0-4773-9192-ac9cf136b960 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:05.191954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046896a-9169-40f7-84f4-a121dc0bc63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:05.192962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046896a-9169-40f7-84f4-a121dc0bc63b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.193330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046896a-9169-40f7-84f4-a121dc0bc63b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.193709 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046896a-9169-40f7-84f4-a121dc0bc63b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.204978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046896a-9169-40f7-84f4-a121dc0bc63b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:05.206483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046896a-9169-40f7-84f4-a121dc0bc63b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-9046896a-9169-40f7-84f4-a121dc0bc63b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:05.226162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:05.227413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:05.228566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:05.228566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:05.228566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:05.228566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:05.229338 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 622/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:05.235745 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb07a1-495e-4202-ac17-103e6ce1d3da None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:05.350099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:05.356887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb07a1-495e-4202-ac17-103e6ce1d3da None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:05.396067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1242b-155b-45ba-aec7-406f50297274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:05.397001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1242b-155b-45ba-aec7-406f50297274 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.397288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1242b-155b-45ba-aec7-406f50297274 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.397565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1242b-155b-45ba-aec7-406f50297274 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.398598 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1242b-155b-45ba-aec7-406f50297274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:05.399006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1242b-155b-45ba-aec7-406f50297274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:05.401512 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1242b-155b-45ba-aec7-406f50297274 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.415074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 621/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:05.420899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046896a-9169-40f7-84f4-a121dc0bc63b None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:05.512262 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:05.540273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046896a-9169-40f7-84f4-a121dc0bc63b None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:05.576555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c9fed-a9b2-45d2-bb12-5741dab97115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:05.577371 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9fed-a9b2-45d2-bb12-5741dab97115 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.577658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9fed-a9b2-45d2-bb12-5741dab97115 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.577933 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c9fed-a9b2-45d2-bb12-5741dab97115 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.585522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c9fed-a9b2-45d2-bb12-5741dab97115 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:05.587260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c9fed-a9b2-45d2-bb12-5741dab97115 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-9c6c9fed-a9b2-45d2-bb12-5741dab97115 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:22:05.603366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:05.604631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:05.605749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:22:05.605749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:22:05.605749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:22:05.605749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:22:05.605749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:22:05.605749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:22:05.605749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:05.605749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:05.605749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 623/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:05.612149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1242b-155b-45ba-aec7-406f50297274 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:05.724950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1242b-155b-45ba-aec7-406f50297274 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:05.760670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01247a8-58c5-42c9-bbb4-7bc5ab23ccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:05.761364 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01247a8-58c5-42c9-bbb4-7bc5ab23ccc8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.761649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01247a8-58c5-42c9-bbb4-7bc5ab23ccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.761926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01247a8-58c5-42c9-bbb4-7bc5ab23ccc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.762722 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01247a8-58c5-42c9-bbb4-7bc5ab23ccc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:05.763036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01247a8-58c5-42c9-bbb4-7bc5ab23ccc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:05.764476 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01247a8-58c5-42c9-bbb4-7bc5ab23ccc8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.777341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 622/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:05.783888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c9fed-a9b2-45d2-bb12-5741dab97115 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:05.904555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c9fed-a9b2-45d2-bb12-5741dab97115 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:05.942917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22281c8-2c66-4360-be71-9a0f7a64b438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:05.943634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22281c8-2c66-4360-be71-9a0f7a64b438 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:05.943932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22281c8-2c66-4360-be71-9a0f7a64b438 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:05.944205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22281c8-2c66-4360-be71-9a0f7a64b438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:05.945107 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22281c8-2c66-4360-be71-9a0f7a64b438 None admin] RBAC: Adding query filter params (role.id=11b992de70b244678ed4f0e082d92e7f, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=b39eb81eb6a64556a4079115d27f1624) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:05.945447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22281c8-2c66-4360-be71-9a0f7a64b438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:05.947259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22281c8-2c66-4360-be71-9a0f7a64b438 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:05.953682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 624/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:22:05 2022] GET /identity/v3/role_assignments?user.id=b39eb81eb6a64556a4079115d27f1624&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=11b992de70b244678ed4f0e082d92e7f => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:08.638872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45fc19-e215-4922-8d01-23ff52f7bebd None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:08.639437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45fc19-e215-4922-8d01-23ff52f7bebd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:08.639437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45fc19-e215-4922-8d01-23ff52f7bebd None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:08.640899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 623/1247] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:08.648493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881860-9c98-490f-a635-8af90359b598 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:08.649744 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881860-9c98-490f-a635-8af90359b598 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:08.649883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881860-9c98-490f-a635-8af90359b598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:08.656609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:08.676223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3e881860-9c98-490f-a635-8af90359b598 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:08.677649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3e881860-9c98-490f-a635-8af90359b598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:08.753751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 625/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:22:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:22:08.779434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45fc19-e215-4922-8d01-23ff52f7bebd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:08.800801 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:08.897983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45fc19-e215-4922-8d01-23ff52f7bebd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:08.938623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002a983-5215-4180-9c10-cced7affae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:08.939421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002a983-5215-4180-9c10-cced7affae91 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:08.939710 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002a983-5215-4180-9c10-cced7affae91 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:08.940019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002a983-5215-4180-9c10-cced7affae91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:08.950344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002a983-5215-4180-9c10-cced7affae91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f002a983-5215-4180-9c10-cced7affae91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:08.957952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:08.959032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:08.960025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:08.960025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:08.960025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:08.960025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:08.960025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:08.960025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:08.960025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:08.960025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:08.960025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:08.960025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:08.960025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:08.960025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:22:08.960025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 624/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:22:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:08.965865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881860-9c98-490f-a635-8af90359b598 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.079402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881860-9c98-490f-a635-8af90359b598 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.114571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:09.120672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b966a77-4de0-49f7-8422-ddae4b829147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.121447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b966a77-4de0-49f7-8422-ddae4b829147 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.121747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b966a77-4de0-49f7-8422-ddae4b829147 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.122032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b966a77-4de0-49f7-8422-ddae4b829147 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.122848 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b966a77-4de0-49f7-8422-ddae4b829147 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:09.123161 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b966a77-4de0-49f7-8422-ddae4b829147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:09.124707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b966a77-4de0-49f7-8422-ddae4b829147 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:09.134594 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 626/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:22:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:09.140548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002a983-5215-4180-9c10-cced7affae91 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.228051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:09.255094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002a983-5215-4180-9c10-cced7affae91 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.293088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc71215-e0da-448d-a1e8-2b47370dce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.293889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc71215-e0da-448d-a1e8-2b47370dce2b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.294178 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc71215-e0da-448d-a1e8-2b47370dce2b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.294457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc71215-e0da-448d-a1e8-2b47370dce2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.308278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc71215-e0da-448d-a1e8-2b47370dce2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:09.309966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc71215-e0da-448d-a1e8-2b47370dce2b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-4fc71215-e0da-448d-a1e8-2b47370dce2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:09.329384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:09.330363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:09.331381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:09.331381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:09.331381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:09.331381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:22:09.331381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 625/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:09.337006 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b966a77-4de0-49f7-8422-ddae4b829147 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.450170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b966a77-4de0-49f7-8422-ddae4b829147 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.486923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb4de2-746a-44be-95e0-782d90983c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.487515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb4de2-746a-44be-95e0-782d90983c6e None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.487804 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb4de2-746a-44be-95e0-782d90983c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.488081 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb4de2-746a-44be-95e0-782d90983c6e None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.488835 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb4de2-746a-44be-95e0-782d90983c6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:09.489147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb4de2-746a-44be-95e0-782d90983c6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:09.490517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb4de2-746a-44be-95e0-782d90983c6e None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:09.503866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 627/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:09.510607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc71215-e0da-448d-a1e8-2b47370dce2b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.622941 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc71215-e0da-448d-a1e8-2b47370dce2b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.652443 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:09.661058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc3b02-504f-48dd-bb61-6a221270db56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.661855 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3b02-504f-48dd-bb61-6a221270db56 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.662138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3b02-504f-48dd-bb61-6a221270db56 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.662412 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc3b02-504f-48dd-bb61-6a221270db56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.670232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc3b02-504f-48dd-bb61-6a221270db56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:09.671833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc3b02-504f-48dd-bb61-6a221270db56 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-fbfc3b02-504f-48dd-bb61-6a221270db56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:22:09.687436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:09.688518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:09.689989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:09.689989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:09.689989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:22:09.689989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:22:09.689989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:22:09.689989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:22:09.689989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:22:09.689989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:22:09.689989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:22:09.689989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:22:09.689989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 626/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:09.694871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb4de2-746a-44be-95e0-782d90983c6e None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.754000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:09.804596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb4de2-746a-44be-95e0-782d90983c6e None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:09.842135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1658e-60d5-4d04-adb1-91cd4a99abcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:09.842866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1658e-60d5-4d04-adb1-91cd4a99abcf None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:09.843184 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1658e-60d5-4d04-adb1-91cd4a99abcf None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:09.843500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1658e-60d5-4d04-adb1-91cd4a99abcf None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:09.844431 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1658e-60d5-4d04-adb1-91cd4a99abcf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:09.844806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1658e-60d5-4d04-adb1-91cd4a99abcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:09.846374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1658e-60d5-4d04-adb1-91cd4a99abcf None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:09.870390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 628/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:09.872762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc3b02-504f-48dd-bb61-6a221270db56 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:09.986500 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc3b02-504f-48dd-bb61-6a221270db56 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.023274 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd33c5-ddc7-4de1-900d-61cbb3e68980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.024474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd33c5-ddc7-4de1-900d-61cbb3e68980 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.024914 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd33c5-ddc7-4de1-900d-61cbb3e68980 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.025197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd33c5-ddc7-4de1-900d-61cbb3e68980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.085388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:10.100122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd33c5-ddc7-4de1-900d-61cbb3e68980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.101667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd33c5-ddc7-4de1-900d-61cbb3e68980 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:10.209383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 627/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:22:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:22:10.215497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1658e-60d5-4d04-adb1-91cd4a99abcf None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:10.321998 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1658e-60d5-4d04-adb1-91cd4a99abcf None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.337625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:10.359900 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e61cc-95e8-416b-856f-fe7a84b909ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.360728 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e61cc-95e8-416b-856f-fe7a84b909ba None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.361019 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e61cc-95e8-416b-856f-fe7a84b909ba None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.361297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e61cc-95e8-416b-856f-fe7a84b909ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.372797 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e61cc-95e8-416b-856f-fe7a84b909ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.374299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e61cc-95e8-416b-856f-fe7a84b909ba None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-a88e61cc-95e8-416b-856f-fe7a84b909ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:10.393470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:10.394465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:10.395379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:10.395379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:10.395379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:10.395379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:10.395379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 629/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:10.400888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd33c5-ddc7-4de1-900d-61cbb3e68980 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:10.491957 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:10.507560 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd33c5-ddc7-4de1-900d-61cbb3e68980 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.542642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12873a-5864-46b6-a840-8f37d8ac8b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.543313 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12873a-5864-46b6-a840-8f37d8ac8b45 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.543599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12873a-5864-46b6-a840-8f37d8ac8b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.543884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12873a-5864-46b6-a840-8f37d8ac8b45 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.544612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12873a-5864-46b6-a840-8f37d8ac8b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:10.544962 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12873a-5864-46b6-a840-8f37d8ac8b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.546350 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12873a-5864-46b6-a840-8f37d8ac8b45 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:10.558139 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 628/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:10.564085 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e61cc-95e8-416b-856f-fe7a84b909ba None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:10.686174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e61cc-95e8-416b-856f-fe7a84b909ba None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.723339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad041-37ac-4609-91c8-dd6992bd21ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.724140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad041-37ac-4609-91c8-dd6992bd21ca None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.724422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad041-37ac-4609-91c8-dd6992bd21ca None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.724702 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ad041-37ac-4609-91c8-dd6992bd21ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.732832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ad041-37ac-4609-91c8-dd6992bd21ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.734271 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ad041-37ac-4609-91c8-dd6992bd21ca None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-7e5ad041-37ac-4609-91c8-dd6992bd21ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:22:10.749306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:10.750397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:10.751668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:22:10.751668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:22:10.751668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:22:10.751668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:22:10.751668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:22:10.751668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:22:10.751668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:10.751668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:10.751668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 630/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:22:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:10.756342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12873a-5864-46b6-a840-8f37d8ac8b45 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:10.853692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12873a-5864-46b6-a840-8f37d8ac8b45 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:10.886311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf8e6c-1000-4291-87b2-1d0e469fef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:10.886970 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf8e6c-1000-4291-87b2-1d0e469fef4b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:10.887255 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf8e6c-1000-4291-87b2-1d0e469fef4b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:10.887533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf8e6c-1000-4291-87b2-1d0e469fef4b None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:10.888319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf8e6c-1000-4291-87b2-1d0e469fef4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:10.888631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf8e6c-1000-4291-87b2-1d0e469fef4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:10.890099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf8e6c-1000-4291-87b2-1d0e469fef4b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:10.902491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 629/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:22:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:10.908479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad041-37ac-4609-91c8-dd6992bd21ca None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:10.934646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:11.008988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ad041-37ac-4609-91c8-dd6992bd21ca None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:11.042012 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36713340-5d55-46db-8ed4-c7aafcd88722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:11.042677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713340-5d55-46db-8ed4-c7aafcd88722 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:11.042959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713340-5d55-46db-8ed4-c7aafcd88722 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:11.043230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36713340-5d55-46db-8ed4-c7aafcd88722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:11.044047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36713340-5d55-46db-8ed4-c7aafcd88722 None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=b39eb81eb6a64556a4079115d27f1624) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:11.044354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36713340-5d55-46db-8ed4-c7aafcd88722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:11.045785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36713340-5d55-46db-8ed4-c7aafcd88722 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:11.051050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 631/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:22:10 2022] GET /identity/v3/role_assignments?user.id=b39eb81eb6a64556a4079115d27f1624&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:13.231386 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f2069-7854-415b-a281-2013f92a57b5 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.231922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f2069-7854-415b-a281-2013f92a57b5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.231922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f2069-7854-415b-a281-2013f92a57b5 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.233353 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 630/1261] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:13.238567 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbb983-27f5-4808-9187-f550d576466e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.238979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbb983-27f5-4808-9187-f550d576466e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.239136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbb983-27f5-4808-9187-f550d576466e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.256141 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f3dbb983-27f5-4808-9187-f550d576466e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:13.257374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f3dbb983-27f5-4808-9187-f550d576466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:13.323530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 632/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:22:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:13.345539 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f2069-7854-415b-a281-2013f92a57b5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:13.356431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:13.447948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f2069-7854-415b-a281-2013f92a57b5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:13.480536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e7a81-3db1-416b-85cd-d76b4c275dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:13.481351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e7a81-3db1-416b-85cd-d76b4c275dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.481683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e7a81-3db1-416b-85cd-d76b4c275dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.481903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e7a81-3db1-416b-85cd-d76b4c275dc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.493376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e7a81-3db1-416b-85cd-d76b4c275dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f15e7a81-3db1-416b-85cd-d76b4c275dc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:13.500920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:13.501990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:13.502955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:13.502955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:13.502955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:13.502955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:13.502955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:13.502955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:13.502955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:13.502955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:13.502955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:13.502955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:13.502955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:13.502955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:22:13.502955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 631/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:22:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:13.509032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbb983-27f5-4808-9187-f550d576466e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:13.526810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:13.617869 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbb983-27f5-4808-9187-f550d576466e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:13.658631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dfda9-7f80-44db-90e2-8172e78b2124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:13.659303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dfda9-7f80-44db-90e2-8172e78b2124 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.659589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dfda9-7f80-44db-90e2-8172e78b2124 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.659868 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dfda9-7f80-44db-90e2-8172e78b2124 None admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.660618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dfda9-7f80-44db-90e2-8172e78b2124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:13.660960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dfda9-7f80-44db-90e2-8172e78b2124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:13.662329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dfda9-7f80-44db-90e2-8172e78b2124 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:13.670818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 633/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:22:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:13.676584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e7a81-3db1-416b-85cd-d76b4c275dc6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:13.754322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:13.789276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e7a81-3db1-416b-85cd-d76b4c275dc6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:13.822704 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c91367-1802-4283-a8a9-77c33f0a4e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:13.823483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c91367-1802-4283-a8a9-77c33f0a4e05 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.823762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c91367-1802-4283-a8a9-77c33f0a4e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.824033 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c91367-1802-4283-a8a9-77c33f0a4e05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.834181 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c91367-1802-4283-a8a9-77c33f0a4e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:13.835639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c91367-1802-4283-a8a9-77c33f0a4e05 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-66c91367-1802-4283-a8a9-77c33f0a4e05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:13.853187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:13.854211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:13.855425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:13.855425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:13.855425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:13.855425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:22:13.855425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 632/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:13.860536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dfda9-7f80-44db-90e2-8172e78b2124 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:13.940110 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:13.959274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dfda9-7f80-44db-90e2-8172e78b2124 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:13.993052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b067e-52fe-47c6-a9fb-0a34422ea91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:13.993712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b067e-52fe-47c6-a9fb-0a34422ea91a None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:13.993993 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b067e-52fe-47c6-a9fb-0a34422ea91a None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:13.994270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b067e-52fe-47c6-a9fb-0a34422ea91a None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:13.994989 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b067e-52fe-47c6-a9fb-0a34422ea91a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:13.995296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b067e-52fe-47c6-a9fb-0a34422ea91a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:13.996652 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b067e-52fe-47c6-a9fb-0a34422ea91a None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:14.009725 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 634/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:14.015357 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c91367-1802-4283-a8a9-77c33f0a4e05 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:14.113769 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c91367-1802-4283-a8a9-77c33f0a4e05 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:14.134256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:14.148168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad0c00-40b0-4e62-9d5d-a7114899bd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:14.149228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad0c00-40b0-4e62-9d5d-a7114899bd7e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:14.149511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad0c00-40b0-4e62-9d5d-a7114899bd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:14.149784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad0c00-40b0-4e62-9d5d-a7114899bd7e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:14.156985 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad0c00-40b0-4e62-9d5d-a7114899bd7e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:14.158410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad0c00-40b0-4e62-9d5d-a7114899bd7e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6aad0c00-40b0-4e62-9d5d-a7114899bd7e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:22:14.172460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:14.173697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:14.174900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:14.174900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:14.174900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:22:14.174900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:22:14.174900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:22:14.174900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:22:14.174900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:22:14.174900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:22:14.174900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:22:14.174900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:22:14.174900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 633/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:22:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:14.180058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b067e-52fe-47c6-a9fb-0a34422ea91a None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:14.278386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b067e-52fe-47c6-a9fb-0a34422ea91a None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:14.311337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4722ed-d6b9-4fb3-a4a1-cb4d2a51c84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:14.311999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4722ed-d6b9-4fb3-a4a1-cb4d2a51c84d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:14.312286 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4722ed-d6b9-4fb3-a4a1-cb4d2a51c84d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:14.312562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4722ed-d6b9-4fb3-a4a1-cb4d2a51c84d None admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:14.313431 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4722ed-d6b9-4fb3-a4a1-cb4d2a51c84d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:14.313746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4722ed-d6b9-4fb3-a4a1-cb4d2a51c84d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:14.315172 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4722ed-d6b9-4fb3-a4a1-cb4d2a51c84d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:14.324204 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:14.332580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 635/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Thu May 26 12:22:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:14.338860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad0c00-40b0-4e62-9d5d-a7114899bd7e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:14.441815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad0c00-40b0-4e62-9d5d-a7114899bd7e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:14.474851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b07b1c-c16e-40b5-9127-13cbdb66a7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:14.475637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b07b1c-c16e-40b5-9127-13cbdb66a7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:14.475918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b07b1c-c16e-40b5-9127-13cbdb66a7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:14.476222 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b07b1c-c16e-40b5-9127-13cbdb66a7a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:14.486842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b07b1c-c16e-40b5-9127-13cbdb66a7a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:14.488284 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b07b1c-c16e-40b5-9127-13cbdb66a7a1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-05b07b1c-c16e-40b5-9127-13cbdb66a7a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:14.505104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:14.506152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:14.507977 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:14.507977 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:14.507977 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:14.507977 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:22:14.507977 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 634/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:22:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:14.512568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4722ed-d6b9-4fb3-a4a1-cb4d2a51c84d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:14.614041 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4722ed-d6b9-4fb3-a4a1-cb4d2a51c84d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:14.647797 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae153081-b287-477b-86f8-cc859653a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:14.649192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae153081-b287-477b-86f8-cc859653a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:14.649482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae153081-b287-477b-86f8-cc859653a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:14.649762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae153081-b287-477b-86f8-cc859653a1e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:14.650484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae153081-b287-477b-86f8-cc859653a1e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:14.650825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae153081-b287-477b-86f8-cc859653a1e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:14.652187 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae153081-b287-477b-86f8-cc859653a1e3 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:14.663065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 636/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:14.668944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b07b1c-c16e-40b5-9127-13cbdb66a7a1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:14.700749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:14.768602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b07b1c-c16e-40b5-9127-13cbdb66a7a1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:14.802371 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953850e5-81f0-4e82-9d6b-50acbf6f39b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:14.803154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953850e5-81f0-4e82-9d6b-50acbf6f39b6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:14.803435 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953850e5-81f0-4e82-9d6b-50acbf6f39b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:14.803711 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953850e5-81f0-4e82-9d6b-50acbf6f39b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:14.810822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953850e5-81f0-4e82-9d6b-50acbf6f39b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:14.812254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953850e5-81f0-4e82-9d6b-50acbf6f39b6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-953850e5-81f0-4e82-9d6b-50acbf6f39b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:22:14.826633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:14.827708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:14.833311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:22:14.833311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:22:14.833311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:22:14.833311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:22:14.833311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:22:14.833311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:22:14.833311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:14.833311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:22:14.833311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 635/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:22:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:14.833908 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae153081-b287-477b-86f8-cc859653a1e3 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:14.891096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:14.932385 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae153081-b287-477b-86f8-cc859653a1e3 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:14.964754 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fa91a-e491-48fe-b734-9de7da3fc7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:14.965413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fa91a-e491-48fe-b734-9de7da3fc7bd None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:14.965691 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fa91a-e491-48fe-b734-9de7da3fc7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:14.965963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fa91a-e491-48fe-b734-9de7da3fc7bd None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:14.966744 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fa91a-e491-48fe-b734-9de7da3fc7bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:14.967055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fa91a-e491-48fe-b734-9de7da3fc7bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:14.968470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fa91a-e491-48fe-b734-9de7da3fc7bd None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:14.980366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 637/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:22:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:14.986513 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953850e5-81f0-4e82-9d6b-50acbf6f39b6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:15.075471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:15.084181 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953850e5-81f0-4e82-9d6b-50acbf6f39b6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:15.117189 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e837c5-0f69-4b00-a6ce-043d477fab0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:15.118683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e837c5-0f69-4b00-a6ce-043d477fab0a None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:15.118962 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e837c5-0f69-4b00-a6ce-043d477fab0a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:15.119238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e837c5-0f69-4b00-a6ce-043d477fab0a None admin] PATH_INFO: `/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/b39eb81eb6a64556a4079115d27f1624/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:15.121341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e837c5-0f69-4b00-a6ce-043d477fab0a None admin] RBAC: Authorizing `identity:create_grant(project_id=b341d104240e4b4cb61d365e8167f6a8, user_id=b39eb81eb6a64556a4079115d27f1624, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:15.122771 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e837c5-0f69-4b00-a6ce-043d477fab0a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:15.134809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 636/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Thu May 26 12:22:14 2022] PUT /identity/v3/projects/b341d104240e4b4cb61d365e8167f6a8/users/b39eb81eb6a64556a4079115d27f1624/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:22:17.306582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46f9e5-0205-49d2-9dae-4abbd88f06c3 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:17.307128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46f9e5-0205-49d2-9dae-4abbd88f06c3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:17.307128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46f9e5-0205-49d2-9dae-4abbd88f06c3 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:17.308501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 638/1274] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:22:17.313657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d77b5-7efc-4e95-ae5c-e4820314db0d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:17.314054 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d77b5-7efc-4e95-ae5c-e4820314db0d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:17.314216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d77b5-7efc-4e95-ae5c-e4820314db0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:17.331228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f70d77b5-7efc-4e95-ae5c-e4820314db0d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:17.332409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f70d77b5-7efc-4e95-ae5c-e4820314db0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:17.398881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 637/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:22:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:17.422821 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46f9e5-0205-49d2-9dae-4abbd88f06c3 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:17.524645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46f9e5-0205-49d2-9dae-4abbd88f06c3 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:17.543879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:17.560731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469b93d-34dc-457b-9c6a-23d5be1d9858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:17.561481 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469b93d-34dc-457b-9c6a-23d5be1d9858 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:17.561765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469b93d-34dc-457b-9c6a-23d5be1d9858 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:17.562043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469b93d-34dc-457b-9c6a-23d5be1d9858 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:17.572378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469b93d-34dc-457b-9c6a-23d5be1d9858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-0469b93d-34dc-457b-9c6a-23d5be1d9858 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:17.580023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:17.581111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:17.582082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:17.582082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:17.582082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:17.582082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:17.582082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:17.582082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:17.582082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:17.582082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:17.582082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:17.582082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:17.582082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:17.582082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:17.582082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 639/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Thu May 26 12:22:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:17.590552 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d77b5-7efc-4e95-ae5c-e4820314db0d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:17.685563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:17.704641 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d77b5-7efc-4e95-ae5c-e4820314db0d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:17.737662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cbe88-78da-4f72-a0bc-f9cd5b8df3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:17.738329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cbe88-78da-4f72-a0bc-f9cd5b8df3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:17.738616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cbe88-78da-4f72-a0bc-f9cd5b8df3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:17.738895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cbe88-78da-4f72-a0bc-f9cd5b8df3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:17.739642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cbe88-78da-4f72-a0bc-f9cd5b8df3b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:17.739951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cbe88-78da-4f72-a0bc-f9cd5b8df3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:17.741360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cbe88-78da-4f72-a0bc-f9cd5b8df3b6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:17.749867 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 638/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Thu May 26 12:22:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:17.755549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469b93d-34dc-457b-9c6a-23d5be1d9858 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:17.856194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469b93d-34dc-457b-9c6a-23d5be1d9858 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:17.890819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6e7a3-6bea-41b3-b808-64a4d1f07d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:17.891614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6e7a3-6bea-41b3-b808-64a4d1f07d1c None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:17.891902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6e7a3-6bea-41b3-b808-64a4d1f07d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:17.892367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6e7a3-6bea-41b3-b808-64a4d1f07d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:17.902669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6e7a3-6bea-41b3-b808-64a4d1f07d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:17.904118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6e7a3-6bea-41b3-b808-64a4d1f07d1c None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-85c6e7a3-6bea-41b3-b808-64a4d1f07d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:17.920633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:17.921675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:17.922778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:17.922778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:17.922778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:17.922778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:17.922778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 640/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:17.927544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cbe88-78da-4f72-a0bc-f9cd5b8df3b6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:18.026288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cbe88-78da-4f72-a0bc-f9cd5b8df3b6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:18.059479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fc02b-2b7c-49c3-b8f3-1d7a16c7bf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:18.060130 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fc02b-2b7c-49c3-b8f3-1d7a16c7bf49 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:18.060411 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fc02b-2b7c-49c3-b8f3-1d7a16c7bf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:18.060682 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fc02b-2b7c-49c3-b8f3-1d7a16c7bf49 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:18.061427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fc02b-2b7c-49c3-b8f3-1d7a16c7bf49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:18.061732 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fc02b-2b7c-49c3-b8f3-1d7a16c7bf49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:18.063102 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fc02b-2b7c-49c3-b8f3-1d7a16c7bf49 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:18.074444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 639/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:18.080014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6e7a3-6bea-41b3-b808-64a4d1f07d1c None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:18.110996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:18.180976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6e7a3-6bea-41b3-b808-64a4d1f07d1c None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:18.213231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adb1bd-7abd-41da-88ae-c863f9f499a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:18.214018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adb1bd-7abd-41da-88ae-c863f9f499a4 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:18.214303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adb1bd-7abd-41da-88ae-c863f9f499a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:18.214583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adb1bd-7abd-41da-88ae-c863f9f499a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:18.221778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adb1bd-7abd-41da-88ae-c863f9f499a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:18.223202 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adb1bd-7abd-41da-88ae-c863f9f499a4 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-22adb1bd-7abd-41da-88ae-c863f9f499a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:22:18.237874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:18.238992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:18.240339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:18.240339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:18.240339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:22:18.240339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:22:18.240339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:22:18.240339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:22:18.240339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:22:18.240339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:22:18.240339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:22:18.240339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:18.240339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 641/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:22:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:18.245723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fc02b-2b7c-49c3-b8f3-1d7a16c7bf49 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:18.249519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:18.341035 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fc02b-2b7c-49c3-b8f3-1d7a16c7bf49 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:18.375150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4e867-d26c-460b-a747-4ae57fcf6558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:18.375744 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4e867-d26c-460b-a747-4ae57fcf6558 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:18.376027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4e867-d26c-460b-a747-4ae57fcf6558 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:18.376304 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4e867-d26c-460b-a747-4ae57fcf6558 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:18.377162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4e867-d26c-460b-a747-4ae57fcf6558 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:18.377473 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4e867-d26c-460b-a747-4ae57fcf6558 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:18.378900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4e867-d26c-460b-a747-4ae57fcf6558 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:18.395374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 640/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Thu May 26 12:22:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:18.401514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adb1bd-7abd-41da-88ae-c863f9f499a4 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:18.490734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:18.501171 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adb1bd-7abd-41da-88ae-c863f9f499a4 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:18.534017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afc9cf-e53a-4090-ae13-fc3350ed0100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:18.534658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afc9cf-e53a-4090-ae13-fc3350ed0100 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:18.534943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afc9cf-e53a-4090-ae13-fc3350ed0100 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:18.535221 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afc9cf-e53a-4090-ae13-fc3350ed0100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:18.609532 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afc9cf-e53a-4090-ae13-fc3350ed0100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:18.610990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afc9cf-e53a-4090-ae13-fc3350ed0100 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:18.703436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:18.710608 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 642/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Thu May 26 12:22:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:22:18.717217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4e867-d26c-460b-a747-4ae57fcf6558 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:18.778255 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:18.814946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4e867-d26c-460b-a747-4ae57fcf6558 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:18.848369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b748ad-5ca9-42c6-a313-4dbd60662d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:18.849173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b748ad-5ca9-42c6-a313-4dbd60662d0c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:18.849455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b748ad-5ca9-42c6-a313-4dbd60662d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:18.849724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b748ad-5ca9-42c6-a313-4dbd60662d0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:18.860057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b748ad-5ca9-42c6-a313-4dbd60662d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:18.861536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b748ad-5ca9-42c6-a313-4dbd60662d0c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-d5b748ad-5ca9-42c6-a313-4dbd60662d0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:18.879715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:18.880606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:18.881597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:18.881597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:18.881597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:18.881597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:22:18.881597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 641/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:18.886240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afc9cf-e53a-4090-ae13-fc3350ed0100 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:18.983228 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afc9cf-e53a-4090-ae13-fc3350ed0100 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:19.016649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d55f9c-80a6-4985-9e25-6438d7c92b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:19.017344 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d55f9c-80a6-4985-9e25-6438d7c92b42 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:19.017633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d55f9c-80a6-4985-9e25-6438d7c92b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:19.017915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d55f9c-80a6-4985-9e25-6438d7c92b42 None admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:19.018644 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d55f9c-80a6-4985-9e25-6438d7c92b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:19.018956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d55f9c-80a6-4985-9e25-6438d7c92b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:19.020346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d55f9c-80a6-4985-9e25-6438d7c92b42 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:19.032537 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 643/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Thu May 26 12:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:19.038812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b748ad-5ca9-42c6-a313-4dbd60662d0c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:19.137659 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b748ad-5ca9-42c6-a313-4dbd60662d0c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:19.151735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:19.171894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fc857-31ba-47af-bd86-904f787a74ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:19.172675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fc857-31ba-47af-bd86-904f787a74ea None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:19.172992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fc857-31ba-47af-bd86-904f787a74ea None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:19.173270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fc857-31ba-47af-bd86-904f787a74ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:19.180355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fc857-31ba-47af-bd86-904f787a74ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:19.181828 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fc857-31ba-47af-bd86-904f787a74ea None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c62fc857-31ba-47af-bd86-904f787a74ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:22:19.195746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:19.197015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:19.198200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:22:19.198200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:22:19.198200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:22:19.198200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:22:19.198200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:22:19.198200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:22:19.198200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:22:19.198200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: ERROR keystone.server.flask.application May 26 12:22:19.198200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 642/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Thu May 26 12:22:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:19.202795 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d55f9c-80a6-4985-9e25-6438d7c92b42 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:19.252591 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:19.301653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d55f9c-80a6-4985-9e25-6438d7c92b42 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:19.333604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabca98-2273-4d07-a195-6a4628b5432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:19.334252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabca98-2273-4d07-a195-6a4628b5432b None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:19.334536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabca98-2273-4d07-a195-6a4628b5432b None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:19.334811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabca98-2273-4d07-a195-6a4628b5432b None admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:19.336107 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabca98-2273-4d07-a195-6a4628b5432b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:19.336417 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabca98-2273-4d07-a195-6a4628b5432b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:19.337983 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabca98-2273-4d07-a195-6a4628b5432b None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:19.349563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 644/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Thu May 26 12:22:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:19.356631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fc857-31ba-47af-bd86-904f787a74ea None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:19.451877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fc857-31ba-47af-bd86-904f787a74ea None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:19.484501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065c60e-a798-4192-891c-03cc0408eb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:19.485156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065c60e-a798-4192-891c-03cc0408eb82 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:19.485438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065c60e-a798-4192-891c-03cc0408eb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:19.485711 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065c60e-a798-4192-891c-03cc0408eb82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:19.486529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065c60e-a798-4192-891c-03cc0408eb82 None admin] RBAC: Adding query filter params (role.id=bcbfd8f7fed84bb99e272a37328dcc43, scope.project.id=b341d104240e4b4cb61d365e8167f6a8, user.id=b39eb81eb6a64556a4079115d27f1624) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:19.486840 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065c60e-a798-4192-891c-03cc0408eb82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:19.488257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065c60e-a798-4192-891c-03cc0408eb82 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:19.494570 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 643/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Thu May 26 12:22:19 2022] GET /identity/v3/role_assignments?user.id=b39eb81eb6a64556a4079115d27f1624&scope.project.id=b341d104240e4b4cb61d365e8167f6a8&role.id=bcbfd8f7fed84bb99e272a37328dcc43 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:21.717859 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983105d2-9632-4d27-8754-4f0dc9ac32fc None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:21.718387 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983105d2-9632-4d27-8754-4f0dc9ac32fc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:21.718507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983105d2-9632-4d27-8754-4f0dc9ac32fc None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:21.719779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 645/1288] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:21.724901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b61578-0a90-4a28-8506-f6fd7f181296 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:21.725296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b61578-0a90-4a28-8506-f6fd7f181296 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:21.725467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b61578-0a90-4a28-8506-f6fd7f181296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:21.747029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-36b61578-0a90-4a28-8506-f6fd7f181296 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:21.748256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-36b61578-0a90-4a28-8506-f6fd7f181296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:21.778361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:21.814425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 644/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:22:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:21.837907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983105d2-9632-4d27-8754-4f0dc9ac32fc None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:21.937882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983105d2-9632-4d27-8754-4f0dc9ac32fc None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:21.948768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:21.972299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b0ff-1380-4797-9aca-875ddf3b961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:21.973086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b0ff-1380-4797-9aca-875ddf3b961d None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:21.973370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b0ff-1380-4797-9aca-875ddf3b961d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:21.973646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871b0ff-1380-4797-9aca-875ddf3b961d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:21.974302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871b0ff-1380-4797-9aca-875ddf3b961d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:21.975665 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871b0ff-1380-4797-9aca-875ddf3b961d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-4871b0ff-1380-4797-9aca-875ddf3b961d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:21.987527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:21.988786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:21.989856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 646/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Thu May 26 12:22:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:21.994871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b61578-0a90-4a28-8506-f6fd7f181296 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:22.107158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b61578-0a90-4a28-8506-f6fd7f181296 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:22.141001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146e873-d925-4903-b642-23a041bf6b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:22.141655 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146e873-d925-4903-b642-23a041bf6b59 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:22.141936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146e873-d925-4903-b642-23a041bf6b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:22.142210 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146e873-d925-4903-b642-23a041bf6b59 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:22.142909 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146e873-d925-4903-b642-23a041bf6b59 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:22.143216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146e873-d925-4903-b642-23a041bf6b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:22.144586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146e873-d925-4903-b642-23a041bf6b59 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:22.149867 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 645/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Thu May 26 12:22:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:22.155607 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b0ff-1380-4797-9aca-875ddf3b961d None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:22.254495 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871b0ff-1380-4797-9aca-875ddf3b961d None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:22.287287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c4a72-b00f-42e9-a6ba-956c47ba3ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:22.287939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c4a72-b00f-42e9-a6ba-956c47ba3ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:22.288265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c4a72-b00f-42e9-a6ba-956c47ba3ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:22.288550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c4a72-b00f-42e9-a6ba-956c47ba3ba2 None admin] PATH_INFO: `/v3/services` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:22.289289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c4a72-b00f-42e9-a6ba-956c47ba3ba2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:22.289601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c4a72-b00f-42e9-a6ba-956c47ba3ba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:22.290964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c4a72-b00f-42e9-a6ba-956c47ba3ba2 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:22.295317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 647/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Thu May 26 12:22:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:24.503823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0be7fb-8ea2-4b98-89c9-f5e7ed6cfad6 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:24.504385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0be7fb-8ea2-4b98-89c9-f5e7ed6cfad6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:24.504385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0be7fb-8ea2-4b98-89c9-f5e7ed6cfad6 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:24.505810 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 646/1293] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:24.511327 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7096912-d748-4c47-863c-4f02491acf42 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:24.511745 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7096912-d748-4c47-863c-4f02491acf42 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:24.511892 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7096912-d748-4c47-863c-4f02491acf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:24.529164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e7096912-d748-4c47-863c-4f02491acf42 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:24.530362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e7096912-d748-4c47-863c-4f02491acf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:24.560024 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:24.600241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 648/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:22:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:22:24.624511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0be7fb-8ea2-4b98-89c9-f5e7ed6cfad6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:24.663766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:24.734652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0be7fb-8ea2-4b98-89c9-f5e7ed6cfad6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:24.767479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30996805-4a7f-4cc1-ba6b-82d34ec87c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:24.768071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30996805-4a7f-4cc1-ba6b-82d34ec87c6c None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:24.768355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30996805-4a7f-4cc1-ba6b-82d34ec87c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:24.768631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30996805-4a7f-4cc1-ba6b-82d34ec87c6c None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:24.769379 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30996805-4a7f-4cc1-ba6b-82d34ec87c6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:24.770750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30996805-4a7f-4cc1-ba6b-82d34ec87c6c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:24.784049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 647/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Thu May 26 12:22:24 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:22:26.961971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140237-e533-47a3-bc88-ee35ee17f374 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:26.962478 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140237-e533-47a3-bc88-ee35ee17f374 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:26.962573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9140237-e533-47a3-bc88-ee35ee17f374 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:26.963899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 649/1296] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:26.969109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b838f-1f01-4683-a3fb-4e2c175a1ede None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:26.969530 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b838f-1f01-4683-a3fb-4e2c175a1ede None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:26.969665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b838f-1f01-4683-a3fb-4e2c175a1ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:26.986932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-046b838f-1f01-4683-a3fb-4e2c175a1ede None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:26.988109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-046b838f-1f01-4683-a3fb-4e2c175a1ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:27.058837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 648/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:22:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:27.081258 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9140237-e533-47a3-bc88-ee35ee17f374 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:27.182326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9140237-e533-47a3-bc88-ee35ee17f374 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:27.214731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa3ff6-ac88-417b-94b5-a615fc973072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:27.215523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa3ff6-ac88-417b-94b5-a615fc973072 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:27.215806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa3ff6-ac88-417b-94b5-a615fc973072 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:27.216082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa3ff6-ac88-417b-94b5-a615fc973072 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:27.216756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa3ff6-ac88-417b-94b5-a615fc973072 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:27.218123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa3ff6-ac88-417b-94b5-a615fc973072 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-d1fa3ff6-ac88-417b-94b5-a615fc973072 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:27.230879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:27.232077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:27.233287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 650/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Thu May 26 12:22:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:27.241526 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b838f-1f01-4683-a3fb-4e2c175a1ede None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:27.259427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:27.337663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b838f-1f01-4683-a3fb-4e2c175a1ede None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:27.370920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5804d-5385-4b13-8e7d-f5adea588770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:27.371574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5804d-5385-4b13-8e7d-f5adea588770 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:27.371860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5804d-5385-4b13-8e7d-f5adea588770 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:27.372138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5804d-5385-4b13-8e7d-f5adea588770 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:27.372871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5804d-5385-4b13-8e7d-f5adea588770 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:27.373185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5804d-5385-4b13-8e7d-f5adea588770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:27.374551 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5804d-5385-4b13-8e7d-f5adea588770 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:27.379546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 649/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Thu May 26 12:22:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:27.385458 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa3ff6-ac88-417b-94b5-a615fc973072 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:27.417407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:27.495435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa3ff6-ac88-417b-94b5-a615fc973072 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:27.529525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2741a88-4818-4506-9e14-6b679657d8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:27.530183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2741a88-4818-4506-9e14-6b679657d8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:27.530471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2741a88-4818-4506-9e14-6b679657d8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:27.530749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2741a88-4818-4506-9e14-6b679657d8e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:27.531542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2741a88-4818-4506-9e14-6b679657d8e9 None admin] RBAC: Adding query filter params (interface=public, service_id=f2497540213d49759839df4e9b7874a3, region_id=RegionOne) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:27.531857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2741a88-4818-4506-9e14-6b679657d8e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:27.533273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2741a88-4818-4506-9e14-6b679657d8e9 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:27.538960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 651/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Thu May 26 12:22:27 2022] GET /identity/v3/endpoints?service_id=f2497540213d49759839df4e9b7874a3&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:27.544586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5804d-5385-4b13-8e7d-f5adea588770 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:27.634943 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:27.653069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5804d-5385-4b13-8e7d-f5adea588770 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:27.685983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6724d7-9479-4bfe-a60d-276f28ac82a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:27.686667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6724d7-9479-4bfe-a60d-276f28ac82a7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:27.686954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6724d7-9479-4bfe-a60d-276f28ac82a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:27.687233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6724d7-9479-4bfe-a60d-276f28ac82a7 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:27.687916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6724d7-9479-4bfe-a60d-276f28ac82a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:27.689316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6724d7-9479-4bfe-a60d-276f28ac82a7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:27.695964 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 650/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Thu May 26 12:22:27 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:22:29.885150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fca97-20b5-4adf-b9e1-97190b2a3ce5 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:29.885150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fca97-20b5-4adf-b9e1-97190b2a3ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:29.885150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fca97-20b5-4adf-b9e1-97190b2a3ce5 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:29.886514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 652/1302] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:29.891596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b30905-10f7-47f6-816a-76eefd855603 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:29.891983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b30905-10f7-47f6-816a-76eefd855603 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:29.892154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b30905-10f7-47f6-816a-76eefd855603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:29.909099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-36b30905-10f7-47f6-816a-76eefd855603 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:29.910254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-36b30905-10f7-47f6-816a-76eefd855603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:29.975785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 651/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:22:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:22:29.998525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fca97-20b5-4adf-b9e1-97190b2a3ce5 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:30.093587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:30.100791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fca97-20b5-4adf-b9e1-97190b2a3ce5 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:30.134037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b380175-aec2-428b-a57f-06818228c606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:30.134874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b380175-aec2-428b-a57f-06818228c606 None admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:30.135107 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b380175-aec2-428b-a57f-06818228c606 None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:30.135381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b380175-aec2-428b-a57f-06818228c606 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:30.136033 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b380175-aec2-428b-a57f-06818228c606 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:30.137472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b380175-aec2-428b-a57f-06818228c606 None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application [None req-8b380175-aec2-428b-a57f-06818228c606 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:30.149531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:30.150770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application with Lock( May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: ERROR keystone.server.flask.application May 26 12:22:30.151881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 653/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Thu May 26 12:22:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:22:30.156942 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b30905-10f7-47f6-816a-76eefd855603 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:30.232121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:30.254653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b30905-10f7-47f6-816a-76eefd855603 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:30.288875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1da68-82e5-4a80-97c9-bb0a9071d1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:30.289527 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1da68-82e5-4a80-97c9-bb0a9071d1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:30.289811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1da68-82e5-4a80-97c9-bb0a9071d1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:30.290086 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1da68-82e5-4a80-97c9-bb0a9071d1a1 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:30.290790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1da68-82e5-4a80-97c9-bb0a9071d1a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:30.291100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1da68-82e5-4a80-97c9-bb0a9071d1a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:30.292478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1da68-82e5-4a80-97c9-bb0a9071d1a1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:30.297519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 652/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Thu May 26 12:22:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:30.303348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b380175-aec2-428b-a57f-06818228c606 None admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:30.400357 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b380175-aec2-428b-a57f-06818228c606 None admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:30.432570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930a486-3f4a-4456-833b-36d9f66e823d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:30.433230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a486-3f4a-4456-833b-36d9f66e823d None admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:30.433512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a486-3f4a-4456-833b-36d9f66e823d None admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:30.433786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930a486-3f4a-4456-833b-36d9f66e823d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:30.434508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930a486-3f4a-4456-833b-36d9f66e823d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:30.435853 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930a486-3f4a-4456-833b-36d9f66e823d None admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:30.452878 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 654/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Thu May 26 12:22:30 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:22:40.294627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=30 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:40.448741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:34.579617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f842c8b-21bf-40c6-b743-dbbf3938aa26 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:34.580210 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f842c8b-21bf-40c6-b743-dbbf3938aa26 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:34.580210 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f842c8b-21bf-40c6-b743-dbbf3938aa26 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:34.585573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 653/1307] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:23:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:34.586876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50b480-d2e0-4b5e-8eaf-d5f743371f81 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:34.587315 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50b480-d2e0-4b5e-8eaf-d5f743371f81 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:34.587485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50b480-d2e0-4b5e-8eaf-d5f743371f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:34.699131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8d50b480-d2e0-4b5e-8eaf-d5f743371f81 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:34.700313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8d50b480-d2e0-4b5e-8eaf-d5f743371f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:34.838148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 655/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:23:34.892432 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a543c-137b-49e7-870c-91c2f0eddea1 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:34.893202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a543c-137b-49e7-870c-91c2f0eddea1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:34.894979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a543c-137b-49e7-870c-91c2f0eddea1 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:34.897498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 654/1309] 10.222.0.39 () {54 vars in 964 bytes} [Thu May 26 12:23:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:34.905279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1af614-f387-4d48-ba7e-49c6774c9eb6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:34.905717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1af614-f387-4d48-ba7e-49c6774c9eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:34.906004 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1af614-f387-4d48-ba7e-49c6774c9eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:35.008209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5a1af614-f387-4d48-ba7e-49c6774c9eb6 None None] MFA Rules not processed for user `d2ea8fd0ebfd42fdbed9a989d85c8787`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:35.009533 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5a1af614-f387-4d48-ba7e-49c6774c9eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:35.033903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:35.098296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 656/1310] 10.222.0.39 () {58 vars in 1061 bytes} [Thu May 26 12:23:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:23:35.107971 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a543c-137b-49e7-870c-91c2f0eddea1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:35.112072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e43a543c-137b-49e7-870c-91c2f0eddea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:35.252636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a543c-137b-49e7-870c-91c2f0eddea1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:35.329857 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c374c7-3c6b-4b38-ba4b-fdfd15ad607f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:35.330505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c374c7-3c6b-4b38-ba4b-fdfd15ad607f service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:35.330786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c374c7-3c6b-4b38-ba4b-fdfd15ad607f service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:35.331080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c374c7-3c6b-4b38-ba4b-fdfd15ad607f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:35.332740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-41c374c7-3c6b-4b38-ba4b-fdfd15ad607f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:35.389381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:35.448404 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c374c7-3c6b-4b38-ba4b-fdfd15ad607f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:35.449899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c374c7-3c6b-4b38-ba4b-fdfd15ad607f service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:35.470799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 655/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:23:37.983048 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d00228-2bf7-40d1-9a56-470b107e6541 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.984153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d00228-2bf7-40d1-9a56-470b107e6541 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.984398 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d00228-2bf7-40d1-9a56-470b107e6541 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.986563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 657/1312] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:37.991198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83bc78-8ea8-47d1-832d-43dab63466d0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.991675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83bc78-8ea8-47d1-832d-43dab63466d0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.991956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83bc78-8ea8-47d1-832d-43dab63466d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.082370 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6c83bc78-8ea8-47d1-832d-43dab63466d0 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:38.083510 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6c83bc78-8ea8-47d1-832d-43dab63466d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:38.187898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 656/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:23:38.226084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d00228-2bf7-40d1-9a56-470b107e6541 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.227783 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b1d00228-2bf7-40d1-9a56-470b107e6541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:38.339748 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d00228-2bf7-40d1-9a56-470b107e6541 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.416782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:38.419573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768df45f-3994-425d-940b-20b383a9f5f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.420563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768df45f-3994-425d-940b-20b383a9f5f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.421382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768df45f-3994-425d-940b-20b383a9f5f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.422122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768df45f-3994-425d-940b-20b383a9f5f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.424059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-768df45f-3994-425d-940b-20b383a9f5f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:38.540761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768df45f-3994-425d-940b-20b383a9f5f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.542403 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768df45f-3994-425d-940b-20b383a9f5f2 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.562420 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 658/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:23:41.159113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170eb9b-232d-4288-b25b-c4840b49d6df None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.159616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170eb9b-232d-4288-b25b-c4840b49d6df None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.159616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170eb9b-232d-4288-b25b-c4840b49d6df None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.161030 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 657/1315] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:41.166197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a3c2-746f-4ff9-b0de-e57fe2bd1baa None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.166590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a3c2-746f-4ff9-b0de-e57fe2bd1baa None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.166760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a3c2-746f-4ff9-b0de-e57fe2bd1baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.232136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0a30a3c2-746f-4ff9-b0de-e57fe2bd1baa None None] MFA Rules not processed for user `99e8056eecf3447b9595d527690fedf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:41.233686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0a30a3c2-746f-4ff9-b0de-e57fe2bd1baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:41.286254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:41.330954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 659/1316] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:23:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:23:41.385266 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba60f-fc87-48e2-9a7f-d49b97770f04 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.385553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba60f-fc87-48e2-9a7f-d49b97770f04 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.385830 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ba60f-fc87-48e2-9a7f-d49b97770f04 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.387206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 658/1317] 10.222.0.39 () {54 vars in 964 bytes} [Thu May 26 12:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:41.393579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2079-9072-4ca8-b8f0-19df96d4a2f9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.393875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2079-9072-4ca8-b8f0-19df96d4a2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.394158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2079-9072-4ca8-b8f0-19df96d4a2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.467680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5a7c2079-9072-4ca8-b8f0-19df96d4a2f9 None None] MFA Rules not processed for user `d2ea8fd0ebfd42fdbed9a989d85c8787`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:41.468922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5a7c2079-9072-4ca8-b8f0-19df96d4a2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:41.543025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 660/1318] 10.222.0.39 () {58 vars in 1061 bytes} [Thu May 26 12:23:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:23:41.552465 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ba60f-fc87-48e2-9a7f-d49b97770f04 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:41.554113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b67ba60f-fc87-48e2-9a7f-d49b97770f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:41.564462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:41.657555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ba60f-fc87-48e2-9a7f-d49b97770f04 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:41.730636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abba6aa-8e80-4da2-8f0b-88c73c7b8347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:41.731207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abba6aa-8e80-4da2-8f0b-88c73c7b8347 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.731493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abba6aa-8e80-4da2-8f0b-88c73c7b8347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.731768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abba6aa-8e80-4da2-8f0b-88c73c7b8347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.734077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2abba6aa-8e80-4da2-8f0b-88c73c7b8347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:41.794622 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:41.841303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abba6aa-8e80-4da2-8f0b-88c73c7b8347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:41.843108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abba6aa-8e80-4da2-8f0b-88c73c7b8347 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:41.861973 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 659/1319] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:23:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:23:45.001229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e0362-4164-437d-ae18-5decbc277162 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:45.001768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e0362-4164-437d-ae18-5decbc277162 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:45.001768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e0362-4164-437d-ae18-5decbc277162 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:45.003165 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 661/1320] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:45.008361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963149b-26a3-4492-89ec-4e45e4e1c4f6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:45.008814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963149b-26a3-4492-89ec-4e45e4e1c4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:45.009007 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963149b-26a3-4492-89ec-4e45e4e1c4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:45.073203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e963149b-26a3-4492-89ec-4e45e4e1c4f6 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:45.074407 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e963149b-26a3-4492-89ec-4e45e4e1c4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:45.177065 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 660/1321] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:23:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:23:45.214533 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e0362-4164-437d-ae18-5decbc277162 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:45.216060 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-da2e0362-4164-437d-ae18-5decbc277162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:45.266501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:45.319455 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e0362-4164-437d-ae18-5decbc277162 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:45.391691 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf16f27-4bc1-4258-9b28-e1561436bde2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:45.392334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf16f27-4bc1-4258-9b28-e1561436bde2 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:45.392618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf16f27-4bc1-4258-9b28-e1561436bde2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:45.392924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf16f27-4bc1-4258-9b28-e1561436bde2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:45.394572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-adf16f27-4bc1-4258-9b28-e1561436bde2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:45.489223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:45.502489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf16f27-4bc1-4258-9b28-e1561436bde2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:45.503944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf16f27-4bc1-4258-9b28-e1561436bde2 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:45.521805 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 662/1322] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:23:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:23:48.435716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a7d19-14e5-45ee-a93b-17fb19c1ad1a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:48.436337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a7d19-14e5-45ee-a93b-17fb19c1ad1a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:48.436337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a7d19-14e5-45ee-a93b-17fb19c1ad1a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.437730 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 661/1323] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:48.443149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5112b1-e01d-4440-938a-0652b243ad89 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:48.443562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5112b1-e01d-4440-938a-0652b243ad89 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:48.443731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5112b1-e01d-4440-938a-0652b243ad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.509001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7d5112b1-e01d-4440-938a-0652b243ad89 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:48.510209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7d5112b1-e01d-4440-938a-0652b243ad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:48.607631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 663/1324] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:23:48.643469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a7d19-14e5-45ee-a93b-17fb19c1ad1a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:48.645040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f11a7d19-14e5-45ee-a93b-17fb19c1ad1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:48.665979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:48.750533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a7d19-14e5-45ee-a93b-17fb19c1ad1a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:48.829170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79919654-c55a-4cbd-8cd3-b98b4f6cc974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:48.829821 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919654-c55a-4cbd-8cd3-b98b4f6cc974 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:48.830107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919654-c55a-4cbd-8cd3-b98b4f6cc974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:48.830384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919654-c55a-4cbd-8cd3-b98b4f6cc974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:48.832023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-79919654-c55a-4cbd-8cd3-b98b4f6cc974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:48.907877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:48.945980 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79919654-c55a-4cbd-8cd3-b98b4f6cc974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:48.947433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79919654-c55a-4cbd-8cd3-b98b4f6cc974 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:48.967075 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 662/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:23:51.222803 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27ac6-71b2-451b-96e1-9a4021e169c0 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.223371 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27ac6-71b2-451b-96e1-9a4021e169c0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.223708 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c27ac6-71b2-451b-96e1-9a4021e169c0 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.225116 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 664/1326] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:51.230481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14c000-16b4-4bd2-be6a-3fa4f3cda69a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.230892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14c000-16b4-4bd2-be6a-3fa4f3cda69a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.231031 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14c000-16b4-4bd2-be6a-3fa4f3cda69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.297533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-dc14c000-16b4-4bd2-be6a-3fa4f3cda69a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:51.298753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dc14c000-16b4-4bd2-be6a-3fa4f3cda69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:51.400528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 663/1327] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:23:51.435914 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27ac6-71b2-451b-96e1-9a4021e169c0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.437531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d2c27ac6-71b2-451b-96e1-9a4021e169c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:51.498454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.543233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c27ac6-71b2-451b-96e1-9a4021e169c0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:51.617732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8f223-f2c6-4acf-bda8-3f9829d0bce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:51.618386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8f223-f2c6-4acf-bda8-3f9829d0bce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.618672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8f223-f2c6-4acf-bda8-3f9829d0bce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.618947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8f223-f2c6-4acf-bda8-3f9829d0bce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.620590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-91b8f223-f2c6-4acf-bda8-3f9829d0bce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:51.734299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.737062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8f223-f2c6-4acf-bda8-3f9829d0bce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:51.739042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8f223-f2c6-4acf-bda8-3f9829d0bce4 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:51.758492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 665/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:23:54.033912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17b669-c873-41a5-bd8c-c9a375710a65 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:54.037220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17b669-c873-41a5-bd8c-c9a375710a65 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:54.037220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17b669-c873-41a5-bd8c-c9a375710a65 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.037220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 664/1329] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:54.041314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db777e1a-781f-4ce0-a1cc-fba4b8c06362 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:54.041727 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db777e1a-781f-4ce0-a1cc-fba4b8c06362 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:54.041869 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db777e1a-781f-4ce0-a1cc-fba4b8c06362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.108820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-db777e1a-781f-4ce0-a1cc-fba4b8c06362 None None] MFA Rules not processed for user `99e8056eecf3447b9595d527690fedf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:54.110050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-db777e1a-781f-4ce0-a1cc-fba4b8c06362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:54.207212 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 666/1330] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:23:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:23:54.244866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17b669-c873-41a5-bd8c-c9a375710a65 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:54.246393 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6a17b669-c873-41a5-bd8c-c9a375710a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:54.278894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:54.355886 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17b669-c873-41a5-bd8c-c9a375710a65 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:54.430734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d63d9-116b-408a-97b6-129dada43364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:54.431382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d63d9-116b-408a-97b6-129dada43364 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:54.431660 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d63d9-116b-408a-97b6-129dada43364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:54.431934 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d63d9-116b-408a-97b6-129dada43364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.433600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f06d63d9-116b-408a-97b6-129dada43364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:54.509455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:54.542258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d63d9-116b-408a-97b6-129dada43364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:54.543699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d63d9-116b-408a-97b6-129dada43364 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:54.561815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 665/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:23:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:23:57.027858 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1b684-66e1-4dd2-9603-126c4f07caf7 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.028396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1b684-66e1-4dd2-9603-126c4f07caf7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.028498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1b684-66e1-4dd2-9603-126c4f07caf7 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.030418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 667/1332] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:57.035917 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032133e7-d224-4a7e-b333-15cc73d21119 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.036381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032133e7-d224-4a7e-b333-15cc73d21119 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.036475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032133e7-d224-4a7e-b333-15cc73d21119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.105568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-032133e7-d224-4a7e-b333-15cc73d21119 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:57.106761 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-032133e7-d224-4a7e-b333-15cc73d21119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:57.201848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 666/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:23:57.237572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1b684-66e1-4dd2-9603-126c4f07caf7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:57.239161 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-75f1b684-66e1-4dd2-9603-126c4f07caf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:57.309139 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:57.350749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1b684-66e1-4dd2-9603-126c4f07caf7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:57.425272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25051b88-f7ee-4db0-990a-d0eefb2087a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:57.425930 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25051b88-f7ee-4db0-990a-d0eefb2087a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.426215 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25051b88-f7ee-4db0-990a-d0eefb2087a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.426493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25051b88-f7ee-4db0-990a-d0eefb2087a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.428133 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-25051b88-f7ee-4db0-990a-d0eefb2087a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:57.535770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25051b88-f7ee-4db0-990a-d0eefb2087a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:57.537668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25051b88-f7ee-4db0-990a-d0eefb2087a4 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:57.547789 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:57.556066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 668/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:23:59.978741 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb9c1a-cf4f-40f0-a6b4-62ee23040383 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.979289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb9c1a-cf4f-40f0-a6b4-62ee23040383 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.979289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb9c1a-cf4f-40f0-a6b4-62ee23040383 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.980740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 667/1335] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:59.986555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7fb8d-9e35-40de-a390-6489d48f441e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.986966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7fb8d-9e35-40de-a390-6489d48f441e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.987143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7fb8d-9e35-40de-a390-6489d48f441e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.052445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f4f7fb8d-9e35-40de-a390-6489d48f441e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:00.053690 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f4f7fb8d-9e35-40de-a390-6489d48f441e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:00.150809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 669/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:00.191373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb9c1a-cf4f-40f0-a6b4-62ee23040383 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.193372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fbdb9c1a-cf4f-40f0-a6b4-62ee23040383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:00.239909 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:00.302800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb9c1a-cf4f-40f0-a6b4-62ee23040383 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.376234 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05c7b8-7b94-403a-bae1-dab1f666ba09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.376916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05c7b8-7b94-403a-bae1-dab1f666ba09 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.377197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05c7b8-7b94-403a-bae1-dab1f666ba09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.377469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05c7b8-7b94-403a-bae1-dab1f666ba09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.379099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-df05c7b8-7b94-403a-bae1-dab1f666ba09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:00.462101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:00.492269 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05c7b8-7b94-403a-bae1-dab1f666ba09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:00.493770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05c7b8-7b94-403a-bae1-dab1f666ba09 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:00.512849 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 668/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:03.221306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672afaf-38a6-4885-b342-adc784795ce6 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.221874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672afaf-38a6-4885-b342-adc784795ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.221874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672afaf-38a6-4885-b342-adc784795ce6 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.223471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 670/1338] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:03.228871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886c3b5-14ff-4220-80bf-c05197d5b446 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.229301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886c3b5-14ff-4220-80bf-c05197d5b446 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.229430 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886c3b5-14ff-4220-80bf-c05197d5b446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.292613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d886c3b5-14ff-4220-80bf-c05197d5b446 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:03.293832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d886c3b5-14ff-4220-80bf-c05197d5b446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:03.389453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 669/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:03.425107 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672afaf-38a6-4885-b342-adc784795ce6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:03.426649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9672afaf-38a6-4885-b342-adc784795ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:03.502075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:03.530633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672afaf-38a6-4885-b342-adc784795ce6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:03.608379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509ac3b-fb6c-4d89-bf06-392ae024b392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:03.609152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509ac3b-fb6c-4d89-bf06-392ae024b392 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.609437 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509ac3b-fb6c-4d89-bf06-392ae024b392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.609732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509ac3b-fb6c-4d89-bf06-392ae024b392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.611619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1509ac3b-fb6c-4d89-bf06-392ae024b392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:03.720899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509ac3b-fb6c-4d89-bf06-392ae024b392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:03.722359 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509ac3b-fb6c-4d89-bf06-392ae024b392 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:03.741094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 671/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:08.072440 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd991559-472d-457f-b4ec-cbfb9123e117 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.072983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd991559-472d-457f-b4ec-cbfb9123e117 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.072983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd991559-472d-457f-b4ec-cbfb9123e117 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.074321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 670/1341] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:08.080315 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398d31d-75c9-4ea1-bc12-b15abdff28e9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.080809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398d31d-75c9-4ea1-bc12-b15abdff28e9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.081049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398d31d-75c9-4ea1-bc12-b15abdff28e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.087150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:08.154332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7398d31d-75c9-4ea1-bc12-b15abdff28e9 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:08.155657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7398d31d-75c9-4ea1-bc12-b15abdff28e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:08.260103 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 672/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:08.298905 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd991559-472d-457f-b4ec-cbfb9123e117 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:08.301143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fd991559-472d-457f-b4ec-cbfb9123e117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:08.352579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:08.399012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd991559-472d-457f-b4ec-cbfb9123e117 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:08.403246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb91de-e48b-4969-b282-d8908482833a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.404395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb91de-e48b-4969-b282-d8908482833a service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.404684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb91de-e48b-4969-b282-d8908482833a service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.405007 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb91de-e48b-4969-b282-d8908482833a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.414333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb91de-e48b-4969-b282-d8908482833a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:08.415783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb91de-e48b-4969-b282-d8908482833a service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:08.425596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 671/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:11.257312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716913c8-6534-440c-a7ec-0560f7f64a0b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.257829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716913c8-6534-440c-a7ec-0560f7f64a0b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.257829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716913c8-6534-440c-a7ec-0560f7f64a0b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.259163 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 673/1344] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:11.264490 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8b3bb-0ab0-42b1-8aa9-385511112b1a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.265010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8b3bb-0ab0-42b1-8aa9-385511112b1a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.265112 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8b3bb-0ab0-42b1-8aa9-385511112b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.292962 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b2d8b3bb-0ab0-42b1-8aa9-385511112b1a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:11.294363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b2d8b3bb-0ab0-42b1-8aa9-385511112b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:11.370950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 672/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:11.407780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716913c8-6534-440c-a7ec-0560f7f64a0b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:11.418392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716913c8-6534-440c-a7ec-0560f7f64a0b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.422544 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130993f-0bfa-43f0-9b45-cec48ab4efa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:11.423181 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130993f-0bfa-43f0-9b45-cec48ab4efa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.423464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130993f-0bfa-43f0-9b45-cec48ab4efa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.423743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130993f-0bfa-43f0-9b45-cec48ab4efa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.432657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130993f-0bfa-43f0-9b45-cec48ab4efa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:11.434121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130993f-0bfa-43f0-9b45-cec48ab4efa0 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:11.443904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 674/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:15.570101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19042-ed6a-462f-a45d-c2ee805b31f1 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.570581 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19042-ed6a-462f-a45d-c2ee805b31f1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.570676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a19042-ed6a-462f-a45d-c2ee805b31f1 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.572074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 673/1347] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:15.577644 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747baa-4e82-4942-9278-4db463c1bfda None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.578124 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747baa-4e82-4942-9278-4db463c1bfda None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.578276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f747baa-4e82-4942-9278-4db463c1bfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.597842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1f747baa-4e82-4942-9278-4db463c1bfda None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:15.599448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1f747baa-4e82-4942-9278-4db463c1bfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:15.608523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 675/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:15.649089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a19042-ed6a-462f-a45d-c2ee805b31f1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:15.662140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a19042-ed6a-462f-a45d-c2ee805b31f1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:15.665934 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65d7ee-2d25-4c78-a161-80d78abe276e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:15.666591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d7ee-2d25-4c78-a161-80d78abe276e service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.666875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d7ee-2d25-4c78-a161-80d78abe276e service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.667152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d7ee-2d25-4c78-a161-80d78abe276e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.677138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65d7ee-2d25-4c78-a161-80d78abe276e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:15.678584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65d7ee-2d25-4c78-a161-80d78abe276e service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:15.688669 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 674/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:21.149227 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a355697-bb12-41e8-a6cd-634bd8e948c6 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.150096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a355697-bb12-41e8-a6cd-634bd8e948c6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.150540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a355697-bb12-41e8-a6cd-634bd8e948c6 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.152071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 676/1350] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:24:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:21.157873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2220ae6-88a0-4124-857b-2c65f8552fc2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.158740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2220ae6-88a0-4124-857b-2c65f8552fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.159237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2220ae6-88a0-4124-857b-2c65f8552fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.243110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a2220ae6-88a0-4124-857b-2c65f8552fc2 None None] MFA Rules not processed for user `b39eb81eb6a64556a4079115d27f1624`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:21.245197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a2220ae6-88a0-4124-857b-2c65f8552fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:21.275543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.335935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 675/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:25.590992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=72 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.762950 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6990-5784-4fe1-b55c-ab64c05acc56 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.764237 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6990-5784-4fe1-b55c-ab64c05acc56 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.764888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c6990-5784-4fe1-b55c-ab64c05acc56 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.769140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 677/1352] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:24:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:25.773026 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39ab2b-ba8f-4f9c-a136-9af180e2a928 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.773518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39ab2b-ba8f-4f9c-a136-9af180e2a928 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.773790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39ab2b-ba8f-4f9c-a136-9af180e2a928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.794581 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0c39ab2b-ba8f-4f9c-a136-9af180e2a928 None None] MFA Rules not processed for user `b39eb81eb6a64556a4079115d27f1624`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:25.795874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0c39ab2b-ba8f-4f9c-a136-9af180e2a928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:25.804741 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 676/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:27.189322 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b5b52-f96d-4abe-a042-ac464d091417 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.189846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b5b52-f96d-4abe-a042-ac464d091417 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.189846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b5b52-f96d-4abe-a042-ac464d091417 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.191330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 678/1354] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:27.196055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912c5a-3cfc-493e-82ae-8f0aca2448a2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.196484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912c5a-3cfc-493e-82ae-8f0aca2448a2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.196607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912c5a-3cfc-493e-82ae-8f0aca2448a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.215873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-79912c5a-3cfc-493e-82ae-8f0aca2448a2 None None] MFA Rules not processed for user `b39eb81eb6a64556a4079115d27f1624`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:27.217211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-79912c5a-3cfc-493e-82ae-8f0aca2448a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:27.226099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 677/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:24:31.248120 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afbf63-f6a4-4e85-9c33-f860960c6b24 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.248684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afbf63-f6a4-4e85-9c33-f860960c6b24 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.248684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afbf63-f6a4-4e85-9c33-f860960c6b24 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.259500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 679/1356] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:31 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:31.261175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dca06-7a3e-4e63-9543-a265d644acd1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.261175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dca06-7a3e-4e63-9543-a265d644acd1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.262011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dca06-7a3e-4e63-9543-a265d644acd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.283803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-796dca06-7a3e-4e63-9543-a265d644acd1 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:31.285262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-796dca06-7a3e-4e63-9543-a265d644acd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:31.294040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 678/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:31.349415 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb25e14-b819-47c1-87b4-2aa959b87433 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.349962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb25e14-b819-47c1-87b4-2aa959b87433 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.350436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb25e14-b819-47c1-87b4-2aa959b87433 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.352232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 680/1358] 10.222.0.39 () {54 vars in 961 bytes} [Thu May 26 12:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:31.365275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf627d-5315-42be-93cd-c28085f15082 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.366015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf627d-5315-42be-93cd-c28085f15082 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.366461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf627d-5315-42be-93cd-c28085f15082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.418765 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3cbf627d-5315-42be-93cd-c28085f15082 None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:31.419954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3cbf627d-5315-42be-93cd-c28085f15082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:31.526459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 679/1359] 10.222.0.39 () {58 vars in 1058 bytes} [Thu May 26 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:31.535237 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb25e14-b819-47c1-87b4-2aa959b87433 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.552031 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb25e14-b819-47c1-87b4-2aa959b87433 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.562800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc792101-54c2-41ee-9eda-32d7a3d0480f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.563513 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc792101-54c2-41ee-9eda-32d7a3d0480f service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.563803 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc792101-54c2-41ee-9eda-32d7a3d0480f service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.564079 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc792101-54c2-41ee-9eda-32d7a3d0480f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.574222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc792101-54c2-41ee-9eda-32d7a3d0480f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.575871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc792101-54c2-41ee-9eda-32d7a3d0480f service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.588294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 681/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:34.058984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b18e91-b3b8-4b2c-8292-5ff682e15873 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.059501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b18e91-b3b8-4b2c-8292-5ff682e15873 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.059810 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b18e91-b3b8-4b2c-8292-5ff682e15873 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.061535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 680/1361] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:34.066747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901793b-142a-4d16-bc95-6b31e59e6be5 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.067181 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901793b-142a-4d16-bc95-6b31e59e6be5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.067304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901793b-142a-4d16-bc95-6b31e59e6be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.085138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6901793b-142a-4d16-bc95-6b31e59e6be5 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:34.086303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6901793b-142a-4d16-bc95-6b31e59e6be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:34.094857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 682/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:34.140114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b18e91-b3b8-4b2c-8292-5ff682e15873 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.155993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b18e91-b3b8-4b2c-8292-5ff682e15873 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.163676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01d4bd-3f9a-4225-93ef-da6920d1c343 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.164909 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01d4bd-3f9a-4225-93ef-da6920d1c343 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.165434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01d4bd-3f9a-4225-93ef-da6920d1c343 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.165945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01d4bd-3f9a-4225-93ef-da6920d1c343 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.175804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01d4bd-3f9a-4225-93ef-da6920d1c343 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.177912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01d4bd-3f9a-4225-93ef-da6920d1c343 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.191295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 681/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:36.763846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2da2-5168-4831-9b74-8dd937c57179 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.764336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2da2-5168-4831-9b74-8dd937c57179 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.764445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0d2da2-5168-4831-9b74-8dd937c57179 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.765916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 683/1364] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:36.771505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf535-0e10-482a-bf71-2abf752d2626 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.771907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf535-0e10-482a-bf71-2abf752d2626 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.772184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bf535-0e10-482a-bf71-2abf752d2626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.790912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c10bf535-0e10-482a-bf71-2abf752d2626 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:36.792143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c10bf535-0e10-482a-bf71-2abf752d2626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:36.800658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 682/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:36.848581 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bd515-55fc-4308-b849-a3c116363bcf None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.849003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bd515-55fc-4308-b849-a3c116363bcf None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.849362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bd515-55fc-4308-b849-a3c116363bcf None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.851083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 684/1366] 10.222.0.39 () {54 vars in 961 bytes} [Thu May 26 12:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:36.858468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9850e3c-e171-4ae6-bbed-d6cb8af2fc72 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.858756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9850e3c-e171-4ae6-bbed-d6cb8af2fc72 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.859230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9850e3c-e171-4ae6-bbed-d6cb8af2fc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.879307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e9850e3c-e171-4ae6-bbed-d6cb8af2fc72 None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:36.880883 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e9850e3c-e171-4ae6-bbed-d6cb8af2fc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:36.891111 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 683/1367] 10.222.0.39 () {58 vars in 1058 bytes} [Thu May 26 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:36.899137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bd515-55fc-4308-b849-a3c116363bcf None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.921490 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bd515-55fc-4308-b849-a3c116363bcf None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.926899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e84ebd-90b1-419c-bb2f-00698484f8a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.927547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84ebd-90b1-419c-bb2f-00698484f8a6 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.927826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84ebd-90b1-419c-bb2f-00698484f8a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.928101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84ebd-90b1-419c-bb2f-00698484f8a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.936793 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e84ebd-90b1-419c-bb2f-00698484f8a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.938381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e84ebd-90b1-419c-bb2f-00698484f8a6 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.947758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 685/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:39.243394 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b7aed-01a6-4631-ba65-0ce675919374 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.244341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b7aed-01a6-4631-ba65-0ce675919374 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.244629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b7aed-01a6-4631-ba65-0ce675919374 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.246737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 684/1369] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:39.254244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205dab0-bd3a-42ff-99a3-c18585727445 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.254715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205dab0-bd3a-42ff-99a3-c18585727445 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.254810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205dab0-bd3a-42ff-99a3-c18585727445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.274193 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c205dab0-bd3a-42ff-99a3-c18585727445 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:39.275397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c205dab0-bd3a-42ff-99a3-c18585727445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:39.283629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 686/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:39.328285 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b7aed-01a6-4631-ba65-0ce675919374 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.343758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b7aed-01a6-4631-ba65-0ce675919374 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.350131 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c0226-7dd6-4217-bde3-fa1eb71039b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.350916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c0226-7dd6-4217-bde3-fa1eb71039b8 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.351299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c0226-7dd6-4217-bde3-fa1eb71039b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.351678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c0226-7dd6-4217-bde3-fa1eb71039b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.360966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c0226-7dd6-4217-bde3-fa1eb71039b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.362675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c0226-7dd6-4217-bde3-fa1eb71039b8 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.373767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 685/1371] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:39.638555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a83e-4d7a-434b-aa0b-0be4a85fa311 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.638891 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a83e-4d7a-434b-aa0b-0be4a85fa311 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.639082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810a83e-4d7a-434b-aa0b-0be4a85fa311 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.640781 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 687/1372] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:39.646903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2143712-98b2-4f71-bf2f-52339427a910 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.647350 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2143712-98b2-4f71-bf2f-52339427a910 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.647766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2143712-98b2-4f71-bf2f-52339427a910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.668847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c2143712-98b2-4f71-bf2f-52339427a910 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:39.670300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c2143712-98b2-4f71-bf2f-52339427a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:39.678897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 686/1373] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:40.014703 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28feb6-5d23-4368-8056-75f898025841 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.015249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28feb6-5d23-4368-8056-75f898025841 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.015689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28feb6-5d23-4368-8056-75f898025841 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.017250 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 688/1374] 10.222.0.39 () {54 vars in 963 bytes} [Thu May 26 12:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:40.024441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c833c2-bc91-4972-a1a1-2bbfbf39a24e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.024761 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c833c2-bc91-4972-a1a1-2bbfbf39a24e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.025046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c833c2-bc91-4972-a1a1-2bbfbf39a24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.031967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:40.079750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d1c833c2-bc91-4972-a1a1-2bbfbf39a24e None None] MFA Rules not processed for user `64fd1405d96d435faba0c8857009f889`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:40.081103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d1c833c2-bc91-4972-a1a1-2bbfbf39a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:40.147226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 687/1375] 10.222.0.39 () {58 vars in 1060 bytes} [Thu May 26 12:24:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:24:40.157029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28feb6-5d23-4368-8056-75f898025841 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.169098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28feb6-5d23-4368-8056-75f898025841 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.173790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81c98-f679-401c-a66e-98543cdac7ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.174796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81c98-f679-401c-a66e-98543cdac7ca service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.175083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81c98-f679-401c-a66e-98543cdac7ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.175603 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81c98-f679-401c-a66e-98543cdac7ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.190526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81c98-f679-401c-a66e-98543cdac7ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.193604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81c98-f679-401c-a66e-98543cdac7ca service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.205796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 689/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:41.700783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efdaf2-deba-45e5-9805-6b08fbdf7763 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.701345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efdaf2-deba-45e5-9805-6b08fbdf7763 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.701345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efdaf2-deba-45e5-9805-6b08fbdf7763 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.702787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 688/1377] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:41.709067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152722d-e4a2-4f10-88d8-4be49b7eccb3 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.709656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152722d-e4a2-4f10-88d8-4be49b7eccb3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.709656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152722d-e4a2-4f10-88d8-4be49b7eccb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.728680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3152722d-e4a2-4f10-88d8-4be49b7eccb3 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:41.729966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3152722d-e4a2-4f10-88d8-4be49b7eccb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:41.738649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 690/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:41.785092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efdaf2-deba-45e5-9805-6b08fbdf7763 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.800180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efdaf2-deba-45e5-9805-6b08fbdf7763 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.805836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92378a8a-1d3e-448c-8650-ba27835c92e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.806505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378a8a-1d3e-448c-8650-ba27835c92e2 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.806793 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378a8a-1d3e-448c-8650-ba27835c92e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.807069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378a8a-1d3e-448c-8650-ba27835c92e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.817107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92378a8a-1d3e-448c-8650-ba27835c92e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.818664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92378a8a-1d3e-448c-8650-ba27835c92e2 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.829821 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 689/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:44.136167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea04d25-e0a3-40c4-b7fb-5b9b116bb5d7 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.136687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea04d25-e0a3-40c4-b7fb-5b9b116bb5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.136687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea04d25-e0a3-40c4-b7fb-5b9b116bb5d7 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.138669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 691/1380] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:44.144282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38826519-480a-4f67-90ff-ae1c8830b437 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.144767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38826519-480a-4f67-90ff-ae1c8830b437 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.144881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38826519-480a-4f67-90ff-ae1c8830b437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.163851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-38826519-480a-4f67-90ff-ae1c8830b437 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:44.165070 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-38826519-480a-4f67-90ff-ae1c8830b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:44.174457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 690/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:44.218248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea04d25-e0a3-40c4-b7fb-5b9b116bb5d7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.233914 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea04d25-e0a3-40c4-b7fb-5b9b116bb5d7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.241521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f11d34-14d3-4d07-9bd3-e01b228bc89d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.242166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f11d34-14d3-4d07-9bd3-e01b228bc89d service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.242460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f11d34-14d3-4d07-9bd3-e01b228bc89d service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.242737 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f11d34-14d3-4d07-9bd3-e01b228bc89d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.252912 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f11d34-14d3-4d07-9bd3-e01b228bc89d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.254736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f11d34-14d3-4d07-9bd3-e01b228bc89d service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.265192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 692/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:46.551781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369fffe-57d0-442e-8601-1a3cbd6ef848 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.552293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369fffe-57d0-442e-8601-1a3cbd6ef848 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.552379 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369fffe-57d0-442e-8601-1a3cbd6ef848 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.553730 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 691/1383] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:46.559012 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf3607-5842-4959-83c1-18ce5096ba60 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.559958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf3607-5842-4959-83c1-18ce5096ba60 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.560232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf3607-5842-4959-83c1-18ce5096ba60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.578684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-07cf3607-5842-4959-83c1-18ce5096ba60 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:46.579872 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-07cf3607-5842-4959-83c1-18ce5096ba60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:46.587589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 693/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:24:46.636592 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369fffe-57d0-442e-8601-1a3cbd6ef848 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.652691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369fffe-57d0-442e-8601-1a3cbd6ef848 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.660176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2cddc-bcce-4af3-9b7b-3c4242f69300 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.660938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2cddc-bcce-4af3-9b7b-3c4242f69300 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.661251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2cddc-bcce-4af3-9b7b-3c4242f69300 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.661526 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2cddc-bcce-4af3-9b7b-3c4242f69300 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.670964 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2cddc-bcce-4af3-9b7b-3c4242f69300 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.672543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2cddc-bcce-4af3-9b7b-3c4242f69300 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.682521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 692/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:48.972492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4ebb8-7bde-4b5b-8bb1-397c9f7f2e9f None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.973210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4ebb8-7bde-4b5b-8bb1-397c9f7f2e9f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.973210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4ebb8-7bde-4b5b-8bb1-397c9f7f2e9f None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.974456 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 694/1386] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:48.980179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b934f9-06ab-4c89-8ca3-e9061576d8d1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.980658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b934f9-06ab-4c89-8ca3-e9061576d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.980842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b934f9-06ab-4c89-8ca3-e9061576d8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.999595 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-74b934f9-06ab-4c89-8ca3-e9061576d8d1 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:49.000876 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-74b934f9-06ab-4c89-8ca3-e9061576d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:49.008994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 693/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:49.054878 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4ebb8-7bde-4b5b-8bb1-397c9f7f2e9f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.070743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4ebb8-7bde-4b5b-8bb1-397c9f7f2e9f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.078479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda10a4-e77b-4243-9e43-0bc6363697ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.079335 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda10a4-e77b-4243-9e43-0bc6363697ee service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.079714 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda10a4-e77b-4243-9e43-0bc6363697ee service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.080063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda10a4-e77b-4243-9e43-0bc6363697ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.089113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda10a4-e77b-4243-9e43-0bc6363697ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.091225 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda10a4-e77b-4243-9e43-0bc6363697ee service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.101104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 695/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:51.645869 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071f357-7280-478b-8e4c-63014b9a55f7 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.646462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071f357-7280-478b-8e4c-63014b9a55f7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.646800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071f357-7280-478b-8e4c-63014b9a55f7 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.649150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 694/1389] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:51.657233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b7a0-011b-4f1c-a82f-3398fa361c22 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.657652 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b7a0-011b-4f1c-a82f-3398fa361c22 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.657786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5b7a0-011b-4f1c-a82f-3398fa361c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.676806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-34f5b7a0-011b-4f1c-a82f-3398fa361c22 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:51.678063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-34f5b7a0-011b-4f1c-a82f-3398fa361c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:51.686405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 696/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:24:51.733541 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071f357-7280-478b-8e4c-63014b9a55f7 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.754877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071f357-7280-478b-8e4c-63014b9a55f7 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.760468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b31f40-ec6e-452e-a7ac-5acd0135772a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.761169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b31f40-ec6e-452e-a7ac-5acd0135772a service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.761458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b31f40-ec6e-452e-a7ac-5acd0135772a service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.761751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b31f40-ec6e-452e-a7ac-5acd0135772a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.771086 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b31f40-ec6e-452e-a7ac-5acd0135772a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.772786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b31f40-ec6e-452e-a7ac-5acd0135772a service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.783276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 695/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:54.065952 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737974b-b35e-46c2-9ec9-11270f1a213c None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.066539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737974b-b35e-46c2-9ec9-11270f1a213c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.066539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737974b-b35e-46c2-9ec9-11270f1a213c None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.067973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 697/1392] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:54.073544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef3831-99a3-4c84-ae81-7623b1c760a3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.074011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef3831-99a3-4c84-ae81-7623b1c760a3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.074119 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef3831-99a3-4c84-ae81-7623b1c760a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.092442 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-93ef3831-99a3-4c84-ae81-7623b1c760a3 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:54.093663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-93ef3831-99a3-4c84-ae81-7623b1c760a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:54.101961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 696/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:54.145426 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737974b-b35e-46c2-9ec9-11270f1a213c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.160873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737974b-b35e-46c2-9ec9-11270f1a213c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.166394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe61912-3b66-4540-bd67-0f2a05ae3c44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.167044 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61912-3b66-4540-bd67-0f2a05ae3c44 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.167332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61912-3b66-4540-bd67-0f2a05ae3c44 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.167610 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61912-3b66-4540-bd67-0f2a05ae3c44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.176811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe61912-3b66-4540-bd67-0f2a05ae3c44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.178394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe61912-3b66-4540-bd67-0f2a05ae3c44 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.188101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 698/1394] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:56.038975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a39eff-fcf7-4f3f-a479-b6d5322c06d6 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.039530 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a39eff-fcf7-4f3f-a479-b6d5322c06d6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.039530 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a39eff-fcf7-4f3f-a479-b6d5322c06d6 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.040938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 697/1395] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:56.046773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e4271-0c01-413c-a445-819b462e3461 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.047209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e4271-0c01-413c-a445-819b462e3461 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.047327 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e4271-0c01-413c-a445-819b462e3461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.053529 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=52 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:56.067098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-687e4271-0c01-413c-a445-819b462e3461 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:56.068301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-687e4271-0c01-413c-a445-819b462e3461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:56.076217 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 699/1396] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:56.132045 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de22f6b-fee5-4a87-bec9-cd23931ee693 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.132332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de22f6b-fee5-4a87-bec9-cd23931ee693 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.132638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de22f6b-fee5-4a87-bec9-cd23931ee693 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.134239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 698/1397] 10.222.0.39 () {54 vars in 962 bytes} [Thu May 26 12:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:56.139472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afb632-6e94-4b55-8b48-0ce72086290e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.139751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afb632-6e94-4b55-8b48-0ce72086290e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.139990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afb632-6e94-4b55-8b48-0ce72086290e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.189697 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d3afb632-6e94-4b55-8b48-0ce72086290e None None] MFA Rules not processed for user `e854100c04be43c78bce1f95ff85bfc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:56.190893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d3afb632-6e94-4b55-8b48-0ce72086290e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:56.256423 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 700/1398] 10.222.0.39 () {58 vars in 1059 bytes} [Thu May 26 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:56.264809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de22f6b-fee5-4a87-bec9-cd23931ee693 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:56.276575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de22f6b-fee5-4a87-bec9-cd23931ee693 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:56.281556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97acbfd-caab-4640-bf21-7e192d99d7ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e854100c04be43c78bce1f95ff85bfc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:56.282226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acbfd-caab-4640-bf21-7e192d99d7ae service glance] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.282510 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acbfd-caab-4640-bf21-7e192d99d7ae service glance] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.282784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acbfd-caab-4640-bf21-7e192d99d7ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.292820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97acbfd-caab-4640-bf21-7e192d99d7ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:56.294287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97acbfd-caab-4640-bf21-7e192d99d7ae service glance] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:56.306242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 699/1399] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:56.443709 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a835ac-8b40-431d-893c-2a086c53dbcb None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.443981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a835ac-8b40-431d-893c-2a086c53dbcb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.444261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a835ac-8b40-431d-893c-2a086c53dbcb None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.445670 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 701/1400] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:56.451103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0702e-07ed-477f-b9cb-e06187185356 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.451462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0702e-07ed-477f-b9cb-e06187185356 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.452237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0702e-07ed-477f-b9cb-e06187185356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.470146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4fa0702e-07ed-477f-b9cb-e06187185356 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:56.471362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4fa0702e-07ed-477f-b9cb-e06187185356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:56.479771 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 700/1401] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:56.524928 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a835ac-8b40-431d-893c-2a086c53dbcb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:56.541830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a835ac-8b40-431d-893c-2a086c53dbcb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:56.547999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d002c-ff3d-4ab2-870e-2ba47af12f49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:56.548654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d002c-ff3d-4ab2-870e-2ba47af12f49 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.549084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d002c-ff3d-4ab2-870e-2ba47af12f49 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.549371 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d002c-ff3d-4ab2-870e-2ba47af12f49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.558822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d002c-ff3d-4ab2-870e-2ba47af12f49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:56.561318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d002c-ff3d-4ab2-870e-2ba47af12f49 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:56.577352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 702/1402] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:24:56.867693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa6b3-0e71-450c-9418-a92869073c23 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.868059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa6b3-0e71-450c-9418-a92869073c23 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.868412 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa6b3-0e71-450c-9418-a92869073c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.925115 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-738fa6b3-0e71-450c-9418-a92869073c23 None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:56.926354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-738fa6b3-0e71-450c-9418-a92869073c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:56.959646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:56.993531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 701/1403] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:57.040968 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c174865-1be2-42e5-a589-84ae2148ebd5 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.041264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c174865-1be2-42e5-a589-84ae2148ebd5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.041540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c174865-1be2-42e5-a589-84ae2148ebd5 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.043304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 703/1404] 10.222.0.39 () {54 vars in 942 bytes} [Thu May 26 12:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:57.055617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae29ea1-6a91-4869-8e0c-4d9207b55601 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.056133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae29ea1-6a91-4869-8e0c-4d9207b55601 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.056228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae29ea1-6a91-4869-8e0c-4d9207b55601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.119339 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4ae29ea1-6a91-4869-8e0c-4d9207b55601 None None] MFA Rules not processed for user `691c9da310ef42a189bb78183867e46a`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:57.120534 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4ae29ea1-6a91-4869-8e0c-4d9207b55601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:57.194769 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 702/1405] 10.222.0.39 () {58 vars in 1039 bytes} [Thu May 26 12:24:57 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:57.204388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c174865-1be2-42e5-a589-84ae2148ebd5 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:57.218472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c174865-1be2-42e5-a589-84ae2148ebd5 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:57.223440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1efb58-fd16-4bf4-bd34-271398d67b49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:57.224083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1efb58-fd16-4bf4-bd34-271398d67b49 service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.224371 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1efb58-fd16-4bf4-bd34-271398d67b49 service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.224652 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1efb58-fd16-4bf4-bd34-271398d67b49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.233645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1efb58-fd16-4bf4-bd34-271398d67b49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:57.235229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1efb58-fd16-4bf4-bd34-271398d67b49 service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:57.243559 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 704/1406] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:24:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:24:58.842304 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d5918-5739-443c-961d-82f0fa837299 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.843337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d5918-5739-443c-961d-82f0fa837299 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.843804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d5918-5739-443c-961d-82f0fa837299 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.845351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 703/1407] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:58.851124 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55270817-f23c-46b2-ace9-18d869ad5239 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.852317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55270817-f23c-46b2-ace9-18d869ad5239 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.852797 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55270817-f23c-46b2-ace9-18d869ad5239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.871609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-55270817-f23c-46b2-ace9-18d869ad5239 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:58.872895 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-55270817-f23c-46b2-ace9-18d869ad5239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:58.886894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 705/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:24:58.947601 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d5918-5739-443c-961d-82f0fa837299 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.987637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d5918-5739-443c-961d-82f0fa837299 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.009858 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22200048-32ad-41d9-9fd0-23e4f4751df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.020602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22200048-32ad-41d9-9fd0-23e4f4751df8 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.020998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22200048-32ad-41d9-9fd0-23e4f4751df8 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.021226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22200048-32ad-41d9-9fd0-23e4f4751df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.042572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22200048-32ad-41d9-9fd0-23e4f4751df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.044982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22200048-32ad-41d9-9fd0-23e4f4751df8 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.056988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 704/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:08.866448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=55 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.051602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=62 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:20.823516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb5ec-fd29-4bdd-b69d-6a542ece3d69 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.824108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb5ec-fd29-4bdd-b69d-6a542ece3d69 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.824108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb5ec-fd29-4bdd-b69d-6a542ece3d69 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.825398 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 706/1410] 10.222.0.39 () {54 vars in 918 bytes} [Thu May 26 12:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:20.830645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45829556-43e9-4204-878f-aea3afa250f3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.831119 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45829556-43e9-4204-878f-aea3afa250f3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.831233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45829556-43e9-4204-878f-aea3afa250f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.849003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-45829556-43e9-4204-878f-aea3afa250f3 None None] MFA Rules not processed for user `b39eb81eb6a64556a4079115d27f1624`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:20.850182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-45829556-43e9-4204-878f-aea3afa250f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:20.858725 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 705/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Thu May 26 12:25:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:20.873593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27249c8-b83f-442d-8e28-eb05d77de5b3 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.873893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27249c8-b83f-442d-8e28-eb05d77de5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.874178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27249c8-b83f-442d-8e28-eb05d77de5b3 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.875526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 707/1412] 10.222.0.39 () {54 vars in 918 bytes} [Thu May 26 12:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:20.881056 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b9df-b350-4db2-aec4-3f718725e7c5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.881357 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b9df-b350-4db2-aec4-3f718725e7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.881638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b9df-b350-4db2-aec4-3f718725e7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.899620 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f595b9df-b350-4db2-aec4-3f718725e7c5 None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:20.900846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f595b9df-b350-4db2-aec4-3f718725e7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:20.910169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 706/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Thu May 26 12:25:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:25:23.563248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc4187-3da8-4d8e-9631-96bf8a0ca910 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.563787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc4187-3da8-4d8e-9631-96bf8a0ca910 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.563916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc4187-3da8-4d8e-9631-96bf8a0ca910 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.565236 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:23.570875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaf5c3-dcdd-4f70-af44-26e2f875dfdd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.571318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaf5c3-dcdd-4f70-af44-26e2f875dfdd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.571423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaf5c3-dcdd-4f70-af44-26e2f875dfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.590036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-74aaf5c3-dcdd-4f70-af44-26e2f875dfdd None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:23.591229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-74aaf5c3-dcdd-4f70-af44-26e2f875dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:23.599919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:23.643879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc4187-3da8-4d8e-9631-96bf8a0ca910 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.659178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc4187-3da8-4d8e-9631-96bf8a0ca910 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.664625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73db9c-53ce-4f11-91ff-2cfcd7022789 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.665304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73db9c-53ce-4f11-91ff-2cfcd7022789 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.665592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73db9c-53ce-4f11-91ff-2cfcd7022789 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.665872 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73db9c-53ce-4f11-91ff-2cfcd7022789 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.673970 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73db9c-53ce-4f11-91ff-2cfcd7022789 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.675717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73db9c-53ce-4f11-91ff-2cfcd7022789 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.685280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 709/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:24.649613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc882ce9-fbe1-4ef2-bbb1-3dfc7bb67493 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.650190 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc882ce9-fbe1-4ef2-bbb1-3dfc7bb67493 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.650190 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc882ce9-fbe1-4ef2-bbb1-3dfc7bb67493 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.651609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:24.656557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7a959-ae21-4270-ab4a-8d882a1bfa0f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.657013 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7a959-ae21-4270-ab4a-8d882a1bfa0f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.657154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7a959-ae21-4270-ab4a-8d882a1bfa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.675898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c0c7a959-ae21-4270-ab4a-8d882a1bfa0f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:24.677115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c0c7a959-ae21-4270-ab4a-8d882a1bfa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:24.684929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:24.841714 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc882ce9-fbe1-4ef2-bbb1-3dfc7bb67493 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.856238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc882ce9-fbe1-4ef2-bbb1-3dfc7bb67493 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.861956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e68191-c147-409f-853b-2498d11c9d4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.862596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e68191-c147-409f-853b-2498d11c9d4c service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.862881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e68191-c147-409f-853b-2498d11c9d4c service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.863162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e68191-c147-409f-853b-2498d11c9d4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.871232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e68191-c147-409f-853b-2498d11c9d4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.872850 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e68191-c147-409f-853b-2498d11c9d4c service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.883137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 709/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:25.823002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab3a3-9504-438e-9f90-c49622910f9b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.823546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab3a3-9504-438e-9f90-c49622910f9b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.823546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eab3a3-9504-438e-9f90-c49622910f9b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.824935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:25.829821 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5e34-7622-45d7-b204-24bba553ba63 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.830267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5e34-7622-45d7-b204-24bba553ba63 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.830375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5e34-7622-45d7-b204-24bba553ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.848984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-138a5e34-7622-45d7-b204-24bba553ba63 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:25.850226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-138a5e34-7622-45d7-b204-24bba553ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:25.858339 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:26.007815 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eab3a3-9504-438e-9f90-c49622910f9b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:26.022234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eab3a3-9504-438e-9f90-c49622910f9b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:26.027693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941b025-b1ee-48ae-998c-a3fc7ab1e5df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:26.028330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941b025-b1ee-48ae-998c-a3fc7ab1e5df service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.028617 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941b025-b1ee-48ae-998c-a3fc7ab1e5df service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.028927 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941b025-b1ee-48ae-998c-a3fc7ab1e5df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.037341 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941b025-b1ee-48ae-998c-a3fc7ab1e5df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:26.038934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941b025-b1ee-48ae-998c-a3fc7ab1e5df service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:26.048781 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 712/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:26.963408 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e9350-0346-4eae-acf5-412d19fd7918 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.963921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e9350-0346-4eae-acf5-412d19fd7918 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.964017 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e9350-0346-4eae-acf5-412d19fd7918 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.965448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:26.970372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c1a48-f5ef-43b7-be6e-8a10d60e6d92 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.970893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c1a48-f5ef-43b7-be6e-8a10d60e6d92 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.971128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c1a48-f5ef-43b7-be6e-8a10d60e6d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.992607 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b30c1a48-f5ef-43b7-be6e-8a10d60e6d92 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:26.994218 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b30c1a48-f5ef-43b7-be6e-8a10d60e6d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:27.001957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:27.151326 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e9350-0346-4eae-acf5-412d19fd7918 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:27.166267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e9350-0346-4eae-acf5-412d19fd7918 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:27.171889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e23f0-7b4c-499e-aeb1-ebd01cd1b126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:27.172529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e23f0-7b4c-499e-aeb1-ebd01cd1b126 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:27.172843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e23f0-7b4c-499e-aeb1-ebd01cd1b126 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:27.173123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e23f0-7b4c-499e-aeb1-ebd01cd1b126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:27.182057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e23f0-7b4c-499e-aeb1-ebd01cd1b126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:27.183642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e23f0-7b4c-499e-aeb1-ebd01cd1b126 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:27.192971 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 712/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:28.118009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b5cd9-7218-457e-90b8-c7864529567d None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.118546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b5cd9-7218-457e-90b8-c7864529567d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.118546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b5cd9-7218-457e-90b8-c7864529567d None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.119981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:28.125055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80965305-eebf-4c78-8327-eaa3b03121e3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.125428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80965305-eebf-4c78-8327-eaa3b03121e3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.125616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80965305-eebf-4c78-8327-eaa3b03121e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.143578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-80965305-eebf-4c78-8327-eaa3b03121e3 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:28.145227 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-80965305-eebf-4c78-8327-eaa3b03121e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:28.153062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:28.302409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b5cd9-7218-457e-90b8-c7864529567d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.317007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b5cd9-7218-457e-90b8-c7864529567d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:28.322572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc740c24-488d-4600-ab36-3b8b787c06a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:28.323199 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc740c24-488d-4600-ab36-3b8b787c06a6 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.323480 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc740c24-488d-4600-ab36-3b8b787c06a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.323757 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc740c24-488d-4600-ab36-3b8b787c06a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.331635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc740c24-488d-4600-ab36-3b8b787c06a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:28.333569 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc740c24-488d-4600-ab36-3b8b787c06a6 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.342741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 715/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:29.190094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483e0a7-1548-4e29-b477-e187808d7e1d None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.190609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483e0a7-1548-4e29-b477-e187808d7e1d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.190609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483e0a7-1548-4e29-b477-e187808d7e1d None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.192278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:29.197302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec930ce-e5fa-4b5e-b148-cf9b27a91fa2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.197762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec930ce-e5fa-4b5e-b148-cf9b27a91fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.197893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec930ce-e5fa-4b5e-b148-cf9b27a91fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.216200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-dec930ce-e5fa-4b5e-b148-cf9b27a91fa2 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:29.217426 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dec930ce-e5fa-4b5e-b148-cf9b27a91fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:29.226127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:29.373869 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483e0a7-1548-4e29-b477-e187808d7e1d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.388550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483e0a7-1548-4e29-b477-e187808d7e1d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.393963 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d1985-2d2f-415a-914b-f70133bd16ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.395171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d1985-2d2f-415a-914b-f70133bd16ca service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.395456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d1985-2d2f-415a-914b-f70133bd16ca service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.395827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d1985-2d2f-415a-914b-f70133bd16ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.403867 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d1985-2d2f-415a-914b-f70133bd16ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.405489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d1985-2d2f-415a-914b-f70133bd16ca service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.415050 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 715/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:30.268670 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1b946-9403-4d91-a558-2688ff76654d None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.269250 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1b946-9403-4d91-a558-2688ff76654d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.269356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e1b946-9403-4d91-a558-2688ff76654d None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.270865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:30.275787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035d4ba-f6dc-4fc4-988c-e31120a67725 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.276167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035d4ba-f6dc-4fc4-988c-e31120a67725 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.276386 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035d4ba-f6dc-4fc4-988c-e31120a67725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.295030 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3035d4ba-f6dc-4fc4-988c-e31120a67725 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:30.296232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3035d4ba-f6dc-4fc4-988c-e31120a67725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:30.304685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:30.454677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1b946-9403-4d91-a558-2688ff76654d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:30.469234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e1b946-9403-4d91-a558-2688ff76654d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:30.475204 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554314ef-a7ec-441d-9950-60bd0fff1650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:30.475829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554314ef-a7ec-441d-9950-60bd0fff1650 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.476111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554314ef-a7ec-441d-9950-60bd0fff1650 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.476385 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554314ef-a7ec-441d-9950-60bd0fff1650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.484566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554314ef-a7ec-441d-9950-60bd0fff1650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:30.486170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554314ef-a7ec-441d-9950-60bd0fff1650 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.495542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 718/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:31.341927 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad77a0-2911-4496-8b93-ec59e24cd075 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.342472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad77a0-2911-4496-8b93-ec59e24cd075 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.342472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad77a0-2911-4496-8b93-ec59e24cd075 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.343844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:31.349632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdced4-cbfe-4620-944c-34fbe1383ac9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.350097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdced4-cbfe-4620-944c-34fbe1383ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.350197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fdced4-cbfe-4620-944c-34fbe1383ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.368538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-20fdced4-cbfe-4620-944c-34fbe1383ac9 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:31.369782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-20fdced4-cbfe-4620-944c-34fbe1383ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:31.377445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:31.527253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad77a0-2911-4496-8b93-ec59e24cd075 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.544020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad77a0-2911-4496-8b93-ec59e24cd075 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.550252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5237c-c5c3-406b-bf5e-48a3cbac570b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.550974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5237c-c5c3-406b-bf5e-48a3cbac570b service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.551788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5237c-c5c3-406b-bf5e-48a3cbac570b service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.551889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5237c-c5c3-406b-bf5e-48a3cbac570b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.560675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5237c-c5c3-406b-bf5e-48a3cbac570b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.562309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5237c-c5c3-406b-bf5e-48a3cbac570b service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.572971 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 718/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:32.425645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e732-97fd-4e76-b184-c60d5930a8a9 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.426820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e732-97fd-4e76-b184-c60d5930a8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.426820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e732-97fd-4e76-b184-c60d5930a8a9 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.428158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:32.433160 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d71a4-b457-4490-b2d0-bc3401209d5a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.433546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d71a4-b457-4490-b2d0-bc3401209d5a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.433722 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d71a4-b457-4490-b2d0-bc3401209d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.451368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-478d71a4-b457-4490-b2d0-bc3401209d5a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:32.452562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-478d71a4-b457-4490-b2d0-bc3401209d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:32.460383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:32.614786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e732-97fd-4e76-b184-c60d5930a8a9 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:32.628782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e732-97fd-4e76-b184-c60d5930a8a9 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.634180 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26515d1-cd26-4414-992b-d0d815924f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.634816 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26515d1-cd26-4414-992b-d0d815924f81 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.635101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26515d1-cd26-4414-992b-d0d815924f81 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.635381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26515d1-cd26-4414-992b-d0d815924f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.643541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26515d1-cd26-4414-992b-d0d815924f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.645723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26515d1-cd26-4414-992b-d0d815924f81 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.654958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 721/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:34.743708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4483-11d5-4324-8c3f-03dcbdd004a6 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.744272 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4483-11d5-4324-8c3f-03dcbdd004a6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.744272 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4483-11d5-4324-8c3f-03dcbdd004a6 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.745671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:34.751224 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5021b6b-5260-46b1-b6c8-8a0924e3f041 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.751630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5021b6b-5260-46b1-b6c8-8a0924e3f041 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.751771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5021b6b-5260-46b1-b6c8-8a0924e3f041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.770102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b5021b6b-5260-46b1-b6c8-8a0924e3f041 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:34.772186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b5021b6b-5260-46b1-b6c8-8a0924e3f041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:34.780095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:34.822721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4483-11d5-4324-8c3f-03dcbdd004a6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.834095 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4483-11d5-4324-8c3f-03dcbdd004a6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.837663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2306fa2-3e0f-4e40-b20a-c3a3628056fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.838298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2306fa2-3e0f-4e40-b20a-c3a3628056fd service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.838585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2306fa2-3e0f-4e40-b20a-c3a3628056fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.838867 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2306fa2-3e0f-4e40-b20a-c3a3628056fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.848398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2306fa2-3e0f-4e40-b20a-c3a3628056fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.849883 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2306fa2-3e0f-4e40-b20a-c3a3628056fd service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.859478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 721/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:37.291644 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68085df7-84e9-4e8a-a94c-d364c13a1c78 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.292206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68085df7-84e9-4e8a-a94c-d364c13a1c78 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.292206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68085df7-84e9-4e8a-a94c-d364c13a1c78 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.293600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:37.298800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d89ec-bf36-4a69-a16a-f9051229acad None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.299228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d89ec-bf36-4a69-a16a-f9051229acad None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.299376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d89ec-bf36-4a69-a16a-f9051229acad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.318053 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4d1d89ec-bf36-4a69-a16a-f9051229acad None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:37.319397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4d1d89ec-bf36-4a69-a16a-f9051229acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:37.327127 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:37.364873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68085df7-84e9-4e8a-a94c-d364c13a1c78 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.375437 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68085df7-84e9-4e8a-a94c-d364c13a1c78 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.378981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb8d12-6f7c-4f45-865f-f4771afe5b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.379614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb8d12-6f7c-4f45-865f-f4771afe5b7c service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.380479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb8d12-6f7c-4f45-865f-f4771afe5b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.380796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb8d12-6f7c-4f45-865f-f4771afe5b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.393591 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb8d12-6f7c-4f45-865f-f4771afe5b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.395032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb8d12-6f7c-4f45-865f-f4771afe5b7c service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.404563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 724/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:39.911033 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547386a-3521-489a-bc4b-e71d4e4cf74d None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:39.912044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547386a-3521-489a-bc4b-e71d4e4cf74d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:39.912225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547386a-3521-489a-bc4b-e71d4e4cf74d None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:39.913657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:39.919131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004240a-526b-4da1-9de8-a8956a3887c4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:39.919565 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004240a-526b-4da1-9de8-a8956a3887c4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:39.919718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004240a-526b-4da1-9de8-a8956a3887c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:39.937776 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a004240a-526b-4da1-9de8-a8956a3887c4 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:39.939097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a004240a-526b-4da1-9de8-a8956a3887c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:39.948769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:39.987256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547386a-3521-489a-bc4b-e71d4e4cf74d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:39.988956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3547386a-3521-489a-bc4b-e71d4e4cf74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:40.002314 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547386a-3521-489a-bc4b-e71d4e4cf74d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.006075 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad229e7-c2d9-409a-89e0-bfb5af5dc959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.006696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad229e7-c2d9-409a-89e0-bfb5af5dc959 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.006974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad229e7-c2d9-409a-89e0-bfb5af5dc959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.007246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad229e7-c2d9-409a-89e0-bfb5af5dc959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.016017 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad229e7-c2d9-409a-89e0-bfb5af5dc959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.017469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad229e7-c2d9-409a-89e0-bfb5af5dc959 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.026583 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 724/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:42.379499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200c1d6-5e01-48fe-90a6-a795247fb072 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.380105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200c1d6-5e01-48fe-90a6-a795247fb072 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.380105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200c1d6-5e01-48fe-90a6-a795247fb072 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.381506 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:42.386931 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d7aa-ee16-406b-8674-d6ac4d69dd40 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.387356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d7aa-ee16-406b-8674-d6ac4d69dd40 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.387523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d7aa-ee16-406b-8674-d6ac4d69dd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.405896 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7ad7d7aa-ee16-406b-8674-d6ac4d69dd40 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:42.407060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7ad7d7aa-ee16-406b-8674-d6ac4d69dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:42.415453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:42.452209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200c1d6-5e01-48fe-90a6-a795247fb072 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:42.463535 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200c1d6-5e01-48fe-90a6-a795247fb072 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:42.467046 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee4939-cb87-4056-9a9f-74fed17c7c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:42.467678 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee4939-cb87-4056-9a9f-74fed17c7c53 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.467964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee4939-cb87-4056-9a9f-74fed17c7c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.468243 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee4939-cb87-4056-9a9f-74fed17c7c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.477785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee4939-cb87-4056-9a9f-74fed17c7c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:42.479244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee4939-cb87-4056-9a9f-74fed17c7c53 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:42.489043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 727/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:44.778358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de23593-7d9b-49c8-9b35-6a4333290607 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.778922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de23593-7d9b-49c8-9b35-6a4333290607 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.778922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de23593-7d9b-49c8-9b35-6a4333290607 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.780274 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:44.785477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dd680-54be-4291-9ce1-8077d966da2a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.785893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dd680-54be-4291-9ce1-8077d966da2a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.786089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dd680-54be-4291-9ce1-8077d966da2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.804622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-da9dd680-54be-4291-9ce1-8077d966da2a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:44.805849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-da9dd680-54be-4291-9ce1-8077d966da2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:44.813594 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:44.851913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de23593-7d9b-49c8-9b35-6a4333290607 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.862820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de23593-7d9b-49c8-9b35-6a4333290607 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:44.866543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4784d73-a282-4339-8608-43d932f2926b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:44.867173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4784d73-a282-4339-8608-43d932f2926b service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.867457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4784d73-a282-4339-8608-43d932f2926b service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.867736 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4784d73-a282-4339-8608-43d932f2926b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.876585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4784d73-a282-4339-8608-43d932f2926b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:44.878054 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4784d73-a282-4339-8608-43d932f2926b service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:44.887933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 727/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:47.165427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214bfc-9405-4029-8903-184dd7e30ea0 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.165955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214bfc-9405-4029-8903-184dd7e30ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.165955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214bfc-9405-4029-8903-184dd7e30ea0 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.167335 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:47.172463 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa4bc3-9369-465c-9d69-4f9b382a0ee7 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.172894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa4bc3-9369-465c-9d69-4f9b382a0ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.173042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa4bc3-9369-465c-9d69-4f9b382a0ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.192436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-59fa4bc3-9369-465c-9d69-4f9b382a0ee7 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:47.194481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-59fa4bc3-9369-465c-9d69-4f9b382a0ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:47.202179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:47.239833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec214bfc-9405-4029-8903-184dd7e30ea0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:47.251549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec214bfc-9405-4029-8903-184dd7e30ea0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:47.255421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12c466-c491-4ce7-b182-ad2b7ca9cb22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:47.256201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12c466-c491-4ce7-b182-ad2b7ca9cb22 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.256585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12c466-c491-4ce7-b182-ad2b7ca9cb22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.256896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12c466-c491-4ce7-b182-ad2b7ca9cb22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.265904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12c466-c491-4ce7-b182-ad2b7ca9cb22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:47.267377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12c466-c491-4ce7-b182-ad2b7ca9cb22 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:47.276987 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 730/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:49.574436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8af84-58da-42ed-b5b2-dc34a62651b1 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.575000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8af84-58da-42ed-b5b2-dc34a62651b1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.575000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8af84-58da-42ed-b5b2-dc34a62651b1 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.576362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:49.581909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e83f5-d463-42b5-be68-852566a67728 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.582309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e83f5-d463-42b5-be68-852566a67728 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.582468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e83f5-d463-42b5-be68-852566a67728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.589304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=70 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:49.601742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-418e83f5-d463-42b5-be68-852566a67728 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:49.602935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-418e83f5-d463-42b5-be68-852566a67728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:49.610936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:49.648311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8af84-58da-42ed-b5b2-dc34a62651b1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:49.653720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=73 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:49.659991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8af84-58da-42ed-b5b2-dc34a62651b1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:49.664461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e280359-2715-4720-a8d6-50e728d063ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:49.666405 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e280359-2715-4720-a8d6-50e728d063ed service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.666405 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e280359-2715-4720-a8d6-50e728d063ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.666405 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e280359-2715-4720-a8d6-50e728d063ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.678140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e280359-2715-4720-a8d6-50e728d063ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:49.679613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e280359-2715-4720-a8d6-50e728d063ed service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:49.689891 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 730/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:51.954508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf7b1-31f6-48ff-9de7-54581195228a None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.955098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf7b1-31f6-48ff-9de7-54581195228a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.955098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf7b1-31f6-48ff-9de7-54581195228a None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.956442 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:51.962613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bd058-7cbd-4abb-9ce3-25fdb53dab42 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.963002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bd058-7cbd-4abb-9ce3-25fdb53dab42 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.963168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bd058-7cbd-4abb-9ce3-25fdb53dab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.980816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-bb2bd058-7cbd-4abb-9ce3-25fdb53dab42 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:51.982023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bb2bd058-7cbd-4abb-9ce3-25fdb53dab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:51.990043 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:52.027347 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf7b1-31f6-48ff-9de7-54581195228a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:52.038076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf7b1-31f6-48ff-9de7-54581195228a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:52.041707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c6079-68a2-494d-a687-d6a79a28b295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:52.042340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c6079-68a2-494d-a687-d6a79a28b295 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.042627 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c6079-68a2-494d-a687-d6a79a28b295 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.042906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c6079-68a2-494d-a687-d6a79a28b295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.051850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c6079-68a2-494d-a687-d6a79a28b295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:52.053335 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c6079-68a2-494d-a687-d6a79a28b295 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:52.062683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 733/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:54.284650 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47e833-c7ee-4fa6-9efa-d08a5383d082 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.285243 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47e833-c7ee-4fa6-9efa-d08a5383d082 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.285243 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47e833-c7ee-4fa6-9efa-d08a5383d082 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.286638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:54.292738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c683de-1fd4-407b-acc8-a3632c25f74c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.293173 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c683de-1fd4-407b-acc8-a3632c25f74c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.293346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c683de-1fd4-407b-acc8-a3632c25f74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.311640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-24c683de-1fd4-407b-acc8-a3632c25f74c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:54.312862 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-24c683de-1fd4-407b-acc8-a3632c25f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:54.320563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:54.356523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47e833-c7ee-4fa6-9efa-d08a5383d082 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:54.368160 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47e833-c7ee-4fa6-9efa-d08a5383d082 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:54.371667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb135802-9ea3-4bdc-a34e-314691406ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:54.372305 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb135802-9ea3-4bdc-a34e-314691406ecb service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.372589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb135802-9ea3-4bdc-a34e-314691406ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.372908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb135802-9ea3-4bdc-a34e-314691406ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.381729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb135802-9ea3-4bdc-a34e-314691406ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:54.383163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb135802-9ea3-4bdc-a34e-314691406ecb service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:54.392330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 733/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:25:56.653274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2b5e0-1ea1-4632-adbd-5d16e17f60cd None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.653828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2b5e0-1ea1-4632-adbd-5d16e17f60cd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.653828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2b5e0-1ea1-4632-adbd-5d16e17f60cd None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.655239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:56.660746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357d9c0-732b-4546-894d-70f845bf9714 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.661168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357d9c0-732b-4546-894d-70f845bf9714 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.661321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357d9c0-732b-4546-894d-70f845bf9714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.680298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0357d9c0-732b-4546-894d-70f845bf9714 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:56.681553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0357d9c0-732b-4546-894d-70f845bf9714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:56.689348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:25:56.725273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2b5e0-1ea1-4632-adbd-5d16e17f60cd None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:56.736558 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2b5e0-1ea1-4632-adbd-5d16e17f60cd None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:56.740035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8736af-8e64-48f0-acea-e048173df371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:56.740659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8736af-8e64-48f0-acea-e048173df371 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.740972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8736af-8e64-48f0-acea-e048173df371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.741246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8736af-8e64-48f0-acea-e048173df371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.750848 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8736af-8e64-48f0-acea-e048173df371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:56.752259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8736af-8e64-48f0-acea-e048173df371 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:56.762353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 736/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:06.673901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=17 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:06.757318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=17 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:29.969737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bd618-3cc3-4cfb-a5f4-a1c966cbf77c None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:29.970310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bd618-3cc3-4cfb-a5f4-a1c966cbf77c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:29.970310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bd618-3cc3-4cfb-a5f4-a1c966cbf77c None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:29.971682 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 735/1471] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:29.976870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a367c8-949a-4498-b750-7c4e1a7a689e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:29.977314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a367c8-949a-4498-b750-7c4e1a7a689e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:29.977424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a367c8-949a-4498-b750-7c4e1a7a689e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:29.996213 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-76a367c8-949a-4498-b750-7c4e1a7a689e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:29.998067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-76a367c8-949a-4498-b750-7c4e1a7a689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:30.008434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 737/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:30.056196 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a00b6b-41a4-4e00-91c2-ca0e7845861a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.056483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a00b6b-41a4-4e00-91c2-ca0e7845861a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.056792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a00b6b-41a4-4e00-91c2-ca0e7845861a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.058759 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 736/1473] 10.222.0.39 () {54 vars in 962 bytes} [Thu May 26 12:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:30.063557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdcabd-f77a-4d24-9d0e-19398343caa5 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.063851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdcabd-f77a-4d24-9d0e-19398343caa5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.064135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdcabd-f77a-4d24-9d0e-19398343caa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.081989 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-18fdcabd-f77a-4d24-9d0e-19398343caa5 None None] MFA Rules not processed for user `e854100c04be43c78bce1f95ff85bfc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:30.083178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-18fdcabd-f77a-4d24-9d0e-19398343caa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:30.089751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 738/1474] 10.222.0.39 () {58 vars in 1059 bytes} [Thu May 26 12:26:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:30.096950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a00b6b-41a4-4e00-91c2-ca0e7845861a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:30.107947 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a00b6b-41a4-4e00-91c2-ca0e7845861a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:30.111544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab050027-4d91-40fb-8526-7fec40e55347 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e854100c04be43c78bce1f95ff85bfc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:30.112170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab050027-4d91-40fb-8526-7fec40e55347 service glance] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.112454 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab050027-4d91-40fb-8526-7fec40e55347 service glance] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.112762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab050027-4d91-40fb-8526-7fec40e55347 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.122623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab050027-4d91-40fb-8526-7fec40e55347 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:30.124051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab050027-4d91-40fb-8526-7fec40e55347 service glance] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:30.133279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 737/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:26:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:32.447322 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af5aa-68c3-4942-9bb1-a22b15558cec None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.447864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af5aa-68c3-4942-9bb1-a22b15558cec None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.447864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af5aa-68c3-4942-9bb1-a22b15558cec None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.450185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 739/1476] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:32.455355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e734d5-0ff9-446b-824a-086a661381fb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.455835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e734d5-0ff9-446b-824a-086a661381fb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.455941 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e734d5-0ff9-446b-824a-086a661381fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.474274 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-92e734d5-0ff9-446b-824a-086a661381fb None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:32.475456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-92e734d5-0ff9-446b-824a-086a661381fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:32.483593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 738/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:32.506781 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535af5aa-68c3-4942-9bb1-a22b15558cec None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:32.519539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535af5aa-68c3-4942-9bb1-a22b15558cec None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:32.523963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d72a24-f33d-4ac5-943a-6f8d390ea408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:32.524600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d72a24-f33d-4ac5-943a-6f8d390ea408 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.524917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d72a24-f33d-4ac5-943a-6f8d390ea408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.525197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d72a24-f33d-4ac5-943a-6f8d390ea408 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.525936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d72a24-f33d-4ac5-943a-6f8d390ea408 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:32.528279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: WARNING py.warnings [None req-c6d72a24-f33d-4ac5-943a-6f8d390ea408 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:26:32.528279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: warnings.warn(msg) May 26 12:26:32.528279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: May 26 12:26:32.529429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d72a24-f33d-4ac5-943a-6f8d390ea408 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:32.548331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 740/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Thu May 26 12:26:32 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:26:34.779699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42272466-b7a3-4fdc-8cb9-7b4c71c91d94 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:34.780289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42272466-b7a3-4fdc-8cb9-7b4c71c91d94 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:34.780289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42272466-b7a3-4fdc-8cb9-7b4c71c91d94 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:34.781731 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 739/1479] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:34.786941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644cac0-cae4-44c5-8590-8330f20ef6bf None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:34.787344 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644cac0-cae4-44c5-8590-8330f20ef6bf None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:34.787516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644cac0-cae4-44c5-8590-8330f20ef6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:34.805991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e644cac0-cae4-44c5-8590-8330f20ef6bf None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:34.807213 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e644cac0-cae4-44c5-8590-8330f20ef6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:34.815889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 741/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:34.859838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42272466-b7a3-4fdc-8cb9-7b4c71c91d94 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:34.874788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42272466-b7a3-4fdc-8cb9-7b4c71c91d94 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:34.880208 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a6c6f-5d88-41f2-aacf-fef21f011b03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:34.880884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a6c6f-5d88-41f2-aacf-fef21f011b03 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:34.881161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a6c6f-5d88-41f2-aacf-fef21f011b03 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:34.881441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a6c6f-5d88-41f2-aacf-fef21f011b03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:34.889960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a6c6f-5d88-41f2-aacf-fef21f011b03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:34.891545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a6c6f-5d88-41f2-aacf-fef21f011b03 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:34.900926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 740/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:37.297661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29d2c7-2199-4002-8e6f-6b2a89276785 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:37.298226 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29d2c7-2199-4002-8e6f-6b2a89276785 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:37.298226 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29d2c7-2199-4002-8e6f-6b2a89276785 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:37.299621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 742/1482] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:37.304884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbdcb-911e-4da3-b79e-4fce0ba1218e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:37.305328 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbdcb-911e-4da3-b79e-4fce0ba1218e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:37.305429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbdcb-911e-4da3-b79e-4fce0ba1218e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:37.326326 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2d6bbdcb-911e-4da3-b79e-4fce0ba1218e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:37.327536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2d6bbdcb-911e-4da3-b79e-4fce0ba1218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:37.337768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 741/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:37.373184 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29d2c7-2199-4002-8e6f-6b2a89276785 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:37.384070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29d2c7-2199-4002-8e6f-6b2a89276785 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:37.388446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e98b5-db5e-436e-a6e3-6832b5d2f738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:37.389114 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e98b5-db5e-436e-a6e3-6832b5d2f738 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:37.389399 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e98b5-db5e-436e-a6e3-6832b5d2f738 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:37.389674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e98b5-db5e-436e-a6e3-6832b5d2f738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:37.398558 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e98b5-db5e-436e-a6e3-6832b5d2f738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:37.399979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e98b5-db5e-436e-a6e3-6832b5d2f738 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:37.409441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 743/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:39.670265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce58ee-e37d-4bc4-8016-add2e482dff2 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:39.670833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce58ee-e37d-4bc4-8016-add2e482dff2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:39.670833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce58ee-e37d-4bc4-8016-add2e482dff2 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:39.672264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 742/1485] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:39.677430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb1258-6b1c-4692-9720-b14491698363 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:39.677831 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb1258-6b1c-4692-9720-b14491698363 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:39.677998 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb1258-6b1c-4692-9720-b14491698363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:39.696533 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6fbb1258-6b1c-4692-9720-b14491698363 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:39.697852 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6fbb1258-6b1c-4692-9720-b14491698363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:39.706285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 744/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:39.744115 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce58ee-e37d-4bc4-8016-add2e482dff2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:39.754951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce58ee-e37d-4bc4-8016-add2e482dff2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:39.758509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f77a1b-e1d1-466b-a56b-fdf42315ff94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:39.759166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f77a1b-e1d1-466b-a56b-fdf42315ff94 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:39.759451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f77a1b-e1d1-466b-a56b-fdf42315ff94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:39.759728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f77a1b-e1d1-466b-a56b-fdf42315ff94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:39.769391 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f77a1b-e1d1-466b-a56b-fdf42315ff94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:39.770830 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f77a1b-e1d1-466b-a56b-fdf42315ff94 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:39.782845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 743/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:42.105084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245668a-667d-4bd1-b28d-b14e6090a63b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:42.106251 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245668a-667d-4bd1-b28d-b14e6090a63b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:42.106499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245668a-667d-4bd1-b28d-b14e6090a63b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:42.107918 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 745/1488] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:42.113240 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf5feb-a627-46bb-9ff2-bb770b5f49d8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:42.113681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf5feb-a627-46bb-9ff2-bb770b5f49d8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:42.113807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf5feb-a627-46bb-9ff2-bb770b5f49d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:42.132593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5ecf5feb-a627-46bb-9ff2-bb770b5f49d8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:42.133856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5ecf5feb-a627-46bb-9ff2-bb770b5f49d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:42.141820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 744/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:26:42.182122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245668a-667d-4bd1-b28d-b14e6090a63b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:42.193696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245668a-667d-4bd1-b28d-b14e6090a63b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:42.197154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098f2d2-4e88-428c-8070-53e1b2a20efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:42.197782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f2d2-4e88-428c-8070-53e1b2a20efe service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:42.198063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f2d2-4e88-428c-8070-53e1b2a20efe service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:42.198341 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f2d2-4e88-428c-8070-53e1b2a20efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:42.207169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098f2d2-4e88-428c-8070-53e1b2a20efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:42.208585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098f2d2-4e88-428c-8070-53e1b2a20efe service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:42.218064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 746/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:44.626856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80d195-7809-4e43-b39c-50ae0f776abd None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:44.627415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80d195-7809-4e43-b39c-50ae0f776abd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:44.627415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80d195-7809-4e43-b39c-50ae0f776abd None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:44.628818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 745/1491] 10.222.0.39 () {54 vars in 926 bytes} [Thu May 26 12:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:44.634080 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0344f-e92c-48e9-ae71-d19bea4597cc None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:44.634505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0344f-e92c-48e9-ae71-d19bea4597cc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:44.634639 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0344f-e92c-48e9-ae71-d19bea4597cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:44.653121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-08c0344f-e92c-48e9-ae71-d19bea4597cc None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:44.654449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-08c0344f-e92c-48e9-ae71-d19bea4597cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:44.662365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 747/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Thu May 26 12:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:26:44.700840 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80d195-7809-4e43-b39c-50ae0f776abd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:44.711452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80d195-7809-4e43-b39c-50ae0f776abd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:44.715596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2bb75-7762-405a-8fde-f59bd27fcf08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:44.716401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2bb75-7762-405a-8fde-f59bd27fcf08 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:44.716684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2bb75-7762-405a-8fde-f59bd27fcf08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:44.716999 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2bb75-7762-405a-8fde-f59bd27fcf08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:44.726038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2bb75-7762-405a-8fde-f59bd27fcf08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:44.727462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2bb75-7762-405a-8fde-f59bd27fcf08 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:44.737340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 746/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:26:54.647362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=33 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:54.733275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=33 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:31.654430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9793089-f897-4038-b07c-86b27e816878 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:31.655023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9793089-f897-4038-b07c-86b27e816878 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:31.655023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9793089-f897-4038-b07c-86b27e816878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:31.674145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b9793089-f897-4038-b07c-86b27e816878 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:31.675436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b9793089-f897-4038-b07c-86b27e816878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:31.683499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 748/1494] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:31.693398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6d337-12ce-4c0f-9d8a-8b7cbe2fc1ea None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:31.693921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6d337-12ce-4c0f-9d8a-8b7cbe2fc1ea None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:31.694029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6d337-12ce-4c0f-9d8a-8b7cbe2fc1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:31.711653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-33b6d337-12ce-4c0f-9d8a-8b7cbe2fc1ea None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:31.712889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-33b6d337-12ce-4c0f-9d8a-8b7cbe2fc1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:31.720857 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 747/1495] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:31.725054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9793089-f897-4038-b07c-86b27e816878 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:31.734532 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9793089-f897-4038-b07c-86b27e816878 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:31.739707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab59c8-abd0-40c7-a3ca-4e3f9ae2d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:31.740352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab59c8-abd0-40c7-a3ca-4e3f9ae2d7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:31.740633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab59c8-abd0-40c7-a3ca-4e3f9ae2d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:31.740936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab59c8-abd0-40c7-a3ca-4e3f9ae2d7d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:31.741653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab59c8-abd0-40c7-a3ca-4e3f9ae2d7d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:31.741958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab59c8-abd0-40c7-a3ca-4e3f9ae2d7d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:31.742964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: WARNING py.warnings [None req-bfab59c8-abd0-40c7-a3ca-4e3f9ae2d7d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:28:31.742964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: warnings.warn(msg) May 26 12:28:31.742964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: May 26 12:28:31.743842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab59c8-abd0-40c7-a3ca-4e3f9ae2d7d7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:31.756376 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 749/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:28:31.764084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6d337-12ce-4c0f-9d8a-8b7cbe2fc1ea None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:31.773122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6d337-12ce-4c0f-9d8a-8b7cbe2fc1ea None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:31.777687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bb822-1cb6-46c9-94b9-427954166d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:31.778327 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bb822-1cb6-46c9-94b9-427954166d1b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:31.778611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bb822-1cb6-46c9-94b9-427954166d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:31.778883 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bb822-1cb6-46c9-94b9-427954166d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:31.779580 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bb822-1cb6-46c9-94b9-427954166d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:31.781403 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: WARNING py.warnings [None req-d56bb822-1cb6-46c9-94b9-427954166d1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:28:31.781403 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: warnings.warn(msg) May 26 12:28:31.781403 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: May 26 12:28:31.782597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bb822-1cb6-46c9-94b9-427954166d1b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:31.819616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 748/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:28:31 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:28:31.824048 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab59c8-abd0-40c7-a3ca-4e3f9ae2d7d7 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:31.834317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab59c8-abd0-40c7-a3ca-4e3f9ae2d7d7 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:31.895388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0693b73-1f1c-433f-baf6-f6ebabee6d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:31.896072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0693b73-1f1c-433f-baf6-f6ebabee6d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:31.896365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0693b73-1f1c-433f-baf6-f6ebabee6d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:31.896646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0693b73-1f1c-433f-baf6-f6ebabee6d02 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:31.897421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0693b73-1f1c-433f-baf6-f6ebabee6d02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:31.898434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: WARNING py.warnings [None req-c0693b73-1f1c-433f-baf6-f6ebabee6d02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:28:31.898434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: warnings.warn(msg) May 26 12:28:31.898434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: May 26 12:28:31.899634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0693b73-1f1c-433f-baf6-f6ebabee6d02 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:31.920939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 750/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:28:31 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:28:31.926122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bb822-1cb6-46c9-94b9-427954166d1b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:31.936328 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bb822-1cb6-46c9-94b9-427954166d1b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:31.940937 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26377178-8dd4-492e-978d-ddb04883bafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:31.941626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26377178-8dd4-492e-978d-ddb04883bafc admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:31.941914 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26377178-8dd4-492e-978d-ddb04883bafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:31.942193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26377178-8dd4-492e-978d-ddb04883bafc admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:31.942921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26377178-8dd4-492e-978d-ddb04883bafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:31.943948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: WARNING py.warnings [None req-26377178-8dd4-492e-978d-ddb04883bafc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:28:31.943948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: warnings.warn(msg) May 26 12:28:31.943948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: May 26 12:28:31.944864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26377178-8dd4-492e-978d-ddb04883bafc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:31.957916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 749/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:28:31.961931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0693b73-1f1c-433f-baf6-f6ebabee6d02 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:31.972631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0693b73-1f1c-433f-baf6-f6ebabee6d02 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:31.977146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cb06e-13e4-4e7e-855b-a0d350e51ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:31.977813 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cb06e-13e4-4e7e-855b-a0d350e51ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:31.978083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cb06e-13e4-4e7e-855b-a0d350e51ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:31.978360 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cb06e-13e4-4e7e-855b-a0d350e51ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:31.979083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cb06e-13e4-4e7e-855b-a0d350e51ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:31.980088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: WARNING py.warnings [None req-120cb06e-13e4-4e7e-855b-a0d350e51ff1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:28:31.980088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: warnings.warn(msg) May 26 12:28:31.980088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: May 26 12:28:31.981008 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cb06e-13e4-4e7e-855b-a0d350e51ff1 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:31.994977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 751/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:28:31.998940 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26377178-8dd4-492e-978d-ddb04883bafc admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:32.009118 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26377178-8dd4-492e-978d-ddb04883bafc admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:32.013685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788e38c-95da-402d-bb0e-90a0d434a407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:32.014563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788e38c-95da-402d-bb0e-90a0d434a407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:32.014853 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788e38c-95da-402d-bb0e-90a0d434a407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:32.015135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788e38c-95da-402d-bb0e-90a0d434a407 admin admin] PATH_INFO: `/v3/projects/8e6d8ca38f7e4f7d8366b541a8dc6ade/users/5fde9d6568cb4abc888fee479a43a9a1/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:32.029760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788e38c-95da-402d-bb0e-90a0d434a407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6d8ca38f7e4f7d8366b541a8dc6ade, user_id=5fde9d6568cb4abc888fee479a43a9a1, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:32.030807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: WARNING py.warnings [None req-3788e38c-95da-402d-bb0e-90a0d434a407 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:28:32.030807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: warnings.warn(msg) May 26 12:28:32.030807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: May 26 12:28:32.033250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788e38c-95da-402d-bb0e-90a0d434a407 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:32.045854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 750/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:28:31 2022] PUT /identity/v3/projects/8e6d8ca38f7e4f7d8366b541a8dc6ade/users/5fde9d6568cb4abc888fee479a43a9a1/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:28:32.057881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0844de-e9c6-40c4-9256-56b99300f80b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:32.058182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0844de-e9c6-40c4-9256-56b99300f80b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:32.058467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0844de-e9c6-40c4-9256-56b99300f80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:32.084196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1b0844de-e9c6-40c4-9256-56b99300f80b None None] MFA Rules not processed for user `5fde9d6568cb4abc888fee479a43a9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:32.085366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1b0844de-e9c6-40c4-9256-56b99300f80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:32.152525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 752/1502] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:28:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:32.166147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279ab4e-ce7d-477f-ac63-d512a7f4f6f2 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:32.166443 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279ab4e-ce7d-477f-ac63-d512a7f4f6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:32.166726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279ab4e-ce7d-477f-ac63-d512a7f4f6f2 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:32.168105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 751/1503] 10.222.0.39 () {54 vars in 963 bytes} [Thu May 26 12:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:32.172695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17912478-d4e1-4dfe-a1fb-4baa5c3a8ad8 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:32.173009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17912478-d4e1-4dfe-a1fb-4baa5c3a8ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:32.173293 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17912478-d4e1-4dfe-a1fb-4baa5c3a8ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:32.192047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-17912478-d4e1-4dfe-a1fb-4baa5c3a8ad8 None None] MFA Rules not processed for user `64fd1405d96d435faba0c8857009f889`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:32.193290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-17912478-d4e1-4dfe-a1fb-4baa5c3a8ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:32.239478 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:32.248522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 753/1504] 10.222.0.39 () {58 vars in 1060 bytes} [Thu May 26 12:28:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:32.256740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279ab4e-ce7d-477f-ac63-d512a7f4f6f2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:32.267786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b279ab4e-ce7d-477f-ac63-d512a7f4f6f2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:32.271529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc34a8b-4dfe-4f5f-aaea-40095b38b0d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:32.272166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc34a8b-4dfe-4f5f-aaea-40095b38b0d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:32.272454 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc34a8b-4dfe-4f5f-aaea-40095b38b0d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:32.272753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc34a8b-4dfe-4f5f-aaea-40095b38b0d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:32.280980 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc34a8b-4dfe-4f5f-aaea-40095b38b0d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:32.282433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc34a8b-4dfe-4f5f-aaea-40095b38b0d8 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:32.292005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 752/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:28:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:28:32.334772 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e45a23-6944-4e6c-bf2a-92b645af0102 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:32.335009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e45a23-6944-4e6c-bf2a-92b645af0102 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:32.335286 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e45a23-6944-4e6c-bf2a-92b645af0102 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:32.336561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 754/1506] 10.222.0.39 () {52 vars in 829 bytes} [Thu May 26 12:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:32.340049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc34a8b-4dfe-4f5f-aaea-40095b38b0d8 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:32.401782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc34a8b-4dfe-4f5f-aaea-40095b38b0d8 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:32.406203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:32.407068 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:32.407349 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:32.407619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] PATH_INFO: `/v3/users/5fde9d6568cb4abc888fee479a43a9a1` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:32.409653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fde9d6568cb4abc888fee479a43a9a1)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:32.410663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: WARNING py.warnings [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:28:32.410663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: warnings.warn(msg) May 26 12:28:32.410663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: May 26 12:28:32.411855 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:32.477116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fde9d6568cb4abc888fee479a43a9a1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:28:32.477804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fde9d6568cb4abc888fee479a43a9a1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:28:32.478517 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fde9d6568cb4abc888fee479a43a9a1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:28:32.496423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fde9d6568cb4abc888fee479a43a9a1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:28:32.510307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fde9d6568cb4abc888fee479a43a9a1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:28:32.514195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:32.526785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 753/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:28:32 2022] DELETE /identity/v3/users/5fde9d6568cb4abc888fee479a43a9a1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:28:32.531236 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89b982-c42a-47a1-89b3-8d4a49b5069e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:32.531524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89b982-c42a-47a1-89b3-8d4a49b5069e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:32.531800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89b982-c42a-47a1-89b3-8d4a49b5069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:32.549746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6c89b982-c42a-47a1-89b3-8d4a49b5069e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:32.550912 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6c89b982-c42a-47a1-89b3-8d4a49b5069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:32.610145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 755/1508] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:28:32.620327 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:32.621758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:32.809132 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837cbfc-560a-4b1b-9270-bd64cccc763d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:32.812778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90812052-1479-4bba-ab25-2e5d2dfec40d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:32.813423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90812052-1479-4bba-ab25-2e5d2dfec40d service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:32.813708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90812052-1479-4bba-ab25-2e5d2dfec40d service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:32.814003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90812052-1479-4bba-ab25-2e5d2dfec40d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:32.822788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90812052-1479-4bba-ab25-2e5d2dfec40d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:32.824215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90812052-1479-4bba-ab25-2e5d2dfec40d service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:32.833537 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 754/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:28:33.162586 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89b982-c42a-47a1-89b3-8d4a49b5069e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:33.164070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6c89b982-c42a-47a1-89b3-8d4a49b5069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:33.176010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89b982-c42a-47a1-89b3-8d4a49b5069e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:33.181148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37162107-8649-4cef-b996-0f468ede3a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:33.182049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37162107-8649-4cef-b996-0f468ede3a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:33.182342 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37162107-8649-4cef-b996-0f468ede3a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:33.182615 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37162107-8649-4cef-b996-0f468ede3a6a admin admin] PATH_INFO: `/v3/projects/8e6d8ca38f7e4f7d8366b541a8dc6ade` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:33.183809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37162107-8649-4cef-b996-0f468ede3a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6d8ca38f7e4f7d8366b541a8dc6ade)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:33.184876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: WARNING py.warnings [None req-37162107-8649-4cef-b996-0f468ede3a6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:28:33.184876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: warnings.warn(msg) May 26 12:28:33.184876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: May 26 12:28:33.186080 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37162107-8649-4cef-b996-0f468ede3a6a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:33.252171 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-37162107-8649-4cef-b996-0f468ede3a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6d8ca38f7e4f7d8366b541a8dc6ade', 'request_id': 'req-37162107-8649-4cef-b996-0f468ede3a6a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:28:33.262019 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-37162107-8649-4cef-b996-0f468ede3a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6d8ca38f7e4f7d8366b541a8dc6ade', 'request_id': 'req-37162107-8649-4cef-b996-0f468ede3a6a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:28:33.276276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-37162107-8649-4cef-b996-0f468ede3a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6d8ca38f7e4f7d8366b541a8dc6ade', 'request_id': 'req-37162107-8649-4cef-b996-0f468ede3a6a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:28:33.287826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-37162107-8649-4cef-b996-0f468ede3a6a admin admin] The token cache is being invalidate because project 8e6d8ca38f7e4f7d8366b541a8dc6ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:28:33.288118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-37162107-8649-4cef-b996-0f468ede3a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:28:33.288795 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-37162107-8649-4cef-b996-0f468ede3a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:28:33.290439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 756/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:28:33 2022] DELETE /identity/v3/projects/8e6d8ca38f7e4f7d8366b541a8dc6ade => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:28:42.829424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:43.284973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:17.159120 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66806b8b-ea40-4f61-b6d2-a84cdc0831db None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:17.159696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66806b8b-ea40-4f61-b6d2-a84cdc0831db None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:17.159696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66806b8b-ea40-4f61-b6d2-a84cdc0831db None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:17.161064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:17.165827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73681a-a751-428f-9296-51fc17ea12eb None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:17.166234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73681a-a751-428f-9296-51fc17ea12eb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:17.166380 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73681a-a751-428f-9296-51fc17ea12eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:17.185406 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1a73681a-a751-428f-9296-51fc17ea12eb None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:17.186615 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1a73681a-a751-428f-9296-51fc17ea12eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:17.246247 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:17.415663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66806b8b-ea40-4f61-b6d2-a84cdc0831db None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:17.417415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-66806b8b-ea40-4f61-b6d2-a84cdc0831db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:17.491388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66806b8b-ea40-4f61-b6d2-a84cdc0831db None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:17.496853 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921cbc9-d0a0-4a77-9e8d-8b66e2f54a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:17.497506 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921cbc9-d0a0-4a77-9e8d-8b66e2f54a12 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:17.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921cbc9-d0a0-4a77-9e8d-8b66e2f54a12 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:17.498062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921cbc9-d0a0-4a77-9e8d-8b66e2f54a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:17.507650 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921cbc9-d0a0-4a77-9e8d-8b66e2f54a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:17.509271 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921cbc9-d0a0-4a77-9e8d-8b66e2f54a12 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:17.518388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 756/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:18.400451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23201f9-5b72-4ae1-b073-c19c38314b28 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:18.401017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23201f9-5b72-4ae1-b073-c19c38314b28 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:18.401017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23201f9-5b72-4ae1-b073-c19c38314b28 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:18.402418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:18.407192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb5a93-ec33-4c48-9e4d-76b3b4e5b8b8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:18.407600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb5a93-ec33-4c48-9e4d-76b3b4e5b8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:18.407786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb5a93-ec33-4c48-9e4d-76b3b4e5b8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:18.426183 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b7fb5a93-ec33-4c48-9e4d-76b3b4e5b8b8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:18.427381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b7fb5a93-ec33-4c48-9e4d-76b3b4e5b8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:18.435425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:30:18.594401 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23201f9-5b72-4ae1-b073-c19c38314b28 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:18.608850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23201f9-5b72-4ae1-b073-c19c38314b28 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:18.614210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abf686-b247-4a8a-8b8d-a7e65a11a008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:18.614842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abf686-b247-4a8a-8b8d-a7e65a11a008 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:18.615202 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abf686-b247-4a8a-8b8d-a7e65a11a008 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:18.615482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abf686-b247-4a8a-8b8d-a7e65a11a008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:18.623881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abf686-b247-4a8a-8b8d-a7e65a11a008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:18.625520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abf686-b247-4a8a-8b8d-a7e65a11a008 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:18.636017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 759/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:19.176197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482eddd-3dc2-419d-875f-87de8a4d6877 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:19.176627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482eddd-3dc2-419d-875f-87de8a4d6877 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:19.177085 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482eddd-3dc2-419d-875f-87de8a4d6877 None None] PATH_INFO: `/v3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:19.178843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 758/1517] 10.222.0.66 () {54 vars in 925 bytes} [Thu May 26 12:30:19 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:30:19.185595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d7396-9fc1-418b-9096-e70442a30314 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:19.185894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d7396-9fc1-418b-9096-e70442a30314 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:19.186179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d7396-9fc1-418b-9096-e70442a30314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:19.207426 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-db9d7396-9fc1-418b-9096-e70442a30314 None None] MFA Rules not processed for user `b39eb81eb6a64556a4079115d27f1624`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:19.208653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-db9d7396-9fc1-418b-9096-e70442a30314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:19.274859 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 760/1518] 10.222.0.66 () {58 vars in 1015 bytes} [Thu May 26 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:28.421141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=37 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:28.441023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcccf6e-cfcc-4c74-9d8e-76b85c8db04f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:28.441310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcccf6e-cfcc-4c74-9d8e-76b85c8db04f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:28.441591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcccf6e-cfcc-4c74-9d8e-76b85c8db04f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:28.442979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 759/1519] 10.222.0.39 () {54 vars in 960 bytes} [Thu May 26 12:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:28.448352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b6a87-e7a4-475e-8de7-1c92b3e49dc6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:28.448869 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b6a87-e7a4-475e-8de7-1c92b3e49dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:28.448973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b6a87-e7a4-475e-8de7-1c92b3e49dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:28.466939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7c6b6a87-e7a4-475e-8de7-1c92b3e49dc6 None None] MFA Rules not processed for user `b39eb81eb6a64556a4079115d27f1624`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:28.468167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7c6b6a87-e7a4-475e-8de7-1c92b3e49dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:28.477203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 761/1520] 10.222.0.39 () {58 vars in 1057 bytes} [Thu May 26 12:30:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:28.484634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcccf6e-cfcc-4c74-9d8e-76b85c8db04f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:28.498382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcccf6e-cfcc-4c74-9d8e-76b85c8db04f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:28.503188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10ac43-1d24-4d96-a6c9-43945a87300b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:28.503809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10ac43-1d24-4d96-a6c9-43945a87300b service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:28.504089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10ac43-1d24-4d96-a6c9-43945a87300b service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:28.504360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10ac43-1d24-4d96-a6c9-43945a87300b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:28.512682 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10ac43-1d24-4d96-a6c9-43945a87300b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:28.514283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10ac43-1d24-4d96-a6c9-43945a87300b service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:28.523760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 760/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:30:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:29.924656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f73e3c-65e3-481c-9f78-cef6c23494ed None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:29.925186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f73e3c-65e3-481c-9f78-cef6c23494ed None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:29.925295 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f73e3c-65e3-481c-9f78-cef6c23494ed None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:29.926639 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:29.932036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357e3bb-ff9a-4019-9e8e-94859d8d9d4f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:29.932469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357e3bb-ff9a-4019-9e8e-94859d8d9d4f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:29.932579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357e3bb-ff9a-4019-9e8e-94859d8d9d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:29.950815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7357e3bb-ff9a-4019-9e8e-94859d8d9d4f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:29.952013 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7357e3bb-ff9a-4019-9e8e-94859d8d9d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:29.959845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:30.115856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f73e3c-65e3-481c-9f78-cef6c23494ed None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:30.130948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f73e3c-65e3-481c-9f78-cef6c23494ed None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:30.138343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca495bc-bc69-429d-9542-b03d8d17f4a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:30.139016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca495bc-bc69-429d-9542-b03d8d17f4a6 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:30.139295 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca495bc-bc69-429d-9542-b03d8d17f4a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:30.139569 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca495bc-bc69-429d-9542-b03d8d17f4a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:30.148464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca495bc-bc69-429d-9542-b03d8d17f4a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:30.150119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca495bc-bc69-429d-9542-b03d8d17f4a6 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:30.159385 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 763/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:31.028871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806a1f8-9ad6-43b2-a479-c628f9fb074d None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:31.029487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806a1f8-9ad6-43b2-a479-c628f9fb074d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:31.029604 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806a1f8-9ad6-43b2-a479-c628f9fb074d None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:31.031562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:30:31.036627 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c828cae-921e-47ba-96da-083aa46c0475 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:31.037265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c828cae-921e-47ba-96da-083aa46c0475 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:31.037265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c828cae-921e-47ba-96da-083aa46c0475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:31.055885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0c828cae-921e-47ba-96da-083aa46c0475 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:31.057186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0c828cae-921e-47ba-96da-083aa46c0475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:31.066348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:31.218234 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806a1f8-9ad6-43b2-a479-c628f9fb074d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:31.232540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806a1f8-9ad6-43b2-a479-c628f9fb074d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:31.238122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbba7a-1af2-4eb5-b6f5-413cde7f9e6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:31.238758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbba7a-1af2-4eb5-b6f5-413cde7f9e6c service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:31.239045 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbba7a-1af2-4eb5-b6f5-413cde7f9e6c service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:31.239324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbba7a-1af2-4eb5-b6f5-413cde7f9e6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:31.247855 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbba7a-1af2-4eb5-b6f5-413cde7f9e6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:31.249481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbba7a-1af2-4eb5-b6f5-413cde7f9e6c service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:31.260073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 763/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:35.463108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd28ec8-3b68-468a-bc97-7aaf973a58fe None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:35.463618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd28ec8-3b68-468a-bc97-7aaf973a58fe None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:35.463618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd28ec8-3b68-468a-bc97-7aaf973a58fe None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:35.465008 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:30:35.470435 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77e048-f85c-4870-ab09-0a6618cd2fe4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:35.470856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77e048-f85c-4870-ab09-0a6618cd2fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:35.471000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77e048-f85c-4870-ab09-0a6618cd2fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:35.490139 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2f77e048-f85c-4870-ab09-0a6618cd2fe4 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:35.491362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2f77e048-f85c-4870-ab09-0a6618cd2fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:35.499787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:35.536823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd28ec8-3b68-468a-bc97-7aaf973a58fe None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:35.538640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-acd28ec8-3b68-468a-bc97-7aaf973a58fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:35.598453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd28ec8-3b68-468a-bc97-7aaf973a58fe None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:35.602924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef22ca-f0de-4546-926a-52a6d0def03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:35.603577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef22ca-f0de-4546-926a-52a6d0def03a service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:35.603868 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef22ca-f0de-4546-926a-52a6d0def03a service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:35.604152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef22ca-f0de-4546-926a-52a6d0def03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:35.614287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef22ca-f0de-4546-926a-52a6d0def03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:35.615719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef22ca-f0de-4546-926a-52a6d0def03a service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:35.621112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:35.626550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 766/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:37.851764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080fba3-3beb-4e8b-9a56-55c4b45a916e None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.852285 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080fba3-3beb-4e8b-9a56-55c4b45a916e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.852370 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080fba3-3beb-4e8b-9a56-55c4b45a916e None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.853750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:37.859306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a316e-20b6-4b73-beec-e8059ff9ee34 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.859758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a316e-20b6-4b73-beec-e8059ff9ee34 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.859922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a316e-20b6-4b73-beec-e8059ff9ee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.879634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-cd0a316e-20b6-4b73-beec-e8059ff9ee34 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:37.880931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cd0a316e-20b6-4b73-beec-e8059ff9ee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:37.890297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:37.925591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080fba3-3beb-4e8b-9a56-55c4b45a916e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:37.937056 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080fba3-3beb-4e8b-9a56-55c4b45a916e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:37.940830 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9f3d4-fb5e-4a54-8038-6f66ce84ce6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:37.941475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f3d4-fb5e-4a54-8038-6f66ce84ce6b service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:37.941762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f3d4-fb5e-4a54-8038-6f66ce84ce6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:37.942061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9f3d4-fb5e-4a54-8038-6f66ce84ce6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:37.951681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9f3d4-fb5e-4a54-8038-6f66ce84ce6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:37.953159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9f3d4-fb5e-4a54-8038-6f66ce84ce6b service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:37.963586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 766/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:41.875929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a769f7-79cc-4b3c-8b20-083b86ab21cb None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:41.876551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a769f7-79cc-4b3c-8b20-083b86ab21cb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:41.876551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a769f7-79cc-4b3c-8b20-083b86ab21cb None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:41.878060 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:41.884199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c3f9b-fb31-44c9-9476-367e9a049899 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:41.884657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c3f9b-fb31-44c9-9476-367e9a049899 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:41.884813 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c3f9b-fb31-44c9-9476-367e9a049899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:41.904774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f19c3f9b-fb31-44c9-9476-367e9a049899 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:41.905961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f19c3f9b-fb31-44c9-9476-367e9a049899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:41.914114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:42.190036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a769f7-79cc-4b3c-8b20-083b86ab21cb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:42.191734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-88a769f7-79cc-4b3c-8b20-083b86ab21cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:42.250286 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a769f7-79cc-4b3c-8b20-083b86ab21cb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:42.253837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08007faa-12d4-4793-b44d-5e75f48911b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:42.254507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08007faa-12d4-4793-b44d-5e75f48911b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:42.254787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08007faa-12d4-4793-b44d-5e75f48911b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:42.255060 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08007faa-12d4-4793-b44d-5e75f48911b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:42.264856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08007faa-12d4-4793-b44d-5e75f48911b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:42.266271 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08007faa-12d4-4793-b44d-5e75f48911b0 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:42.276491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 769/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:44.519150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ec685-fd13-4d9a-b7e5-f84c69bafd3a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:44.519707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ec685-fd13-4d9a-b7e5-f84c69bafd3a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:44.519707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ec685-fd13-4d9a-b7e5-f84c69bafd3a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:44.521115 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:30:44.526883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc8f07-62fd-41e1-b9c6-62f8e305746d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:44.527311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc8f07-62fd-41e1-b9c6-62f8e305746d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:44.527453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc8f07-62fd-41e1-b9c6-62f8e305746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:44.545369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-57bc8f07-62fd-41e1-b9c6-62f8e305746d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:30:44.546571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-57bc8f07-62fd-41e1-b9c6-62f8e305746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:44.555014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:30:44.831894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ec685-fd13-4d9a-b7e5-f84c69bafd3a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:30:44.833583 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-490ec685-fd13-4d9a-b7e5-f84c69bafd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:30:44.846652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ec685-fd13-4d9a-b7e5-f84c69bafd3a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:30:44.850130 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd2963-0b96-4c94-8b26-54e0413ecf73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:30:44.850784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd2963-0b96-4c94-8b26-54e0413ecf73 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:30:44.851176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd2963-0b96-4c94-8b26-54e0413ecf73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:30:44.851446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd2963-0b96-4c94-8b26-54e0413ecf73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:30:44.860198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd2963-0b96-4c94-8b26-54e0413ecf73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:30:44.861637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd2963-0b96-4c94-8b26-54e0413ecf73 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:30:44.871856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 769/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:30:54.540180 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=32 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:30:54.866837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=33 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:19.486343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47230e-a920-4714-b351-5fad1b05c907 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.486976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47230e-a920-4714-b351-5fad1b05c907 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.487377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47230e-a920-4714-b351-5fad1b05c907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.520090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5e47230e-a920-4714-b351-5fad1b05c907 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:19.521340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5e47230e-a920-4714-b351-5fad1b05c907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:19.532429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 771/1540] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:19.542569 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb6271-2bce-4db3-8569-f1c86fdeae06 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.543228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb6271-2bce-4db3-8569-f1c86fdeae06 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.543228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb6271-2bce-4db3-8569-f1c86fdeae06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.558966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e996ed-5f4b-403f-a5b8-e015ad81a200 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.559303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e996ed-5f4b-403f-a5b8-e015ad81a200 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.559710 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e996ed-5f4b-403f-a5b8-e015ad81a200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.577544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f3cb6271-2bce-4db3-8569-f1c86fdeae06 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:19.579180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f3cb6271-2bce-4db3-8569-f1c86fdeae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:19.589619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 770/1541] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:19.591050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a5e996ed-5f4b-403f-a5b8-e015ad81a200 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:19.592307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a5e996ed-5f4b-403f-a5b8-e015ad81a200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:19.595129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb6271-2bce-4db3-8569-f1c86fdeae06 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:19.610539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 772/1542] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:32:19.611534 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb6271-2bce-4db3-8569-f1c86fdeae06 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:19.616848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a478115-23c6-480b-987f-3b0321d66785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:19.617764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4450125-128d-491f-8322-91c3a8518c05 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.618059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4450125-128d-491f-8322-91c3a8518c05 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.618342 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4450125-128d-491f-8322-91c3a8518c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.618686 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a478115-23c6-480b-987f-3b0321d66785 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.619185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a478115-23c6-480b-987f-3b0321d66785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.619671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a478115-23c6-480b-987f-3b0321d66785 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.622184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a478115-23c6-480b-987f-3b0321d66785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:19.622890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a478115-23c6-480b-987f-3b0321d66785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:19.624141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: WARNING py.warnings [None req-5a478115-23c6-480b-987f-3b0321d66785 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:32:19.624141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: warnings.warn(msg) May 26 12:32:19.624141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: May 26 12:32:19.629257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a478115-23c6-480b-987f-3b0321d66785 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:19.645163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 771/1543] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:32:19.647034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f19a8-ffd4-412d-b158-24e4a184f8be None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.647545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f19a8-ffd4-412d-b158-24e4a184f8be None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.648059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f19a8-ffd4-412d-b158-24e4a184f8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.661151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c4450125-128d-491f-8322-91c3a8518c05 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:19.662410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c4450125-128d-491f-8322-91c3a8518c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:19.671417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-799f19a8-ffd4-412d-b158-24e4a184f8be None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:19.673721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-799f19a8-ffd4-412d-b158-24e4a184f8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:19.689322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 772/1544] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:19.690734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f19a8-ffd4-412d-b158-24e4a184f8be None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:19.695211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 773/1545] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:19.696623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73aac9-90df-47a3-a2d1-02004a03ec9f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.697040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73aac9-90df-47a3-a2d1-02004a03ec9f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.697325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73aac9-90df-47a3-a2d1-02004a03ec9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.706539 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f19a8-ffd4-412d-b158-24e4a184f8be None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:19.718284 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e1452-dd74-4ad7-9882-923044a155aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:19.719428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1452-dd74-4ad7-9882-923044a155aa admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.719946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1452-dd74-4ad7-9882-923044a155aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.720484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e1452-dd74-4ad7-9882-923044a155aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.721480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e1452-dd74-4ad7-9882-923044a155aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:19.723672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e1452-dd74-4ad7-9882-923044a155aa admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:19.745861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-aa73aac9-90df-47a3-a2d1-02004a03ec9f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:19.752884 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-aa73aac9-90df-47a3-a2d1-02004a03ec9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:19.770231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 773/1546] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:19.774631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e1452-dd74-4ad7-9882-923044a155aa admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:19.775622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 774/1547] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:19.777001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd280c-135f-4ead-b8f1-7c1e22774055 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.777299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd280c-135f-4ead-b8f1-7c1e22774055 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.777580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd280c-135f-4ead-b8f1-7c1e22774055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.812706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-badd280c-135f-4ead-b8f1-7c1e22774055 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:19.814089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-badd280c-135f-4ead-b8f1-7c1e22774055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:19.850212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e1452-dd74-4ad7-9882-923044a155aa admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:19.861694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09cf73-0fb3-4bac-ad49-6c4c2808c90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:19.862426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09cf73-0fb3-4bac-ad49-6c4c2808c90d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.862712 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09cf73-0fb3-4bac-ad49-6c4c2808c90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.862989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09cf73-0fb3-4bac-ad49-6c4c2808c90d admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.867710 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09cf73-0fb3-4bac-ad49-6c4c2808c90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:19.868034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09cf73-0fb3-4bac-ad49-6c4c2808c90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:19.870149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09cf73-0fb3-4bac-ad49-6c4c2808c90d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:19.897106 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 774/1548] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:32:19.898186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09cf73-0fb3-4bac-ad49-6c4c2808c90d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:19.916108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09cf73-0fb3-4bac-ad49-6c4c2808c90d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:19.919774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 775/1549] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:19.921029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381d42-6199-4061-84ef-f12285f85bd6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.921378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381d42-6199-4061-84ef-f12285f85bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.921734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30381d42-6199-4061-84ef-f12285f85bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.923530 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485fb8d-6d79-422c-b4dd-a750e2a25d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:19.924302 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485fb8d-6d79-422c-b4dd-a750e2a25d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.924596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485fb8d-6d79-422c-b4dd-a750e2a25d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.924912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485fb8d-6d79-422c-b4dd-a750e2a25d24 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.925605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485fb8d-6d79-422c-b4dd-a750e2a25d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:19.926636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: WARNING py.warnings [None req-3485fb8d-6d79-422c-b4dd-a750e2a25d24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:32:19.926636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: warnings.warn(msg) May 26 12:32:19.926636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: May 26 12:32:19.928210 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485fb8d-6d79-422c-b4dd-a750e2a25d24 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:19.940752 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-30381d42-6199-4061-84ef-f12285f85bd6 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:19.941956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-30381d42-6199-4061-84ef-f12285f85bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:19.957160 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 775/1550] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:19.957414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 776/1551] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:19.957515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fc3b2-3b16-43e9-a69c-00cec27e1827 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.957515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fc3b2-3b16-43e9-a69c-00cec27e1827 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.957515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fc3b2-3b16-43e9-a69c-00cec27e1827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.957744 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31be151-e9eb-4593-a869-920bcff907fd None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.957744 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31be151-e9eb-4593-a869-920bcff907fd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.957744 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31be151-e9eb-4593-a869-920bcff907fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.977877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1d3fc3b2-3b16-43e9-a69c-00cec27e1827 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:19.979134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1d3fc3b2-3b16-43e9-a69c-00cec27e1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:19.979350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b31be151-e9eb-4593-a869-920bcff907fd None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:19.981635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b31be151-e9eb-4593-a869-920bcff907fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:19.989143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 776/1552] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:19.990839 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcf6a9-bc85-403f-8fab-fc7f2f360968 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:19.991142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcf6a9-bc85-403f-8fab-fc7f2f360968 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:19.991411 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcf6a9-bc85-403f-8fab-fc7f2f360968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:19.994242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 777/1553] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:19.995681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31be151-e9eb-4593-a869-920bcff907fd None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.006456 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31be151-e9eb-4593-a869-920bcff907fd None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.011965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e170c0c-0739-4089-8ca3-c92efe80caa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.012632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e170c0c-0739-4089-8ca3-c92efe80caa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.013083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e170c0c-0739-4089-8ca3-c92efe80caa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.013370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e170c0c-0739-4089-8ca3-c92efe80caa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.014073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e170c0c-0739-4089-8ca3-c92efe80caa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.015104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: WARNING py.warnings [None req-5e170c0c-0739-4089-8ca3-c92efe80caa6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:32:20.015104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: warnings.warn(msg) May 26 12:32:20.015104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: May 26 12:32:20.016301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e170c0c-0739-4089-8ca3-c92efe80caa6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.026264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7edcf6a9-bc85-403f-8fab-fc7f2f360968 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:20.027948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7edcf6a9-bc85-403f-8fab-fc7f2f360968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:20.047480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 777/1554] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:20.048649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcf6a9-bc85-403f-8fab-fc7f2f360968 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.054825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 778/1555] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:19 2022] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:20.055825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e170c0c-0739-4089-8ca3-c92efe80caa6 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.084417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcf6a9-bc85-403f-8fab-fc7f2f360968 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.137573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e170c0c-0739-4089-8ca3-c92efe80caa6 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.142479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733b3c0-4c1e-43ab-887c-c6be3253d4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.143284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733b3c0-4c1e-43ab-887c-c6be3253d4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.143648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733b3c0-4c1e-43ab-887c-c6be3253d4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.144002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733b3c0-4c1e-43ab-887c-c6be3253d4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.144912 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733b3c0-4c1e-43ab-887c-c6be3253d4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.146610 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733b3c0-4c1e-43ab-887c-c6be3253d4b9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.147116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592ad81-752f-41a3-b92f-b93ea074d345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.147917 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ad81-752f-41a3-b92f-b93ea074d345 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.148072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ad81-752f-41a3-b92f-b93ea074d345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.148378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ad81-752f-41a3-b92f-b93ea074d345 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.149153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592ad81-752f-41a3-b92f-b93ea074d345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:20.149478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592ad81-752f-41a3-b92f-b93ea074d345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.151198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592ad81-752f-41a3-b92f-b93ea074d345 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.157501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 779/1556] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:20.158645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733b3c0-4c1e-43ab-887c-c6be3253d4b9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.171341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 778/1557] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:32:20.171341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ace6-ff15-45c9-aeae-f9d7ce94c30e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.171341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ace6-ff15-45c9-aeae-f9d7ce94c30e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.171341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944ace6-ff15-45c9-aeae-f9d7ce94c30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.171834 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733b3c0-4c1e-43ab-887c-c6be3253d4b9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.176058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac12db-10ad-454d-a975-eb01ccb06c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.176737 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac12db-10ad-454d-a975-eb01ccb06c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.177045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac12db-10ad-454d-a975-eb01ccb06c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.177321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac12db-10ad-454d-a975-eb01ccb06c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.178045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac12db-10ad-454d-a975-eb01ccb06c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:20.178354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac12db-10ad-454d-a975-eb01ccb06c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.179954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac12db-10ad-454d-a975-eb01ccb06c92 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.185704 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7944ace6-ff15-45c9-aeae-f9d7ce94c30e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:20.187284 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7944ace6-ff15-45c9-aeae-f9d7ce94c30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:20.192562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 780/1558] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:32:20.193971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4e80c-0d2e-48b2-9d9d-9b6b7be47cac None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.194264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4e80c-0d2e-48b2-9d9d-9b6b7be47cac None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.194544 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4e80c-0d2e-48b2-9d9d-9b6b7be47cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.199509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 779/1559] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:20.200451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ace6-ff15-45c9-aeae-f9d7ce94c30e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.206049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:20.212024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944ace6-ff15-45c9-aeae-f9d7ce94c30e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.212329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8bd4e80c-0d2e-48b2-9d9d-9b6b7be47cac None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:20.213613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8bd4e80c-0d2e-48b2-9d9d-9b6b7be47cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:20.217971 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343cdd6-f9f9-4747-8168-cd85dd931fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.218639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343cdd6-f9f9-4747-8168-cd85dd931fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.218924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343cdd6-f9f9-4747-8168-cd85dd931fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.219203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343cdd6-f9f9-4747-8168-cd85dd931fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.219894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343cdd6-f9f9-4747-8168-cd85dd931fd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.221903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343cdd6-f9f9-4747-8168-cd85dd931fd0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.222409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 781/1560] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:20.223723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82f9c6-7ac9-4109-b454-c7868ebe4956 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.224010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82f9c6-7ac9-4109-b454-c7868ebe4956 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.224293 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82f9c6-7ac9-4109-b454-c7868ebe4956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.242946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-da82f9c6-7ac9-4109-b454-c7868ebe4956 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:20.244190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-da82f9c6-7ac9-4109-b454-c7868ebe4956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:20.244325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 780/1561] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/users => generated 302 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:20.246159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05909316-1ecb-40e8-a7ad-f758a082cf9b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.246450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05909316-1ecb-40e8-a7ad-f758a082cf9b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.246728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05909316-1ecb-40e8-a7ad-f758a082cf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.254939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 782/1562] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:20.255935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82f9c6-7ac9-4109-b454-c7868ebe4956 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.265372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-05909316-1ecb-40e8-a7ad-f758a082cf9b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:20.266503 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-05909316-1ecb-40e8-a7ad-f758a082cf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:20.268428 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82f9c6-7ac9-4109-b454-c7868ebe4956 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.272958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e725e-579d-4a62-a5d1-cd2cf108ecae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.273616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e725e-579d-4a62-a5d1-cd2cf108ecae admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.273904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e725e-579d-4a62-a5d1-cd2cf108ecae admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.274190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e725e-579d-4a62-a5d1-cd2cf108ecae admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.274792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 781/1563] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:20.274911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e725e-579d-4a62-a5d1-cd2cf108ecae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.275550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05909316-1ecb-40e8-a7ad-f758a082cf9b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.276633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e725e-579d-4a62-a5d1-cd2cf108ecae admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.279004 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:20.287881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05909316-1ecb-40e8-a7ad-f758a082cf9b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.291581 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 783/1564] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:20.292566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e725e-579d-4a62-a5d1-cd2cf108ecae admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.293088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d76a7-4336-4ec7-a8e0-582107bc17d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.293751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d76a7-4336-4ec7-a8e0-582107bc17d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.294037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d76a7-4336-4ec7-a8e0-582107bc17d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.294330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d76a7-4336-4ec7-a8e0-582107bc17d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.295015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d76a7-4336-4ec7-a8e0-582107bc17d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.296986 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d76a7-4336-4ec7-a8e0-582107bc17d1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.302300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e725e-579d-4a62-a5d1-cd2cf108ecae admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.306875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422e762-e3e6-4815-af74-4421880643c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.307517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e762-e3e6-4815-af74-4421880643c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.308339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e762-e3e6-4815-af74-4421880643c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.308615 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e762-e3e6-4815-af74-4421880643c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.309336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422e762-e3e6-4815-af74-4421880643c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.311232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422e762-e3e6-4815-af74-4421880643c3 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.324516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 782/1565] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:20.325692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d76a7-4336-4ec7-a8e0-582107bc17d1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.338692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 784/1566] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:20.340483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422e762-e3e6-4815-af74-4421880643c3 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.393802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d76a7-4336-4ec7-a8e0-582107bc17d1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.418497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422e762-e3e6-4815-af74-4421880643c3 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.424320 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b68163-4c5c-4f90-88ed-c925f56d7700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.425367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b68163-4c5c-4f90-88ed-c925f56d7700 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.425656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b68163-4c5c-4f90-88ed-c925f56d7700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.425940 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b68163-4c5c-4f90-88ed-c925f56d7700 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.426682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b68163-4c5c-4f90-88ed-c925f56d7700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:20.426996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b68163-4c5c-4f90-88ed-c925f56d7700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.429095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b68163-4c5c-4f90-88ed-c925f56d7700 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.450486 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 785/1567] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:32:20.450486 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b68163-4c5c-4f90-88ed-c925f56d7700 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.453237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3d578-1c67-462a-9693-a61f90da361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.453917 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3d578-1c67-462a-9693-a61f90da361d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.454199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3d578-1c67-462a-9693-a61f90da361d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.454475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3d578-1c67-462a-9693-a61f90da361d admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.455232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3d578-1c67-462a-9693-a61f90da361d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:20.455540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3d578-1c67-462a-9693-a61f90da361d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.455828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b68163-4c5c-4f90-88ed-c925f56d7700 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.457195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3d578-1c67-462a-9693-a61f90da361d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.460610 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba55795-116a-4bd7-9e72-4d45d799309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.461303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba55795-116a-4bd7-9e72-4d45d799309a admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.461590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba55795-116a-4bd7-9e72-4d45d799309a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.461870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba55795-116a-4bd7-9e72-4d45d799309a admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.462601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba55795-116a-4bd7-9e72-4d45d799309a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.464419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba55795-116a-4bd7-9e72-4d45d799309a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.470418 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 783/1568] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:32:20.477449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 786/1569] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:20.477449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2fd8c-1fe6-4d5c-864b-9f5418c18e41 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.477449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2fd8c-1fe6-4d5c-864b-9f5418c18e41 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.477449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2fd8c-1fe6-4d5c-864b-9f5418c18e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.478183 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3d578-1c67-462a-9693-a61f90da361d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.490731 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3d578-1c67-462a-9693-a61f90da361d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.496801 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bde650-dd85-45a2-a36b-d12d8cea4e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.497896 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bde650-dd85-45a2-a36b-d12d8cea4e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.498187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bde650-dd85-45a2-a36b-d12d8cea4e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.498462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bde650-dd85-45a2-a36b-d12d8cea4e05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.499096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9da2fd8c-1fe6-4d5c-864b-9f5418c18e41 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:20.499574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bde650-dd85-45a2-a36b-d12d8cea4e05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:20.499574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bde650-dd85-45a2-a36b-d12d8cea4e05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.500812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9da2fd8c-1fe6-4d5c-864b-9f5418c18e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:20.502534 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bde650-dd85-45a2-a36b-d12d8cea4e05 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.508805 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 787/1570] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:20.509585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2fd8c-1fe6-4d5c-864b-9f5418c18e41 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.517591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 784/1571] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:32:20.517811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bde650-dd85-45a2-a36b-d12d8cea4e05 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.521153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2fd8c-1fe6-4d5c-864b-9f5418c18e41 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.525823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9355737-e195-4d14-ab24-4ab149778714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.527375 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9355737-e195-4d14-ab24-4ab149778714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.527814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9355737-e195-4d14-ab24-4ab149778714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.528096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9355737-e195-4d14-ab24-4ab149778714 admin admin] PATH_INFO: `/v3/projects/7ef656c0ca2943eb965bf10d4e943d27/users/7b14606965a74c71881595c71bdd2d58/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.529244 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bde650-dd85-45a2-a36b-d12d8cea4e05 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.533865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68fd79-cef2-4fbf-8654-5b60341f069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.534532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68fd79-cef2-4fbf-8654-5b60341f069f admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.534815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68fd79-cef2-4fbf-8654-5b60341f069f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.535121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68fd79-cef2-4fbf-8654-5b60341f069f admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.535809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68fd79-cef2-4fbf-8654-5b60341f069f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.537813 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68fd79-cef2-4fbf-8654-5b60341f069f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.542975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9355737-e195-4d14-ab24-4ab149778714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef656c0ca2943eb965bf10d4e943d27, user_id=7b14606965a74c71881595c71bdd2d58, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.544010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: WARNING py.warnings [None req-e9355737-e195-4d14-ab24-4ab149778714 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:32:20.544010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: warnings.warn(msg) May 26 12:32:20.544010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: May 26 12:32:20.545959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9355737-e195-4d14-ab24-4ab149778714 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.559565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 785/1572] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/users => generated 294 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:20.560452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68fd79-cef2-4fbf-8654-5b60341f069f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.561042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 788/1573] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:20 2022] PUT /identity/v3/projects/7ef656c0ca2943eb965bf10d4e943d27/users/7b14606965a74c71881595c71bdd2d58/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:20.561822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9355737-e195-4d14-ab24-4ab149778714 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.570951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68fd79-cef2-4fbf-8654-5b60341f069f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.596433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:20.625343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9355737-e195-4d14-ab24-4ab149778714 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.629643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3ae86-6047-4562-9585-c2d9b6b81949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.630107 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97f783-66a8-4485-af55-481b7895c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.630468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3ae86-6047-4562-9585-c2d9b6b81949 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.630754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3ae86-6047-4562-9585-c2d9b6b81949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.630865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97f783-66a8-4485-af55-481b7895c3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.631030 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3ae86-6047-4562-9585-c2d9b6b81949 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.631142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97f783-66a8-4485-af55-481b7895c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.631306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97f783-66a8-4485-af55-481b7895c3f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.631718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3ae86-6047-4562-9585-c2d9b6b81949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.631991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97f783-66a8-4485-af55-481b7895c3f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.633694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3ae86-6047-4562-9585-c2d9b6b81949 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.633903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97f783-66a8-4485-af55-481b7895c3f2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.658846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 786/1574] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:20.660180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3ae86-6047-4562-9585-c2d9b6b81949 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.666555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 789/1575] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:20.667418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97f783-66a8-4485-af55-481b7895c3f2 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.670951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3ae86-6047-4562-9585-c2d9b6b81949 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.682850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:20.728368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446213bd-85eb-4ce0-9609-e64ebe74701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.729064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446213bd-85eb-4ce0-9609-e64ebe74701b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.729379 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446213bd-85eb-4ce0-9609-e64ebe74701b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.729692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446213bd-85eb-4ce0-9609-e64ebe74701b admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.730390 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446213bd-85eb-4ce0-9609-e64ebe74701b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.732302 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446213bd-85eb-4ce0-9609-e64ebe74701b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.735915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97f783-66a8-4485-af55-481b7895c3f2 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.740611 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c548c1-bc93-43dd-bf78-47cc59069582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.741326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c548c1-bc93-43dd-bf78-47cc59069582 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.741615 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c548c1-bc93-43dd-bf78-47cc59069582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.741898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c548c1-bc93-43dd-bf78-47cc59069582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.742632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c548c1-bc93-43dd-bf78-47cc59069582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.744265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c548c1-bc93-43dd-bf78-47cc59069582 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.754974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 790/1576] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:20.755932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c548c1-bc93-43dd-bf78-47cc59069582 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.764100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 787/1577] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:20.764100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446213bd-85eb-4ce0-9609-e64ebe74701b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.772645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c548c1-bc93-43dd-bf78-47cc59069582 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.828911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446213bd-85eb-4ce0-9609-e64ebe74701b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.830970 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528006a-10de-4040-a27f-5876ba013289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.831655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528006a-10de-4040-a27f-5876ba013289 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.831944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528006a-10de-4040-a27f-5876ba013289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.832223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528006a-10de-4040-a27f-5876ba013289 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.832993 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528006a-10de-4040-a27f-5876ba013289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:20.833309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528006a-10de-4040-a27f-5876ba013289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.834938 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2528006a-10de-4040-a27f-5876ba013289 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.840063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e9a8b-7570-4165-8673-af54776e36fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.840791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e9a8b-7570-4165-8673-af54776e36fd admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.841147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e9a8b-7570-4165-8673-af54776e36fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.841426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e9a8b-7570-4165-8673-af54776e36fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.842138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e9a8b-7570-4165-8673-af54776e36fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.845561 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e9a8b-7570-4165-8673-af54776e36fd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.848365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 791/1578] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:32:20.849555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528006a-10de-4040-a27f-5876ba013289 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.866988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528006a-10de-4040-a27f-5876ba013289 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.873391 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115314b5-cfb4-4bd1-b4e4-0cd9571ec129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.874226 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115314b5-cfb4-4bd1-b4e4-0cd9571ec129 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.874510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115314b5-cfb4-4bd1-b4e4-0cd9571ec129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.874791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115314b5-cfb4-4bd1-b4e4-0cd9571ec129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.875607 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115314b5-cfb4-4bd1-b4e4-0cd9571ec129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.877504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115314b5-cfb4-4bd1-b4e4-0cd9571ec129 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.890840 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 788/1579] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:20.892263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e6ca8-92e6-4991-9a4e-3830ac15e448 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.892555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e6ca8-92e6-4991-9a4e-3830ac15e448 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.892880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e6ca8-92e6-4991-9a4e-3830ac15e448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.895656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 792/1580] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:20.896558 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115314b5-cfb4-4bd1-b4e4-0cd9571ec129 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.909076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115314b5-cfb4-4bd1-b4e4-0cd9571ec129 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.913278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-530e6ca8-92e6-4991-9a4e-3830ac15e448 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:20.914487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-530e6ca8-92e6-4991-9a4e-3830ac15e448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:20.939060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:20.968432 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2863dc-b3a9-4fff-b761-4bc08dd73671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.969158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2863dc-b3a9-4fff-b761-4bc08dd73671 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.969433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2863dc-b3a9-4fff-b761-4bc08dd73671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.969711 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2863dc-b3a9-4fff-b761-4bc08dd73671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.970436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2863dc-b3a9-4fff-b761-4bc08dd73671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:20.972063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2863dc-b3a9-4fff-b761-4bc08dd73671 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:20.981001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 789/1581] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:20.984942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 793/1582] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:20.985648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e6ca8-92e6-4991-9a4e-3830ac15e448 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.985932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2863dc-b3a9-4fff-b761-4bc08dd73671 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:20.991169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e6ca8-92e6-4991-9a4e-3830ac15e448 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.997221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5c92a-4c8e-4dd8-84d6-ba1e46a4feef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:20.997895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5c92a-4c8e-4dd8-84d6-ba1e46a4feef admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:20.998182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5c92a-4c8e-4dd8-84d6-ba1e46a4feef admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:20.998461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5c92a-4c8e-4dd8-84d6-ba1e46a4feef admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:20.998884 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2863dc-b3a9-4fff-b761-4bc08dd73671 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:20.999158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5c92a-4c8e-4dd8-84d6-ba1e46a4feef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.001224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5c92a-4c8e-4dd8-84d6-ba1e46a4feef admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.003500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9043b-96d1-4b1a-9228-dc0e1094beeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.004378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9043b-96d1-4b1a-9228-dc0e1094beeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.004662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9043b-96d1-4b1a-9228-dc0e1094beeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.004986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9043b-96d1-4b1a-9228-dc0e1094beeb admin admin] PATH_INFO: `/v3/projects/79f9d66ae95d4e42b07dd9f091de2111/users/c09469ca2e2940c5a55c6365f374e26d/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.021141 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9043b-96d1-4b1a-9228-dc0e1094beeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f9d66ae95d4e42b07dd9f091de2111, user_id=c09469ca2e2940c5a55c6365f374e26d, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.021866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 790/1583] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:20 2022] POST /identity/v3/users => generated 297 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:21.022698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5c92a-4c8e-4dd8-84d6-ba1e46a4feef admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.023914 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9043b-96d1-4b1a-9228-dc0e1094beeb admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.033806 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5c92a-4c8e-4dd8-84d6-ba1e46a4feef admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.042962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 794/1584] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:20 2022] PUT /identity/v3/projects/79f9d66ae95d4e42b07dd9f091de2111/users/c09469ca2e2940c5a55c6365f374e26d/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:21.042962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9043b-96d1-4b1a-9228-dc0e1094beeb admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.046436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:21.093320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef9e85-e429-4cba-9f8c-d252c9eeb3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.094084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef9e85-e429-4cba-9f8c-d252c9eeb3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.094372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef9e85-e429-4cba-9f8c-d252c9eeb3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.094651 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef9e85-e429-4cba-9f8c-d252c9eeb3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.095336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef9e85-e429-4cba-9f8c-d252c9eeb3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.097315 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef9e85-e429-4cba-9f8c-d252c9eeb3b4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.104342 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9043b-96d1-4b1a-9228-dc0e1094beeb admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.109773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8182c6-427c-4b8a-ac7f-22e01f196db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.110434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8182c6-427c-4b8a-ac7f-22e01f196db3 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.110725 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8182c6-427c-4b8a-ac7f-22e01f196db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.111006 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8182c6-427c-4b8a-ac7f-22e01f196db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.111696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8182c6-427c-4b8a-ac7f-22e01f196db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.113643 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8182c6-427c-4b8a-ac7f-22e01f196db3 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.117788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 791/1585] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:21 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:21.121859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef9e85-e429-4cba-9f8c-d252c9eeb3b4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.132101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef9e85-e429-4cba-9f8c-d252c9eeb3b4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.137704 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438a429-30c3-4890-85f8-66ff05d1b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.138713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a429-30c3-4890-85f8-66ff05d1b602 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.139004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a429-30c3-4890-85f8-66ff05d1b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.139284 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a429-30c3-4890-85f8-66ff05d1b602 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.143391 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 795/1586] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:21 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:21.143542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438a429-30c3-4890-85f8-66ff05d1b602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.143648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8182c6-427c-4b8a-ac7f-22e01f196db3 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.143748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438a429-30c3-4890-85f8-66ff05d1b602 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.163829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 792/1587] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:21 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:21.164653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438a429-30c3-4890-85f8-66ff05d1b602 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.174633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438a429-30c3-4890-85f8-66ff05d1b602 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.213120 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8182c6-427c-4b8a-ac7f-22e01f196db3 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.218647 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cebea2-73d2-4534-8d9c-7e93336eb196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.219326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cebea2-73d2-4534-8d9c-7e93336eb196 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.219637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cebea2-73d2-4534-8d9c-7e93336eb196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.219917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cebea2-73d2-4534-8d9c-7e93336eb196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.220659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cebea2-73d2-4534-8d9c-7e93336eb196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.222333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cebea2-73d2-4534-8d9c-7e93336eb196 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.233667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 796/1588] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:21.234522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cebea2-73d2-4534-8d9c-7e93336eb196 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.242597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b2981-8c13-47a9-b22f-efcae32a9515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.243286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b2981-8c13-47a9-b22f-efcae32a9515 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.243571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b2981-8c13-47a9-b22f-efcae32a9515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.243848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b2981-8c13-47a9-b22f-efcae32a9515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.244593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b2981-8c13-47a9-b22f-efcae32a9515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.246445 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b2981-8c13-47a9-b22f-efcae32a9515 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.256943 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 793/1589] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:21.257855 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b2981-8c13-47a9-b22f-efcae32a9515 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.272040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b2981-8c13-47a9-b22f-efcae32a9515 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.277564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a3ee-2d4c-4c2c-9926-683877287de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.278356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a3ee-2d4c-4c2c-9926-683877287de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.278642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a3ee-2d4c-4c2c-9926-683877287de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.278917 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a3ee-2d4c-4c2c-9926-683877287de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.279650 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1a3ee-2d4c-4c2c-9926-683877287de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.281325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1a3ee-2d4c-4c2c-9926-683877287de8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.295447 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 794/1590] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:21.296979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eee77-66b7-4487-932b-99ea201adf1a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.297280 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eee77-66b7-4487-932b-99ea201adf1a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.297560 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eee77-66b7-4487-932b-99ea201adf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.299577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cebea2-73d2-4534-8d9c-7e93336eb196 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.304132 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17174ba4-4318-4cee-9810-8a6c1fe9054e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.304812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17174ba4-4318-4cee-9810-8a6c1fe9054e service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.305137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17174ba4-4318-4cee-9810-8a6c1fe9054e service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.305400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17174ba4-4318-4cee-9810-8a6c1fe9054e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.310713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:21.316170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17174ba4-4318-4cee-9810-8a6c1fe9054e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.317217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-419eee77-66b7-4487-932b-99ea201adf1a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:21.317652 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17174ba4-4318-4cee-9810-8a6c1fe9054e service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.318458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-419eee77-66b7-4487-932b-99ea201adf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:21.326773 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 795/1591] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:21.327347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419eee77-66b7-4487-932b-99ea201adf1a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.328076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 797/1592] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:21.328750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17174ba4-4318-4cee-9810-8a6c1fe9054e service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.336783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419eee77-66b7-4487-932b-99ea201adf1a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.342819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4add9-2a79-4783-83d6-b0f56b98c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.343487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4add9-2a79-4783-83d6-b0f56b98c99e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.343769 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4add9-2a79-4783-83d6-b0f56b98c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.344042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4add9-2a79-4783-83d6-b0f56b98c99e admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.344808 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4add9-2a79-4783-83d6-b0f56b98c99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.346405 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4add9-2a79-4783-83d6-b0f56b98c99e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.347244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17174ba4-4318-4cee-9810-8a6c1fe9054e service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.353688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf4d16-c7ac-4ff1-8bce-d7649889079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.354392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4d16-c7ac-4ff1-8bce-d7649889079f admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.354788 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4d16-c7ac-4ff1-8bce-d7649889079f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.355105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4d16-c7ac-4ff1-8bce-d7649889079f admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.355960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf4d16-c7ac-4ff1-8bce-d7649889079f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.361209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf4d16-c7ac-4ff1-8bce-d7649889079f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.361471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 796/1593] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:21.361471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4add9-2a79-4783-83d6-b0f56b98c99e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.371285 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4add9-2a79-4783-83d6-b0f56b98c99e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.377563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e5e3d-6115-41a6-ac68-56278aedf96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.378323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e5e3d-6115-41a6-ac68-56278aedf96a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.378700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e5e3d-6115-41a6-ac68-56278aedf96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.378890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e5e3d-6115-41a6-ac68-56278aedf96a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.379807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e5e3d-6115-41a6-ac68-56278aedf96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.381241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e5e3d-6115-41a6-ac68-56278aedf96a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.389061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 798/1594] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:21 2022] POST /identity/v3/users => generated 287 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:21.389061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf4d16-c7ac-4ff1-8bce-d7649889079f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.392836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 797/1595] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:21.393530 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e5e3d-6115-41a6-ac68-56278aedf96a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.403530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf4d16-c7ac-4ff1-8bce-d7649889079f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.404001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e5e3d-6115-41a6-ac68-56278aedf96a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.409477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0194c-2b33-4187-8de9-39c09fcbb409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.409644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40879568-1078-45e8-b570-1efac18836d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.410404 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0194c-2b33-4187-8de9-39c09fcbb409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.410523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879568-1078-45e8-b570-1efac18836d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.410712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0194c-2b33-4187-8de9-39c09fcbb409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.410830 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879568-1078-45e8-b570-1efac18836d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.411026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0194c-2b33-4187-8de9-39c09fcbb409 admin admin] PATH_INFO: `/v3/projects/978105ae032049cd85c3b1c061d10a24/users/c90e6a7a7265480ca4c817d633da4a1d/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.411163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879568-1078-45e8-b570-1efac18836d0 admin admin] PATH_INFO: `/v3/projects/91bc9228161843beb63d71faddf3dfa5/users/c31af84396fa48aa9da4fa2591141cd3/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.422695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:21.428621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40879568-1078-45e8-b570-1efac18836d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91bc9228161843beb63d71faddf3dfa5, user_id=c31af84396fa48aa9da4fa2591141cd3, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.431269 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40879568-1078-45e8-b570-1efac18836d0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.431933 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0194c-2b33-4187-8de9-39c09fcbb409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978105ae032049cd85c3b1c061d10a24, user_id=c90e6a7a7265480ca4c817d633da4a1d, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.435054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0194c-2b33-4187-8de9-39c09fcbb409 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.447731 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 798/1596] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:21 2022] PUT /identity/v3/projects/91bc9228161843beb63d71faddf3dfa5/users/c31af84396fa48aa9da4fa2591141cd3/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:21.452288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 799/1597] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:21 2022] PUT /identity/v3/projects/978105ae032049cd85c3b1c061d10a24/users/c90e6a7a7265480ca4c817d633da4a1d/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:21.453035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0194c-2b33-4187-8de9-39c09fcbb409 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.454865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-aed0194c-2b33-4187-8de9-39c09fcbb409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:21.459684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40879568-1078-45e8-b570-1efac18836d0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.539576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0194c-2b33-4187-8de9-39c09fcbb409 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.544246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7adb-ff0a-4853-b4be-12f0a072b4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.545028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7adb-ff0a-4853-b4be-12f0a072b4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.545387 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7adb-ff0a-4853-b4be-12f0a072b4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.545739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d7adb-ff0a-4853-b4be-12f0a072b4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.549882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40879568-1078-45e8-b570-1efac18836d0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.623637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6b6c7-c117-490b-8955-139463277695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.624379 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6b6c7-c117-490b-8955-139463277695 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.624671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6b6c7-c117-490b-8955-139463277695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.624980 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6b6c7-c117-490b-8955-139463277695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.625776 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6b6c7-c117-490b-8955-139463277695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.627392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6b6c7-c117-490b-8955-139463277695 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.627881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d7adb-ff0a-4853-b4be-12f0a072b4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.629981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d7adb-ff0a-4853-b4be-12f0a072b4a8 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.639123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 799/1598] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:21.640376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6b6c7-c117-490b-8955-139463277695 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.642215 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 800/1599] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:21.643444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7adb-ff0a-4853-b4be-12f0a072b4a8 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.653035 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6b6c7-c117-490b-8955-139463277695 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.656363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d7adb-ff0a-4853-b4be-12f0a072b4a8 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.660171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03511153-b7d5-4b8a-9569-ad9ceec21074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.661168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03511153-b7d5-4b8a-9569-ad9ceec21074 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.662051 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87071c26-4c48-4bbc-ac66-fed0b3b519ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.662188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03511153-b7d5-4b8a-9569-ad9ceec21074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.662188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03511153-b7d5-4b8a-9569-ad9ceec21074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.662354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87071c26-4c48-4bbc-ac66-fed0b3b519ac admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.662561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87071c26-4c48-4bbc-ac66-fed0b3b519ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.662821 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87071c26-4c48-4bbc-ac66-fed0b3b519ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.663722 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03511153-b7d5-4b8a-9569-ad9ceec21074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.663836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87071c26-4c48-4bbc-ac66-fed0b3b519ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.665592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87071c26-4c48-4bbc-ac66-fed0b3b519ac admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.665901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03511153-b7d5-4b8a-9569-ad9ceec21074 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.678780 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 800/1600] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:21.680067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03511153-b7d5-4b8a-9569-ad9ceec21074 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.683272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 801/1601] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:21.684887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be9600-cc59-4d7b-afc8-e35070d620d2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.685275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be9600-cc59-4d7b-afc8-e35070d620d2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.685561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be9600-cc59-4d7b-afc8-e35070d620d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.700180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03511153-b7d5-4b8a-9569-ad9ceec21074 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.707426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7c79-161a-4f87-bd90-7c46fefdf5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.707850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-78be9600-cc59-4d7b-afc8-e35070d620d2 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:21.708155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7c79-161a-4f87-bd90-7c46fefdf5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.708489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7c79-161a-4f87-bd90-7c46fefdf5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.708913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7c79-161a-4f87-bd90-7c46fefdf5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.709720 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-78be9600-cc59-4d7b-afc8-e35070d620d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:21.709845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af7c79-161a-4f87-bd90-7c46fefdf5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.711716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af7c79-161a-4f87-bd90-7c46fefdf5e8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.723946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 802/1602] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:21.723946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75b06-6582-40d6-b4d3-68eacf015d16 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.723946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75b06-6582-40d6-b4d3-68eacf015d16 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.723946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75b06-6582-40d6-b4d3-68eacf015d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.733612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 801/1603] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:21.733612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7c79-161a-4f87-bd90-7c46fefdf5e8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.746959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7c79-161a-4f87-bd90-7c46fefdf5e8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.758027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22da90-cf94-4b10-803d-09797c4c60b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.758317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22da90-cf94-4b10-803d-09797c4c60b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.758573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22da90-cf94-4b10-803d-09797c4c60b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.758986 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22da90-cf94-4b10-803d-09797c4c60b1 admin admin] PATH_INFO: `/v3/projects/d04d37bf7dfc47f3b20a58a3d95c1c2b/users/c21602eca99d48d8824c0f5c1693d573/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:21.771818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-41b75b06-6582-40d6-b4d3-68eacf015d16 None None] MFA Rules not processed for user `c31af84396fa48aa9da4fa2591141cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:21.775036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-41b75b06-6582-40d6-b4d3-68eacf015d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:21.804073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22da90-cf94-4b10-803d-09797c4c60b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04d37bf7dfc47f3b20a58a3d95c1c2b, user_id=c21602eca99d48d8824c0f5c1693d573, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:21.807537 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22da90-cf94-4b10-803d-09797c4c60b1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:21.842453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 802/1604] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:21 2022] PUT /identity/v3/projects/d04d37bf7dfc47f3b20a58a3d95c1c2b/users/c21602eca99d48d8824c0f5c1693d573/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:21.843209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22da90-cf94-4b10-803d-09797c4c60b1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.862550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:21.897949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 803/1605] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:21.899808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b75b06-6582-40d6-b4d3-68eacf015d16 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:21.914963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b75b06-6582-40d6-b4d3-68eacf015d16 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.924451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:21.992249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22da90-cf94-4b10-803d-09797c4c60b1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:21.998109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67ed69-9837-41b4-97de-a096b236c519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:21.999229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67ed69-9837-41b4-97de-a096b236c519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:21.999522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67ed69-9837-41b4-97de-a096b236c519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:21.999876 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67ed69-9837-41b4-97de-a096b236c519 admin admin] PATH_INFO: `/v3/projects/56a5f086b59d477ba7206e2bb5fa6eeb/users/01e775d5adc54b5fb361a8e27b8f1007/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.005433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001525de-ed13-489f-a989-a7ce0d199ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:22.006080 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001525de-ed13-489f-a989-a7ce0d199ccc admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.006374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001525de-ed13-489f-a989-a7ce0d199ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.006716 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001525de-ed13-489f-a989-a7ce0d199ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.007569 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001525de-ed13-489f-a989-a7ce0d199ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:22.009287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001525de-ed13-489f-a989-a7ce0d199ccc admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:22.020512 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67ed69-9837-41b4-97de-a096b236c519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a5f086b59d477ba7206e2bb5fa6eeb, user_id=01e775d5adc54b5fb361a8e27b8f1007, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:22.023297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 804/1606] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:22.024135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001525de-ed13-489f-a989-a7ce0d199ccc admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:22.027500 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67ed69-9837-41b4-97de-a096b236c519 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:22.037512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001525de-ed13-489f-a989-a7ce0d199ccc admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:22.052943 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 803/1607] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:21 2022] PUT /identity/v3/projects/56a5f086b59d477ba7206e2bb5fa6eeb/users/01e775d5adc54b5fb361a8e27b8f1007/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:22.052943 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67ed69-9837-41b4-97de-a096b236c519 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:22.130175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e8fbf-5585-45a1-9f69-1c3331ef2ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:22.133131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e8fbf-5585-45a1-9f69-1c3331ef2ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.133605 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e8fbf-5585-45a1-9f69-1c3331ef2ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.134057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e8fbf-5585-45a1-9f69-1c3331ef2ff9 admin admin] PATH_INFO: `/v3/projects/e7143cd05e47434a9e4babd66167f5ea/users/900271d533084386b3d7a3072c355e4c/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.157378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67ed69-9837-41b4-97de-a096b236c519 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:22.160505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e8fbf-5585-45a1-9f69-1c3331ef2ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7143cd05e47434a9e4babd66167f5ea, user_id=900271d533084386b3d7a3072c355e4c, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:22.164378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e8fbf-5585-45a1-9f69-1c3331ef2ff9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:22.165367 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1d83d-ecf5-40a5-8d48-60a279a6333d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:22.166061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1d83d-ecf5-40a5-8d48-60a279a6333d service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.170693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1d83d-ecf5-40a5-8d48-60a279a6333d service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.171003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1d83d-ecf5-40a5-8d48-60a279a6333d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.194892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1d83d-ecf5-40a5-8d48-60a279a6333d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:22.200375 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 805/1608] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:22 2022] PUT /identity/v3/projects/e7143cd05e47434a9e4babd66167f5ea/users/900271d533084386b3d7a3072c355e4c/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:22.200375 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6ffc8-0b01-4342-b245-f73a6163c2a7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.200375 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6ffc8-0b01-4342-b245-f73a6163c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.200375 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6ffc8-0b01-4342-b245-f73a6163c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.202678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1d83d-ecf5-40a5-8d48-60a279a6333d service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:22.217084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 804/1609] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:22.218662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab3420-bb73-419e-b5f3-e18bec24431a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.219124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab3420-bb73-419e-b5f3-e18bec24431a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.219548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab3420-bb73-419e-b5f3-e18bec24431a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.221257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 805/1610] 10.222.0.39 () {54 vars in 961 bytes} [Thu May 26 12:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:22.223076 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab3420-bb73-419e-b5f3-e18bec24431a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:22.228361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6cd6ffc8-0b01-4342-b245-f73a6163c2a7 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:22.231254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6cd6ffc8-0b01-4342-b245-f73a6163c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:22.329076 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab3420-bb73-419e-b5f3-e18bec24431a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:22.337516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c126a-5efd-4691-ae59-d47196752f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:22.340330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c126a-5efd-4691-ae59-d47196752f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.341707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c126a-5efd-4691-ae59-d47196752f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.342728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c126a-5efd-4691-ae59-d47196752f0b admin admin] PATH_INFO: `/v3/projects/13d234594c274f48bde4e1cde4eeccf0/users/6a2c0aee441f4d7baf7313177eaee4d5/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.361441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 806/1611] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:22.362916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e259e-d409-4a43-b3ec-3a7937e4b5a5 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.363265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e259e-d409-4a43-b3ec-3a7937e4b5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.363797 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e259e-d409-4a43-b3ec-3a7937e4b5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.376130 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c126a-5efd-4691-ae59-d47196752f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d234594c274f48bde4e1cde4eeccf0, user_id=6a2c0aee441f4d7baf7313177eaee4d5, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:22.379278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c126a-5efd-4691-ae59-d47196752f0b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:22.413435 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 806/1612] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:22 2022] PUT /identity/v3/projects/13d234594c274f48bde4e1cde4eeccf0/users/6a2c0aee441f4d7baf7313177eaee4d5/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:22.415046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62211e96-4164-41b5-b6b9-64576446d23a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.415402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62211e96-4164-41b5-b6b9-64576446d23a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.415742 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62211e96-4164-41b5-b6b9-64576446d23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.427591 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-224e259e-d409-4a43-b3ec-3a7937e4b5a5 None None] MFA Rules not processed for user `01e775d5adc54b5fb361a8e27b8f1007`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:22.431807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-224e259e-d409-4a43-b3ec-3a7937e4b5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:22.450641 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-62211e96-4164-41b5-b6b9-64576446d23a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:22.452171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-62211e96-4164-41b5-b6b9-64576446d23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:22.478949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:22.489601 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:22.601562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 807/1613] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:22.602954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd8a61-fa9c-4c36-a756-29b469295299 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.603251 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd8a61-fa9c-4c36-a756-29b469295299 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.603535 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd8a61-fa9c-4c36-a756-29b469295299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.607144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 807/1614] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:22.610823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdaaf0-5208-45cf-9d07-ef551447e230 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.611734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdaaf0-5208-45cf-9d07-ef551447e230 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.612141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdaaf0-5208-45cf-9d07-ef551447e230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.653948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f7bd8a61-fa9c-4c36-a756-29b469295299 None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:22.656655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f7bd8a61-fa9c-4c36-a756-29b469295299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:22.673877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a7fdaaf0-5208-45cf-9d07-ef551447e230 None None] MFA Rules not processed for user `6a2c0aee441f4d7baf7313177eaee4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:22.677158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a7fdaaf0-5208-45cf-9d07-ef551447e230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:22.803557 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 808/1615] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:22.807670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdaaf0-5208-45cf-9d07-ef551447e230 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:22.827504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 808/1616] 10.222.0.39 () {58 vars in 1058 bytes} [Thu May 26 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:22.828916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd8a61-fa9c-4c36-a756-29b469295299 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:22.852278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd8a61-fa9c-4c36-a756-29b469295299 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:22.861634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a7149-38ba-4f9b-bf52-ac4493f27f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:22.863703 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a7149-38ba-4f9b-bf52-ac4493f27f41 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.865492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a7149-38ba-4f9b-bf52-ac4493f27f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.865492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a7149-38ba-4f9b-bf52-ac4493f27f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.866191 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a7149-38ba-4f9b-bf52-ac4493f27f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:22.871596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a7149-38ba-4f9b-bf52-ac4493f27f41 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:22.895952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdaaf0-5208-45cf-9d07-ef551447e230 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:22.911362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df116b9-952e-4f57-9158-2fca122cc5f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:22.912383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df116b9-952e-4f57-9158-2fca122cc5f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.912866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df116b9-952e-4f57-9158-2fca122cc5f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.913261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df116b9-952e-4f57-9158-2fca122cc5f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:22.929822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 809/1617] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:22 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:22.929822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a7149-38ba-4f9b-bf52-ac4493f27f41 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:22.942805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df116b9-952e-4f57-9158-2fca122cc5f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:22.948961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df116b9-952e-4f57-9158-2fca122cc5f9 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:22.963471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 809/1618] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:22.966067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f0f49-60a6-4030-90f4-c23755c3a88e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:22.966656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f0f49-60a6-4030-90f4-c23755c3a88e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:22.967041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f0f49-60a6-4030-90f4-c23755c3a88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:23.002175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-589f0f49-60a6-4030-90f4-c23755c3a88e None None] MFA Rules not processed for user `c09469ca2e2940c5a55c6365f374e26d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:23.003588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-589f0f49-60a6-4030-90f4-c23755c3a88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:23.045526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a7149-38ba-4f9b-bf52-ac4493f27f41 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:23.054254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb403f-c575-4855-b139-4c1439f769f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:23.055683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb403f-c575-4855-b139-4c1439f769f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:23.056268 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb403f-c575-4855-b139-4c1439f769f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:23.056701 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb403f-c575-4855-b139-4c1439f769f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:23.064083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:23.111514 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 810/1619] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:23.113585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f0f49-60a6-4030-90f4-c23755c3a88e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:23.139818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:23.181812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb403f-c575-4855-b139-4c1439f769f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:23.184739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb403f-c575-4855-b139-4c1439f769f8 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:23.204325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 810/1620] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:23.219210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb403f-c575-4855-b139-4c1439f769f8 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:23.222308 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f0f49-60a6-4030-90f4-c23755c3a88e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:23.229047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eccb2-8962-4c75-a19e-96242f329e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:23.229797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eccb2-8962-4c75-a19e-96242f329e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:23.230087 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eccb2-8962-4c75-a19e-96242f329e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:23.230363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eccb2-8962-4c75-a19e-96242f329e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:23.231402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2eccb2-8962-4c75-a19e-96242f329e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:23.235104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2eccb2-8962-4c75-a19e-96242f329e26 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:23.305605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 811/1621] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:23 2022] POST /identity/v3/projects => generated 371 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:23.305605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eccb2-8962-4c75-a19e-96242f329e26 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:23.401341 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb403f-c575-4855-b139-4c1439f769f8 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:23.418032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eccb2-8962-4c75-a19e-96242f329e26 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:23.425483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74353079-ab7b-4796-8174-0fad010fd5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:23.426819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353079-ab7b-4796-8174-0fad010fd5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:23.427369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353079-ab7b-4796-8174-0fad010fd5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:23.428090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74353079-ab7b-4796-8174-0fad010fd5a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:23.429242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74353079-ab7b-4796-8174-0fad010fd5a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:23.432418 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74353079-ab7b-4796-8174-0fad010fd5a0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:23.463115 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 812/1622] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:23 2022] POST /identity/v3/users => generated 309 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:23.464907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74353079-ab7b-4796-8174-0fad010fd5a0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:23.498942 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74353079-ab7b-4796-8174-0fad010fd5a0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:23.499536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde9dc7-fddf-4deb-9664-eacd9b2cc632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:23.500314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde9dc7-fddf-4deb-9664-eacd9b2cc632 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:23.500608 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde9dc7-fddf-4deb-9664-eacd9b2cc632 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:23.500926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde9dc7-fddf-4deb-9664-eacd9b2cc632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:23.504927 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fe8b1-60c3-4bf7-a0de-73eadf84af21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:23.505859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fe8b1-60c3-4bf7-a0de-73eadf84af21 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:23.506294 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fe8b1-60c3-4bf7-a0de-73eadf84af21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:23.506693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fe8b1-60c3-4bf7-a0de-73eadf84af21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:23.507579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fe8b1-60c3-4bf7-a0de-73eadf84af21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:23.509900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fe8b1-60c3-4bf7-a0de-73eadf84af21 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:23.577848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 813/1623] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:23 2022] POST /identity/v3/projects => generated 401 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:23.577848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fe8b1-60c3-4bf7-a0de-73eadf84af21 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:23.610294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde9dc7-fddf-4deb-9664-eacd9b2cc632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:23.612290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde9dc7-fddf-4deb-9664-eacd9b2cc632 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:23.654885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 811/1624] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:23.656068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde9dc7-fddf-4deb-9664-eacd9b2cc632 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:23.668948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde9dc7-fddf-4deb-9664-eacd9b2cc632 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:23.673945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:23.686134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:23.716754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fe8b1-60c3-4bf7-a0de-73eadf84af21 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:23.721687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499ff35-c9da-4919-bb3c-e1253c488694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:23.722380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499ff35-c9da-4919-bb3c-e1253c488694 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:23.722666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499ff35-c9da-4919-bb3c-e1253c488694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:23.722949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499ff35-c9da-4919-bb3c-e1253c488694 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:23.724200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499ff35-c9da-4919-bb3c-e1253c488694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:23.726145 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499ff35-c9da-4919-bb3c-e1253c488694 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:23.751902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca14bcf-324e-43c8-8248-f080c221392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:23.753040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca14bcf-324e-43c8-8248-f080c221392b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:23.753853 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca14bcf-324e-43c8-8248-f080c221392b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:23.754572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca14bcf-324e-43c8-8248-f080c221392b admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:23.755903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca14bcf-324e-43c8-8248-f080c221392b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:23.758328 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca14bcf-324e-43c8-8248-f080c221392b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:23.781095 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 814/1625] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:23 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:23.781946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 812/1626] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:23.782073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499ff35-c9da-4919-bb3c-e1253c488694 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:23.786737 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca14bcf-324e-43c8-8248-f080c221392b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:23.799470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499ff35-c9da-4919-bb3c-e1253c488694 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:23.800144 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca14bcf-324e-43c8-8248-f080c221392b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:23.806250 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd6f60-0c35-4173-b2b6-05c1dfedab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:23.807357 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd6f60-0c35-4173-b2b6-05c1dfedab59 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:23.807680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd6f60-0c35-4173-b2b6-05c1dfedab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:23.808574 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd6f60-0c35-4173-b2b6-05c1dfedab59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:23.810047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd6f60-0c35-4173-b2b6-05c1dfedab59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:23.811772 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd6f60-0c35-4173-b2b6-05c1dfedab59 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:23.827590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 813/1627] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:23.827590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd6f60-0c35-4173-b2b6-05c1dfedab59 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:23.828940 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f579b-199f-44e3-af94-cb682f69e731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:23.829875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f579b-199f-44e3-af94-cb682f69e731 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:23.830458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f579b-199f-44e3-af94-cb682f69e731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:23.831053 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f579b-199f-44e3-af94-cb682f69e731 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:23.831997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f579b-199f-44e3-af94-cb682f69e731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:23.835431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f579b-199f-44e3-af94-cb682f69e731 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:23.837572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd6f60-0c35-4173-b2b6-05c1dfedab59 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:23.844288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d1e6f-12c9-4070-a0f1-f11c0a61a499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:23.845445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d1e6f-12c9-4070-a0f1-f11c0a61a499 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:23.845739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d1e6f-12c9-4070-a0f1-f11c0a61a499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:23.846291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d1e6f-12c9-4070-a0f1-f11c0a61a499 admin admin] PATH_INFO: `/v3/projects/e51a3a1c2bfb4d20a56c497542055a90/users/5f56f5160ac444e292b4dcb9acab9fe6/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:23.866706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d1e6f-12c9-4070-a0f1-f11c0a61a499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51a3a1c2bfb4d20a56c497542055a90, user_id=5f56f5160ac444e292b4dcb9acab9fe6, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:23.870695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d1e6f-12c9-4070-a0f1-f11c0a61a499 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:23.880701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 815/1628] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:23 2022] POST /identity/v3/users => generated 307 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:23.881568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f579b-199f-44e3-af94-cb682f69e731 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:23.895564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 814/1629] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:23 2022] PUT /identity/v3/projects/e51a3a1c2bfb4d20a56c497542055a90/users/5f56f5160ac444e292b4dcb9acab9fe6/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:23.897907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d1e6f-12c9-4070-a0f1-f11c0a61a499 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:23.906853 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f579b-199f-44e3-af94-cb682f69e731 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:23.990159 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d1e6f-12c9-4070-a0f1-f11c0a61a499 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:24.002429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e59b20-7b2c-4f05-9ab9-e0a2731106cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:24.003472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e59b20-7b2c-4f05-9ab9-e0a2731106cb admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.003762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e59b20-7b2c-4f05-9ab9-e0a2731106cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.004190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e59b20-7b2c-4f05-9ab9-e0a2731106cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.005136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e59b20-7b2c-4f05-9ab9-e0a2731106cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:24.007013 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e59b20-7b2c-4f05-9ab9-e0a2731106cb admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:24.030460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 815/1630] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:24.032058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e59b20-7b2c-4f05-9ab9-e0a2731106cb admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:24.039358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58417e98-c9cc-4882-a7a8-1ef8444fca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:24.039791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58417e98-c9cc-4882-a7a8-1ef8444fca66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.039981 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58417e98-c9cc-4882-a7a8-1ef8444fca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.040262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58417e98-c9cc-4882-a7a8-1ef8444fca66 admin admin] PATH_INFO: `/v3/projects/ecd31990b99c4748a2d3fdbba4528114/users/298185facb3a4d0ea4ad630361dfa445/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.051451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e59b20-7b2c-4f05-9ab9-e0a2731106cb admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:24.064123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235e718-9c4b-4191-8ea3-dda071b4d63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:24.065036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235e718-9c4b-4191-8ea3-dda071b4d63a admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.065642 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235e718-9c4b-4191-8ea3-dda071b4d63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.066065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235e718-9c4b-4191-8ea3-dda071b4d63a admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.067214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235e718-9c4b-4191-8ea3-dda071b4d63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:24.069246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235e718-9c4b-4191-8ea3-dda071b4d63a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:24.074980 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58417e98-c9cc-4882-a7a8-1ef8444fca66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd31990b99c4748a2d3fdbba4528114, user_id=298185facb3a4d0ea4ad630361dfa445, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:24.078192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58417e98-c9cc-4882-a7a8-1ef8444fca66 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:24.083345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 816/1631] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:24.084296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235e718-9c4b-4191-8ea3-dda071b4d63a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:24.098567 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235e718-9c4b-4191-8ea3-dda071b4d63a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:24.107055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b579a46-269b-46ac-bce8-4f9bf42f4373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:24.108550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b579a46-269b-46ac-bce8-4f9bf42f4373 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.109548 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b579a46-269b-46ac-bce8-4f9bf42f4373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.109548 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b579a46-269b-46ac-bce8-4f9bf42f4373 admin admin] PATH_INFO: `/v3/projects/012c77c36c7a4325aaa900399324cdee/users/492970356b0045a7bb7c58a6e652a98e/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.111598 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 816/1632] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:23 2022] PUT /identity/v3/projects/ecd31990b99c4748a2d3fdbba4528114/users/298185facb3a4d0ea4ad630361dfa445/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:24.114465 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58417e98-c9cc-4882-a7a8-1ef8444fca66 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:24.131619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b579a46-269b-46ac-bce8-4f9bf42f4373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012c77c36c7a4325aaa900399324cdee, user_id=492970356b0045a7bb7c58a6e652a98e, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:24.135489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b579a46-269b-46ac-bce8-4f9bf42f4373 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:24.164491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 817/1633] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:24 2022] PUT /identity/v3/projects/012c77c36c7a4325aaa900399324cdee/users/492970356b0045a7bb7c58a6e652a98e/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:24.167259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b579a46-269b-46ac-bce8-4f9bf42f4373 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:24.266848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58417e98-c9cc-4882-a7a8-1ef8444fca66 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:24.270880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:24.307544 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b579a46-269b-46ac-bce8-4f9bf42f4373 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:24.320477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada732ac-c16e-43c5-9b3f-a27edf32a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:24.321472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada732ac-c16e-43c5-9b3f-a27edf32a411 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.323449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada732ac-c16e-43c5-9b3f-a27edf32a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.324022 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada732ac-c16e-43c5-9b3f-a27edf32a411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.325443 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada732ac-c16e-43c5-9b3f-a27edf32a411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:24.327533 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada732ac-c16e-43c5-9b3f-a27edf32a411 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:24.343997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 818/1634] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:24.345467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada732ac-c16e-43c5-9b3f-a27edf32a411 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:24.358239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada732ac-c16e-43c5-9b3f-a27edf32a411 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:24.366262 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256cc11-36bc-446d-bb8c-d993aaa59e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:24.367250 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256cc11-36bc-446d-bb8c-d993aaa59e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.367800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256cc11-36bc-446d-bb8c-d993aaa59e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.368321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256cc11-36bc-446d-bb8c-d993aaa59e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.369752 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256cc11-36bc-446d-bb8c-d993aaa59e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:24.372270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256cc11-36bc-446d-bb8c-d993aaa59e79 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:24.376512 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:24.389174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 819/1635] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:24.391180 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256cc11-36bc-446d-bb8c-d993aaa59e79 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:24.406592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256cc11-36bc-446d-bb8c-d993aaa59e79 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:24.421032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a037ee2-379a-4758-8fab-d0aecc4fea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:24.422354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a037ee2-379a-4758-8fab-d0aecc4fea48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.423465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a037ee2-379a-4758-8fab-d0aecc4fea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.424457 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a037ee2-379a-4758-8fab-d0aecc4fea48 admin admin] PATH_INFO: `/v3/projects/ecd31990b99c4748a2d3fdbba4528114/users/298185facb3a4d0ea4ad630361dfa445/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.429767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a037ee2-379a-4758-8fab-d0aecc4fea48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd31990b99c4748a2d3fdbba4528114, user_id=298185facb3a4d0ea4ad630361dfa445, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:24.432410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400c89c-83f7-432f-b6a1-26cfaabab6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:24.435592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a037ee2-379a-4758-8fab-d0aecc4fea48 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:24.437041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400c89c-83f7-432f-b6a1-26cfaabab6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.437448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400c89c-83f7-432f-b6a1-26cfaabab6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.437842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400c89c-83f7-432f-b6a1-26cfaabab6c3 admin admin] PATH_INFO: `/v3/projects/e51a3a1c2bfb4d20a56c497542055a90/users/5f56f5160ac444e292b4dcb9acab9fe6/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.443619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400c89c-83f7-432f-b6a1-26cfaabab6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51a3a1c2bfb4d20a56c497542055a90, user_id=5f56f5160ac444e292b4dcb9acab9fe6, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:24.453219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400c89c-83f7-432f-b6a1-26cfaabab6c3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:24.473818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 820/1636] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:24 2022] PUT /identity/v3/projects/ecd31990b99c4748a2d3fdbba4528114/users/298185facb3a4d0ea4ad630361dfa445/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:24.484767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 817/1637] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:24 2022] PUT /identity/v3/projects/e51a3a1c2bfb4d20a56c497542055a90/users/5f56f5160ac444e292b4dcb9acab9fe6/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:24.486775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a037ee2-379a-4758-8fab-d0aecc4fea48 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:24.489808 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec638f54-829b-48f3-a595-92e399d86140 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.490105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec638f54-829b-48f3-a595-92e399d86140 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.490383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec638f54-829b-48f3-a595-92e399d86140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.554774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ec638f54-829b-48f3-a595-92e399d86140 None None] MFA Rules not processed for user `5f56f5160ac444e292b4dcb9acab9fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:24.556146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ec638f54-829b-48f3-a595-92e399d86140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:24.617639 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a037ee2-379a-4758-8fab-d0aecc4fea48 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:24.760612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 818/1638] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:24.765206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441de89-5433-4f32-9dd6-462ee6af1d61 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.766099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441de89-5433-4f32-9dd6-462ee6af1d61 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.767173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441de89-5433-4f32-9dd6-462ee6af1d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.771412 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef171dfd-230d-4fb9-b045-6da3c769d513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:24.775859 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef171dfd-230d-4fb9-b045-6da3c769d513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.775859 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef171dfd-230d-4fb9-b045-6da3c769d513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.775859 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef171dfd-230d-4fb9-b045-6da3c769d513 admin admin] PATH_INFO: `/v3/projects/012c77c36c7a4325aaa900399324cdee/users/492970356b0045a7bb7c58a6e652a98e/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.784222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef171dfd-230d-4fb9-b045-6da3c769d513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012c77c36c7a4325aaa900399324cdee, user_id=492970356b0045a7bb7c58a6e652a98e, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:24.788026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef171dfd-230d-4fb9-b045-6da3c769d513 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:24.832460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 821/1639] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:24 2022] PUT /identity/v3/projects/012c77c36c7a4325aaa900399324cdee/users/492970356b0045a7bb7c58a6e652a98e/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:24.834137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bd991-e51e-46a2-ae5c-14134c522d0c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:24.840770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bd991-e51e-46a2-ae5c-14134c522d0c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:24.841193 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bd991-e51e-46a2-ae5c-14134c522d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:24.880825 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8441de89-5433-4f32-9dd6-462ee6af1d61 None None] MFA Rules not processed for user `298185facb3a4d0ea4ad630361dfa445`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:24.882290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8441de89-5433-4f32-9dd6-462ee6af1d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:24.920517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-418bd991-e51e-46a2-ae5c-14134c522d0c None None] MFA Rules not processed for user `900271d533084386b3d7a3072c355e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:24.921928 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-418bd991-e51e-46a2-ae5c-14134c522d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:25.006252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:25.057916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 822/1640] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:25.059191 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bd991-e51e-46a2-ae5c-14134c522d0c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:25.069756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 819/1641] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:25.071400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f4163-5edb-4060-b7e8-bc99c2229783 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:25.071694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f4163-5edb-4060-b7e8-bc99c2229783 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:25.072410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f4163-5edb-4060-b7e8-bc99c2229783 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:25.073980 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 820/1642] 10.222.0.39 () {54 vars in 961 bytes} [Thu May 26 12:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:25.075877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0ae74-ad16-4f14-b8eb-2af4ffdb0a2e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:25.076441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0ae74-ad16-4f14-b8eb-2af4ffdb0a2e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:25.077346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0ae74-ad16-4f14-b8eb-2af4ffdb0a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:25.098880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6ed0ae74-ad16-4f14-b8eb-2af4ffdb0a2e None None] MFA Rules not processed for user `900271d533084386b3d7a3072c355e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:25.100583 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6ed0ae74-ad16-4f14-b8eb-2af4ffdb0a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:25.112206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 821/1643] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:25.121007 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78eb47-a303-47a6-8a55-f75600345631 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:25.122363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78eb47-a303-47a6-8a55-f75600345631 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:25.122591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78eb47-a303-47a6-8a55-f75600345631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:25.172526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bd991-e51e-46a2-ae5c-14134c522d0c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:25.176752 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-cd78eb47-a303-47a6-8a55-f75600345631 None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:25.178995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5052b3-2894-4fdb-ab19-59ea2f446ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:25.179226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cd78eb47-a303-47a6-8a55-f75600345631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:25.180025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5052b3-2894-4fdb-ab19-59ea2f446ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:25.180501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5052b3-2894-4fdb-ab19-59ea2f446ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:25.181340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5052b3-2894-4fdb-ab19-59ea2f446ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:25.251566 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:25.316828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5052b3-2894-4fdb-ab19-59ea2f446ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:25.318527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5052b3-2894-4fdb-ab19-59ea2f446ef0 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:25.330647 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 822/1644] 10.222.0.39 () {58 vars in 1058 bytes} [Thu May 26 12:32:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:25.331629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78eb47-a303-47a6-8a55-f75600345631 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:25.340277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 823/1645] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:25 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:25.341149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5052b3-2894-4fdb-ab19-59ea2f446ef0 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:25.344118 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78eb47-a303-47a6-8a55-f75600345631 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:25.357849 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255e38c-8569-46aa-aae0-c50e9aa76968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:25.358734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e38c-8569-46aa-aae0-c50e9aa76968 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:25.359129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e38c-8569-46aa-aae0-c50e9aa76968 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:25.359500 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255e38c-8569-46aa-aae0-c50e9aa76968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:25.389861 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255e38c-8569-46aa-aae0-c50e9aa76968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:25.391174 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255e38c-8569-46aa-aae0-c50e9aa76968 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:25.398133 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5052b3-2894-4fdb-ab19-59ea2f446ef0 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:25.419702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 823/1646] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:25.421246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ceec2-a3bd-40ad-989b-9e1b0309e347 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:25.421528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ceec2-a3bd-40ad-989b-9e1b0309e347 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:25.421799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ceec2-a3bd-40ad-989b-9e1b0309e347 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:25.429494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a742a0a-03c8-42cb-92d3-b6ef2ba49deb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:25.430310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a742a0a-03c8-42cb-92d3-b6ef2ba49deb service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:25.430779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a742a0a-03c8-42cb-92d3-b6ef2ba49deb service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:25.431656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a742a0a-03c8-42cb-92d3-b6ef2ba49deb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:25.441105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 824/1647] 10.222.0.39 () {54 vars in 912 bytes} [Thu May 26 12:32:25 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:25.442741 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f023-0199-4378-a7bc-d42f7bfe144e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:25.443031 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f023-0199-4378-a7bc-d42f7bfe144e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:25.443309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66f023-0199-4378-a7bc-d42f7bfe144e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:25.472004 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a742a0a-03c8-42cb-92d3-b6ef2ba49deb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:25.481631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-be66f023-0199-4378-a7bc-d42f7bfe144e None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:25.483576 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-be66f023-0199-4378-a7bc-d42f7bfe144e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:25.489473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a742a0a-03c8-42cb-92d3-b6ef2ba49deb service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:25.499011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 825/1648] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:32:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:25.515096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 824/1649] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:25.528945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66f023-0199-4378-a7bc-d42f7bfe144e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:25.558462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66f023-0199-4378-a7bc-d42f7bfe144e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:25.583288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78409d-3962-405d-85de-7c3caa6ff25f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:25.583963 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78409d-3962-405d-85de-7c3caa6ff25f service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:25.584241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78409d-3962-405d-85de-7c3caa6ff25f service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:25.584523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78409d-3962-405d-85de-7c3caa6ff25f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:25.627971 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78409d-3962-405d-85de-7c3caa6ff25f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:25.629709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78409d-3962-405d-85de-7c3caa6ff25f service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:25.682472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 826/1650] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:25.714409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde1e42-8167-4241-8f3b-cdfb09524ccb None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:25.714409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde1e42-8167-4241-8f3b-cdfb09524ccb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:25.715193 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde1e42-8167-4241-8f3b-cdfb09524ccb None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:25.716006 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 825/1651] 10.222.0.39 () {54 vars in 912 bytes} [Thu May 26 12:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:25.727243 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200da6c-b6a2-4ee3-b9a7-620ec83ef357 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:25.727243 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200da6c-b6a2-4ee3-b9a7-620ec83ef357 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:25.727243 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200da6c-b6a2-4ee3-b9a7-620ec83ef357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:25.778135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1200da6c-b6a2-4ee3-b9a7-620ec83ef357 None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:25.789218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1200da6c-b6a2-4ee3-b9a7-620ec83ef357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:25.812523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 827/1652] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:32:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:32:25.835448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde1e42-8167-4241-8f3b-cdfb09524ccb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:25.837699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6bde1e42-8167-4241-8f3b-cdfb09524ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:25.883015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200da6c-b6a2-4ee3-b9a7-620ec83ef357 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:26.002328 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200da6c-b6a2-4ee3-b9a7-620ec83ef357 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:26.008800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2672f8-7bf0-4cc6-be03-1f83709e7084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:26.010183 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2672f8-7bf0-4cc6-be03-1f83709e7084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:26.010476 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2672f8-7bf0-4cc6-be03-1f83709e7084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:26.010818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2672f8-7bf0-4cc6-be03-1f83709e7084 admin admin] PATH_INFO: `/v3/users/01e775d5adc54b5fb361a8e27b8f1007` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:26.012652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2672f8-7bf0-4cc6-be03-1f83709e7084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e775d5adc54b5fb361a8e27b8f1007)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:26.014847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2672f8-7bf0-4cc6-be03-1f83709e7084 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:26.029939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde1e42-8167-4241-8f3b-cdfb09524ccb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:26.045185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d688d18-c005-4252-98aa-627afefadd1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e854100c04be43c78bce1f95ff85bfc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:26.046682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d688d18-c005-4252-98aa-627afefadd1d service glance] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:26.050618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d688d18-c005-4252-98aa-627afefadd1d service glance] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:26.051001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d688d18-c005-4252-98aa-627afefadd1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:26.081240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d688d18-c005-4252-98aa-627afefadd1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:26.083403 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d688d18-c005-4252-98aa-627afefadd1d service glance] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:26.126541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 826/1653] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:26.135082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0f2672f8-7bf0-4cc6-be03-1f83709e7084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e775d5adc54b5fb361a8e27b8f1007'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.138015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0f2672f8-7bf0-4cc6-be03-1f83709e7084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e775d5adc54b5fb361a8e27b8f1007'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.139036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0f2672f8-7bf0-4cc6-be03-1f83709e7084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e775d5adc54b5fb361a8e27b8f1007'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.168577 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0f2672f8-7bf0-4cc6-be03-1f83709e7084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e775d5adc54b5fb361a8e27b8f1007'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.189859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0f2672f8-7bf0-4cc6-be03-1f83709e7084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e775d5adc54b5fb361a8e27b8f1007'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.259256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 828/1654] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:32:25 2022] DELETE /identity/v3/users/01e775d5adc54b5fb361a8e27b8f1007 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:26.262289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e4332-9318-42ad-a900-ec26f7171f27 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:26.262289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e4332-9318-42ad-a900-ec26f7171f27 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:26.262289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e4332-9318-42ad-a900-ec26f7171f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:26.262466 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec75621-6ccc-46b8-a724-22c2bc2724c9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:26.262466 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec75621-6ccc-46b8-a724-22c2bc2724c9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:26.262466 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec75621-6ccc-46b8-a724-22c2bc2724c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:26.294349 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:26.310419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-518e4332-9318-42ad-a900-ec26f7171f27 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:26.311656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-518e4332-9318-42ad-a900-ec26f7171f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:26.328296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3ec75621-6ccc-46b8-a724-22c2bc2724c9 None None] MFA Rules not processed for user `492970356b0045a7bb7c58a6e652a98e`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:26.333105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3ec75621-6ccc-46b8-a724-22c2bc2724c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:26.378489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:26.489104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 827/1655] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:26.489880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e4332-9318-42ad-a900-ec26f7171f27 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:26.491167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-518e4332-9318-42ad-a900-ec26f7171f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:26.509836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 829/1656] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:32:26.512842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e4332-9318-42ad-a900-ec26f7171f27 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:26.519092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef35a76-7b6f-428e-bbfb-59813b2c466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:26.520163 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef35a76-7b6f-428e-bbfb-59813b2c466d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:26.520584 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef35a76-7b6f-428e-bbfb-59813b2c466d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:26.521042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef35a76-7b6f-428e-bbfb-59813b2c466d admin admin] PATH_INFO: `/v3/users/c31af84396fa48aa9da4fa2591141cd3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:26.522499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef35a76-7b6f-428e-bbfb-59813b2c466d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c31af84396fa48aa9da4fa2591141cd3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:26.523663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: WARNING py.warnings [None req-8ef35a76-7b6f-428e-bbfb-59813b2c466d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:32:26.523663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: warnings.warn(msg) May 26 12:32:26.523663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: May 26 12:32:26.525955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef35a76-7b6f-428e-bbfb-59813b2c466d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:26.526224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec75621-6ccc-46b8-a724-22c2bc2724c9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:26.527758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3ec75621-6ccc-46b8-a724-22c2bc2724c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:26.549264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec75621-6ccc-46b8-a724-22c2bc2724c9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:26.559872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:26.560804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:26.561235 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:26.561510 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] PATH_INFO: `/v3/users/6a2c0aee441f4d7baf7313177eaee4d5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:26.564760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2c0aee441f4d7baf7313177eaee4d5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:26.566866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:26.659029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2c0aee441f4d7baf7313177eaee4d5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.659993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2c0aee441f4d7baf7313177eaee4d5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.660960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2c0aee441f4d7baf7313177eaee4d5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.665027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ef35a76-7b6f-428e-bbfb-59813b2c466d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c31af84396fa48aa9da4fa2591141cd3'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.666226 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ef35a76-7b6f-428e-bbfb-59813b2c466d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c31af84396fa48aa9da4fa2591141cd3'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.667190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ef35a76-7b6f-428e-bbfb-59813b2c466d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c31af84396fa48aa9da4fa2591141cd3'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.676842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2c0aee441f4d7baf7313177eaee4d5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.685650 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2c0aee441f4d7baf7313177eaee4d5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.706373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ef35a76-7b6f-428e-bbfb-59813b2c466d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c31af84396fa48aa9da4fa2591141cd3'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.709156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 830/1657] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:32:26 2022] DELETE /identity/v3/users/6a2c0aee441f4d7baf7313177eaee4d5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:32:26.710504 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:26.712994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:26.722285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ef35a76-7b6f-428e-bbfb-59813b2c466d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c31af84396fa48aa9da4fa2591141cd3'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:26.748287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 828/1658] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:32:26 2022] DELETE /identity/v3/users/c31af84396fa48aa9da4fa2591141cd3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:26.752397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6524c25-f63c-4a16-90e1-488e703a7ff8 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:26.753423 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6524c25-f63c-4a16-90e1-488e703a7ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:26.753655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6524c25-f63c-4a16-90e1-488e703a7ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:26.801296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f6524c25-f63c-4a16-90e1-488e703a7ff8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:26.804349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f6524c25-f63c-4a16-90e1-488e703a7ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:26.848010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc06fc-4164-4448-b07b-e8690257a332 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:26.903499 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:26.977543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 829/1659] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:26.978937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d518ff8-70a1-4b7d-9eae-5a9a6d9f4b03 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:26.982743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d518ff8-70a1-4b7d-9eae-5a9a6d9f4b03 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:26.983158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d518ff8-70a1-4b7d-9eae-5a9a6d9f4b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:27.000230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab631d-437a-4093-a7cd-a04139b86d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:27.002214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab631d-437a-4093-a7cd-a04139b86d53 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:27.004000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab631d-437a-4093-a7cd-a04139b86d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:27.004425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab631d-437a-4093-a7cd-a04139b86d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:27.014703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c5ab631d-437a-4093-a7cd-a04139b86d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:27.027909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-4d518ff8-70a1-4b7d-9eae-5a9a6d9f4b03 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:27.030482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4d518ff8-70a1-4b7d-9eae-5a9a6d9f4b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:27.042318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab631d-437a-4093-a7cd-a04139b86d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:27.044485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab631d-437a-4093-a7cd-a04139b86d53 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:27.053758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 830/1660] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:27.055090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe67d4a-fe77-4e6c-8cc6-6f90dc08095d None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:27.056251 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe67d4a-fe77-4e6c-8cc6-6f90dc08095d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:27.057064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe67d4a-fe77-4e6c-8cc6-6f90dc08095d None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:27.061397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 831/1661] 10.222.0.39 () {54 vars in 912 bytes} [Thu May 26 12:32:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:27.063341 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe67d4a-fe77-4e6c-8cc6-6f90dc08095d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:27.068990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-abe67d4a-fe77-4e6c-8cc6-6f90dc08095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:27.071948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 831/1662] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:27.074687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e09a98-984a-4ba5-85a3-441fd9da2938 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:27.075782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e09a98-984a-4ba5-85a3-441fd9da2938 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:27.076484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e09a98-984a-4ba5-85a3-441fd9da2938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:27.100488 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe67d4a-fe77-4e6c-8cc6-6f90dc08095d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:27.107746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e8158-6b1d-4a78-bc43-c313351b899a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:27.108589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e8158-6b1d-4a78-bc43-c313351b899a service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:27.109024 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e8158-6b1d-4a78-bc43-c313351b899a service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:27.110210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e8158-6b1d-4a78-bc43-c313351b899a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:27.134082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e8158-6b1d-4a78-bc43-c313351b899a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:27.137686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e8158-6b1d-4a78-bc43-c313351b899a service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:27.160173 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 832/1663] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:27.162765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e8158-6b1d-4a78-bc43-c313351b899a service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:27.165247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-68e09a98-984a-4ba5-85a3-441fd9da2938 None None] MFA Rules not processed for user `d2ea8fd0ebfd42fdbed9a989d85c8787`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:27.169088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-68e09a98-984a-4ba5-85a3-441fd9da2938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:27.179244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e8158-6b1d-4a78-bc43-c313351b899a service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:27.185975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 832/1664] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:32:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:27.188356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae98df-5e84-44bb-8b1a-070b1dd84941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:27.189265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae98df-5e84-44bb-8b1a-070b1dd84941 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:27.189647 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae98df-5e84-44bb-8b1a-070b1dd84941 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:27.190083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae98df-5e84-44bb-8b1a-070b1dd84941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:27.202578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae98df-5e84-44bb-8b1a-070b1dd84941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:27.204289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae98df-5e84-44bb-8b1a-070b1dd84941 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:27.210052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:27.221427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 833/1665] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:27.248595 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e09a98-984a-4ba5-85a3-441fd9da2938 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:27.252597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-68e09a98-984a-4ba5-85a3-441fd9da2938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:27.274028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e09a98-984a-4ba5-85a3-441fd9da2938 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:27.282877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47192eb-f848-4c41-9e03-eed2d93b7c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:27.283864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47192eb-f848-4c41-9e03-eed2d93b7c6f service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:27.284264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47192eb-f848-4c41-9e03-eed2d93b7c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:27.285568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47192eb-f848-4c41-9e03-eed2d93b7c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:27.296381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47192eb-f848-4c41-9e03-eed2d93b7c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:27.298354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47192eb-f848-4c41-9e03-eed2d93b7c6f service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:27.309327 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 833/1666] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:28.023827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698272f0-a271-4d9f-9cd9-04f0d716d2b2 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:28.024435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698272f0-a271-4d9f-9cd9-04f0d716d2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:28.024435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698272f0-a271-4d9f-9cd9-04f0d716d2b2 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:28.025875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 834/1667] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:28.088204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e76c4-988f-4ae7-bdd0-53da7a2a656b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:28.088204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e76c4-988f-4ae7-bdd0-53da7a2a656b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:28.088924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e76c4-988f-4ae7-bdd0-53da7a2a656b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:28.125579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9b5e76c4-988f-4ae7-bdd0-53da7a2a656b None None] MFA Rules not processed for user `b39eb81eb6a64556a4079115d27f1624`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:28.127089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9b5e76c4-988f-4ae7-bdd0-53da7a2a656b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:28.267469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 834/1668] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:28.300849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbf9bf-d4e7-4409-baf7-ccbf637fd5ce None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:28.301171 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbf9bf-d4e7-4409-baf7-ccbf637fd5ce None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:28.301444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbf9bf-d4e7-4409-baf7-ccbf637fd5ce None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:28.302817 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 835/1669] 10.222.0.39 () {54 vars in 960 bytes} [Thu May 26 12:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:28.308843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9748ed0-79da-4c5a-963d-7b0088b7346d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:28.309137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9748ed0-79da-4c5a-963d-7b0088b7346d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:28.309416 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9748ed0-79da-4c5a-963d-7b0088b7346d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:28.362483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d9748ed0-79da-4c5a-963d-7b0088b7346d None None] MFA Rules not processed for user `b39eb81eb6a64556a4079115d27f1624`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:28.369354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d9748ed0-79da-4c5a-963d-7b0088b7346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:28.394773 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 835/1670] 10.222.0.39 () {58 vars in 1057 bytes} [Thu May 26 12:32:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:32:28.403751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbf9bf-d4e7-4409-baf7-ccbf637fd5ce None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:28.431334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbf9bf-d4e7-4409-baf7-ccbf637fd5ce None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:28.453485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d32c6-966d-4c25-a45e-394a36c773d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:28.454263 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d32c6-966d-4c25-a45e-394a36c773d8 service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:28.454675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d32c6-966d-4c25-a45e-394a36c773d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:28.455056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d32c6-966d-4c25-a45e-394a36c773d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:28.488880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d32c6-966d-4c25-a45e-394a36c773d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:28.493141 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d32c6-966d-4c25-a45e-394a36c773d8 service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:28.528488 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 836/1671] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:28.882105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9748ed0-79da-4c5a-963d-7b0088b7346d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:28.903391 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9748ed0-79da-4c5a-963d-7b0088b7346d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:28.927245 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7af1d3-8872-4db0-bd8e-3cb07ba663e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:28.928231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7af1d3-8872-4db0-bd8e-3cb07ba663e9 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:28.928750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7af1d3-8872-4db0-bd8e-3cb07ba663e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:28.929237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7af1d3-8872-4db0-bd8e-3cb07ba663e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:28.949348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bb7af1d3-8872-4db0-bd8e-3cb07ba663e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:28.987460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7af1d3-8872-4db0-bd8e-3cb07ba663e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:28.989444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7af1d3-8872-4db0-bd8e-3cb07ba663e9 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:29.004471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 836/1672] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:29.197298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d32c6-966d-4c25-a45e-394a36c773d8 service placement] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:29.199877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cd0d32c6-966d-4c25-a45e-394a36c773d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:29.235618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d32c6-966d-4c25-a45e-394a36c773d8 service placement] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:29.258757 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:29.259959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:29.261696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:29.262637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] PATH_INFO: `/v3/projects/56a5f086b59d477ba7206e2bb5fa6eeb` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:29.264637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a5f086b59d477ba7206e2bb5fa6eeb)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:29.269687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:29.414079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7af1d3-8872-4db0-bd8e-3cb07ba663e9 service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:29.415565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bb7af1d3-8872-4db0-bd8e-3cb07ba663e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:29.427642 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a5f086b59d477ba7206e2bb5fa6eeb', 'request_id': 'req-afb554cf-2217-44b7-a756-b64ef61be64c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.459104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7af1d3-8872-4db0-bd8e-3cb07ba663e9 service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:29.464747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a5f086b59d477ba7206e2bb5fa6eeb', 'request_id': 'req-afb554cf-2217-44b7-a756-b64ef61be64c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.476136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a5f086b59d477ba7206e2bb5fa6eeb', 'request_id': 'req-afb554cf-2217-44b7-a756-b64ef61be64c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.506331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] The token cache is being invalidate because project 56a5f086b59d477ba7206e2bb5fa6eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:32:29.506706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.507967 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.517686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 837/1673] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:32:29 2022] DELETE /identity/v3/projects/56a5f086b59d477ba7206e2bb5fa6eeb => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:29.523680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:29.531545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:29.711730 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb554cf-2217-44b7-a756-b64ef61be64c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:29.712202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:29.713788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:29.714950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:29.715562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] PATH_INFO: `/v3/projects/13d234594c274f48bde4e1cde4eeccf0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:29.718842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:29.720051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d234594c274f48bde4e1cde4eeccf0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:29.721070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:29.721436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:29.725472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: WARNING py.warnings [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:32:29.725472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: warnings.warn(msg) May 26 12:32:29.725472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: May 26 12:32:29.726945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] PATH_INFO: `/v3/users/5f56f5160ac444e292b4dcb9acab9fe6` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:29.728646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f56f5160ac444e292b4dcb9acab9fe6)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:29.730048 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:29.731474 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:29.761851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:29.838042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f56f5160ac444e292b4dcb9acab9fe6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.839960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f56f5160ac444e292b4dcb9acab9fe6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.842174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f56f5160ac444e292b4dcb9acab9fe6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.868884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d234594c274f48bde4e1cde4eeccf0', 'request_id': 'req-2956c020-f7b2-4778-b17f-cd271182d22a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.869432 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f56f5160ac444e292b4dcb9acab9fe6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.890441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:29.906921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d234594c274f48bde4e1cde4eeccf0', 'request_id': 'req-2956c020-f7b2-4778-b17f-cd271182d22a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.913154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f56f5160ac444e292b4dcb9acab9fe6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.941978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 838/1674] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:32:29 2022] DELETE /identity/v3/users/5f56f5160ac444e292b4dcb9acab9fe6 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:29.944862 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d234594c274f48bde4e1cde4eeccf0', 'request_id': 'req-2956c020-f7b2-4778-b17f-cd271182d22a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.967656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:29.970756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:29.974583 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] The token cache is being invalidate because project 13d234594c274f48bde4e1cde4eeccf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:32:29.974583 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.975293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:29.981673 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 837/1675] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:32:29 2022] DELETE /identity/v3/projects/13d234594c274f48bde4e1cde4eeccf0 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:32:29.982781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:29.984339 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:30.183942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93897300-db43-441a-9b9a-c836c190981e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:30.200879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:30.202557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:30.202853 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:30.203130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b admin admin] PATH_INFO: `/v3/projects/91bc9228161843beb63d71faddf3dfa5` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:30.210830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b admin admin] RBAC: Authorizing `identity:delete_project(project_id=91bc9228161843beb63d71faddf3dfa5)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:30.212924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:30.269271 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956c020-f7b2-4778-b17f-cd271182d22a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:30.290091 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d391f-5e60-4f46-9f0e-8260536ba023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:30.291011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d391f-5e60-4f46-9f0e-8260536ba023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:30.291296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d391f-5e60-4f46-9f0e-8260536ba023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:30.295023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d391f-5e60-4f46-9f0e-8260536ba023 admin admin] PATH_INFO: `/v3/users/298185facb3a4d0ea4ad630361dfa445` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:30.296988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d391f-5e60-4f46-9f0e-8260536ba023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=298185facb3a4d0ea4ad630361dfa445)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:30.301757 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d391f-5e60-4f46-9f0e-8260536ba023 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:30.364942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91bc9228161843beb63d71faddf3dfa5', 'request_id': 'req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:30.388120 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91bc9228161843beb63d71faddf3dfa5', 'request_id': 'req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:30.407061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91bc9228161843beb63d71faddf3dfa5', 'request_id': 'req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:30.424486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-314d391f-5e60-4f46-9f0e-8260536ba023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298185facb3a4d0ea4ad630361dfa445'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:30.426694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-314d391f-5e60-4f46-9f0e-8260536ba023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298185facb3a4d0ea4ad630361dfa445'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:30.428021 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-314d391f-5e60-4f46-9f0e-8260536ba023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298185facb3a4d0ea4ad630361dfa445'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:30.433399 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b admin admin] The token cache is being invalidate because project 91bc9228161843beb63d71faddf3dfa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:32:30.435533 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:30.436639 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9f862a0b-e1e2-4c7e-88dd-17a4ed90d95b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:30.441275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 839/1676] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:32:29 2022] DELETE /identity/v3/projects/91bc9228161843beb63d71faddf3dfa5 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:30.445280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aea295-e6ac-4ee7-95b4-520b09fffb6c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:30.445826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aea295-e6ac-4ee7-95b4-520b09fffb6c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:30.446249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aea295-e6ac-4ee7-95b4-520b09fffb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:30.458182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-314d391f-5e60-4f46-9f0e-8260536ba023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298185facb3a4d0ea4ad630361dfa445'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:30.474327 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-314d391f-5e60-4f46-9f0e-8260536ba023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298185facb3a4d0ea4ad630361dfa445'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:30.475582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-81aea295-e6ac-4ee7-95b4-520b09fffb6c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:30.477827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-81aea295-e6ac-4ee7-95b4-520b09fffb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:30.528525 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 838/1677] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:32:29 2022] DELETE /identity/v3/users/298185facb3a4d0ea4ad630361dfa445 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:30.624027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251389a-c215-4dee-8c8d-277357dc0de3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:30.624583 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251389a-c215-4dee-8c8d-277357dc0de3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:30.625030 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251389a-c215-4dee-8c8d-277357dc0de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:30.634808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 840/1678] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:30.656125 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4251389a-c215-4dee-8c8d-277357dc0de3 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:30.657682 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4251389a-c215-4dee-8c8d-277357dc0de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:30.676102 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:30.773728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 839/1679] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:30.778557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aea295-e6ac-4ee7-95b4-520b09fffb6c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:30.792846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aea295-e6ac-4ee7-95b4-520b09fffb6c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:30.800615 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9be43-2075-4cdf-8f3c-0d41beabb362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:30.801374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9be43-2075-4cdf-8f3c-0d41beabb362 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:30.801661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9be43-2075-4cdf-8f3c-0d41beabb362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:30.801938 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9be43-2075-4cdf-8f3c-0d41beabb362 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:30.803047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9be43-2075-4cdf-8f3c-0d41beabb362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:30.803047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9be43-2075-4cdf-8f3c-0d41beabb362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:30.804601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9be43-2075-4cdf-8f3c-0d41beabb362 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:30.826317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251389a-c215-4dee-8c8d-277357dc0de3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:30.834434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 841/1680] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:32:30.838438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251389a-c215-4dee-8c8d-277357dc0de3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:30.849598 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ac3d8-a796-4d05-bb3e-518edbb92303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:30.851442 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ac3d8-a796-4d05-bb3e-518edbb92303 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:30.851953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ac3d8-a796-4d05-bb3e-518edbb92303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:30.853190 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ac3d8-a796-4d05-bb3e-518edbb92303 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:30.856432 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ac3d8-a796-4d05-bb3e-518edbb92303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:30.861684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ac3d8-a796-4d05-bb3e-518edbb92303 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:30.939586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 840/1681] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:30 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:30.946103 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9be43-2075-4cdf-8f3c-0d41beabb362 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:30.947465 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ac3d8-a796-4d05-bb3e-518edbb92303 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:30.951774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ad0ac3d8-a796-4d05-bb3e-518edbb92303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:30.973916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:30.978119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9be43-2075-4cdf-8f3c-0d41beabb362 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:31.159537 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ac3d8-a796-4d05-bb3e-518edbb92303 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:31.170263 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ecfa7-b0bb-423b-b6c5-9ca0ac0ad77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:31.171467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf75b0-1980-4893-b7d3-9e906fce2a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:31.173183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ecfa7-b0bb-423b-b6c5-9ca0ac0ad77d admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:31.173470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ecfa7-b0bb-423b-b6c5-9ca0ac0ad77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:31.173746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ecfa7-b0bb-423b-b6c5-9ca0ac0ad77d admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:31.174474 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ecfa7-b0bb-423b-b6c5-9ca0ac0ad77d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:31.176479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ecfa7-b0bb-423b-b6c5-9ca0ac0ad77d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:31.178677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf75b0-1980-4893-b7d3-9e906fce2a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:31.178677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf75b0-1980-4893-b7d3-9e906fce2a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:31.178677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf75b0-1980-4893-b7d3-9e906fce2a06 admin admin] PATH_INFO: `/v3/users/c09469ca2e2940c5a55c6365f374e26d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:31.182661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf75b0-1980-4893-b7d3-9e906fce2a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09469ca2e2940c5a55c6365f374e26d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:31.186185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf75b0-1980-4893-b7d3-9e906fce2a06 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:31.243925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 842/1682] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:30 2022] POST /identity/v3/users => generated 286 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:31.248324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ecfa7-b0bb-423b-b6c5-9ca0ac0ad77d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:31.286140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ecfa7-b0bb-423b-b6c5-9ca0ac0ad77d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:31.305369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e2cd9-8209-40ff-aaef-b4ef1f28f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:31.307346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2cd9-8209-40ff-aaef-b4ef1f28f2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:31.309753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2cd9-8209-40ff-aaef-b4ef1f28f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:31.310406 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2cd9-8209-40ff-aaef-b4ef1f28f2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:31.313156 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e2cd9-8209-40ff-aaef-b4ef1f28f2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:31.317758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e2cd9-8209-40ff-aaef-b4ef1f28f2f9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:31.341455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-08bf75b0-1980-4893-b7d3-9e906fce2a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09469ca2e2940c5a55c6365f374e26d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:31.348974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-08bf75b0-1980-4893-b7d3-9e906fce2a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09469ca2e2940c5a55c6365f374e26d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:31.349804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-08bf75b0-1980-4893-b7d3-9e906fce2a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09469ca2e2940c5a55c6365f374e26d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:31.367993 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 843/1683] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:31.373479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e2cd9-8209-40ff-aaef-b4ef1f28f2f9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:31.376454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-791e2cd9-8209-40ff-aaef-b4ef1f28f2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:31.405730 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-08bf75b0-1980-4893-b7d3-9e906fce2a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09469ca2e2940c5a55c6365f374e26d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:31.422529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-08bf75b0-1980-4893-b7d3-9e906fce2a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09469ca2e2940c5a55c6365f374e26d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:31.422747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e2cd9-8209-40ff-aaef-b4ef1f28f2f9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:31.437646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497e272-7bd6-4e12-a8a1-42dda363f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:31.438476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497e272-7bd6-4e12-a8a1-42dda363f769 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:31.438873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497e272-7bd6-4e12-a8a1-42dda363f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:31.439259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497e272-7bd6-4e12-a8a1-42dda363f769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:31.441091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497e272-7bd6-4e12-a8a1-42dda363f769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:31.447514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497e272-7bd6-4e12-a8a1-42dda363f769 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:31.462873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 841/1684] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:32:30 2022] DELETE /identity/v3/users/c09469ca2e2940c5a55c6365f374e26d => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:31.494594 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 844/1685] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:31.500348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf75b0-1980-4893-b7d3-9e906fce2a06 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:31.555621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:31.727220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf75b0-1980-4893-b7d3-9e906fce2a06 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:31.735341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaef2d-1e4f-4aec-b376-18e3006e755c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:31.736516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaef2d-1e4f-4aec-b376-18e3006e755c admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:31.736998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaef2d-1e4f-4aec-b376-18e3006e755c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:31.737436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaef2d-1e4f-4aec-b376-18e3006e755c admin admin] PATH_INFO: `/v3/projects/628ee9a93ad54e75bda726f6abf4e16b/users/38ae76bed1274c7a9b4e287694384117/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:31.779218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaef2d-1e4f-4aec-b376-18e3006e755c admin admin] RBAC: Authorizing `identity:create_grant(project_id=628ee9a93ad54e75bda726f6abf4e16b, user_id=38ae76bed1274c7a9b4e287694384117, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:31.786825 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaef2d-1e4f-4aec-b376-18e3006e755c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:31.827760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 842/1686] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:31 2022] PUT /identity/v3/projects/628ee9a93ad54e75bda726f6abf4e16b/users/38ae76bed1274c7a9b4e287694384117/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:31.829513 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b95791-3742-4c56-8889-50197fbc5854 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:31.829964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b95791-3742-4c56-8889-50197fbc5854 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:31.830391 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b95791-3742-4c56-8889-50197fbc5854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:32.119576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-73b95791-3742-4c56-8889-50197fbc5854 None None] MFA Rules not processed for user `38ae76bed1274c7a9b4e287694384117`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:32.121978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-73b95791-3742-4c56-8889-50197fbc5854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:32.271018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 845/1687] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:32:32.271707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaef2d-1e4f-4aec-b376-18e3006e755c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:32.425320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaef2d-1e4f-4aec-b376-18e3006e755c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:32.430922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa3074-b1e7-4f43-8076-b0b94a1d80c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:32.431683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa3074-b1e7-4f43-8076-b0b94a1d80c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:32.432039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa3074-b1e7-4f43-8076-b0b94a1d80c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:32.433316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa3074-b1e7-4f43-8076-b0b94a1d80c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:32.433978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa3074-b1e7-4f43-8076-b0b94a1d80c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:32.436248 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa3074-b1e7-4f43-8076-b0b94a1d80c4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:32.485677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 843/1688] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:32 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:32.487141 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b95791-3742-4c56-8889-50197fbc5854 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:32.518205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b95791-3742-4c56-8889-50197fbc5854 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:32.534036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa3074-b1e7-4f43-8076-b0b94a1d80c4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:32.535968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-57fa3074-b1e7-4f43-8076-b0b94a1d80c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:32.677118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99287f7-676a-4ef3-b739-fb1a48f3fb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:32.678158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99287f7-676a-4ef3-b739-fb1a48f3fb67 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:32.678641 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99287f7-676a-4ef3-b739-fb1a48f3fb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:32.678821 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa3074-b1e7-4f43-8076-b0b94a1d80c4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:32.679329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99287f7-676a-4ef3-b739-fb1a48f3fb67 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:32.680285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99287f7-676a-4ef3-b739-fb1a48f3fb67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:32.686082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:32.687834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:32.688337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:32.688988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] PATH_INFO: `/v3/projects/e51a3a1c2bfb4d20a56c497542055a90` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:32.691425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51a3a1c2bfb4d20a56c497542055a90)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:32.693933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:32.697516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99287f7-676a-4ef3-b739-fb1a48f3fb67 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:32.732046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:32.735136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:32.778113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 846/1689] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:32 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:32.780747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99287f7-676a-4ef3-b739-fb1a48f3fb67 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:32.785566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e99287f7-676a-4ef3-b739-fb1a48f3fb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:32.818239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51a3a1c2bfb4d20a56c497542055a90', 'request_id': 'req-2e46afd3-3d59-4a72-bde2-53dacea9d0de'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:32.832176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99287f7-676a-4ef3-b739-fb1a48f3fb67 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:32.839137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51a3a1c2bfb4d20a56c497542055a90', 'request_id': 'req-2e46afd3-3d59-4a72-bde2-53dacea9d0de'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:32.848031 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51a3a1c2bfb4d20a56c497542055a90', 'request_id': 'req-2e46afd3-3d59-4a72-bde2-53dacea9d0de'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:32.889188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] The token cache is being invalidate because project e51a3a1c2bfb4d20a56c497542055a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:32:32.889467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:32.892379 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:32.895957 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 844/1690] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:32:32 2022] DELETE /identity/v3/projects/e51a3a1c2bfb4d20a56c497542055a90 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:32:32.898376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:32.900116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:33.003788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46afd3-3d59-4a72-bde2-53dacea9d0de admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:33.010682 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f55d3e-e173-4811-9f2e-35223c60a778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:33.012437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f55d3e-e173-4811-9f2e-35223c60a778 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:33.012755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f55d3e-e173-4811-9f2e-35223c60a778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:33.013148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f55d3e-e173-4811-9f2e-35223c60a778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:33.013915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f55d3e-e173-4811-9f2e-35223c60a778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:33.015907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f55d3e-e173-4811-9f2e-35223c60a778 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:33.032739 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 845/1691] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:33.034346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed0958-195c-4aab-b4c3-e637a5a0040b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:33.034907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed0958-195c-4aab-b4c3-e637a5a0040b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:33.035197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed0958-195c-4aab-b4c3-e637a5a0040b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:33.049896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76348f7a-de60-41c9-ac84-ebc97a0113c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:33.051933 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76348f7a-de60-41c9-ac84-ebc97a0113c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:33.052408 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76348f7a-de60-41c9-ac84-ebc97a0113c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:33.052693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76348f7a-de60-41c9-ac84-ebc97a0113c6 admin admin] PATH_INFO: `/v3/projects/79f9d66ae95d4e42b07dd9f091de2111` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:33.054824 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76348f7a-de60-41c9-ac84-ebc97a0113c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f9d66ae95d4e42b07dd9f091de2111)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:33.056526 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-41ed0958-195c-4aab-b4c3-e637a5a0040b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:33.057492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76348f7a-de60-41c9-ac84-ebc97a0113c6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:33.058453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-41ed0958-195c-4aab-b4c3-e637a5a0040b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:33.075158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 846/1692] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:33.076868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291c587-1dd5-427f-a122-48fa91592af6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:33.077135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291c587-1dd5-427f-a122-48fa91592af6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:33.077483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291c587-1dd5-427f-a122-48fa91592af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:33.101892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5291c587-1dd5-427f-a122-48fa91592af6 None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:33.103490 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5291c587-1dd5-427f-a122-48fa91592af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:33.227640 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 847/1693] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:32:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:33.229023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291c587-1dd5-427f-a122-48fa91592af6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:33.235749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-76348f7a-de60-41c9-ac84-ebc97a0113c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f9d66ae95d4e42b07dd9f091de2111', 'request_id': 'req-76348f7a-de60-41c9-ac84-ebc97a0113c6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.256839 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291c587-1dd5-427f-a122-48fa91592af6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:33.259527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-76348f7a-de60-41c9-ac84-ebc97a0113c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f9d66ae95d4e42b07dd9f091de2111', 'request_id': 'req-76348f7a-de60-41c9-ac84-ebc97a0113c6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.271578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-76348f7a-de60-41c9-ac84-ebc97a0113c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f9d66ae95d4e42b07dd9f091de2111', 'request_id': 'req-76348f7a-de60-41c9-ac84-ebc97a0113c6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.298364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-76348f7a-de60-41c9-ac84-ebc97a0113c6 admin admin] The token cache is being invalidate because project 79f9d66ae95d4e42b07dd9f091de2111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:32:33.299349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-76348f7a-de60-41c9-ac84-ebc97a0113c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.304684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-76348f7a-de60-41c9-ac84-ebc97a0113c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.306850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 847/1694] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:32:32 2022] DELETE /identity/v3/projects/79f9d66ae95d4e42b07dd9f091de2111 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:33.309231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc32d10-e899-41e0-a269-9b54d27dc7fd None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:33.312618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc32d10-e899-41e0-a269-9b54d27dc7fd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:33.312963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc32d10-e899-41e0-a269-9b54d27dc7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:33.333902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:33.355104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383ebb9-6449-4c5e-881e-b095915f8983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:33.355325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fcc32d10-e899-41e0-a269-9b54d27dc7fd None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:33.356761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fcc32d10-e899-41e0-a269-9b54d27dc7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:33.357454 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383ebb9-6449-4c5e-881e-b095915f8983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:33.358060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383ebb9-6449-4c5e-881e-b095915f8983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:33.358578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383ebb9-6449-4c5e-881e-b095915f8983 admin admin] PATH_INFO: `/v3/projects/4e9a3627a906480c824cb7cd608cd636/users/ce09136115ce4b9ba54fe298325af294/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:33.379516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383ebb9-6449-4c5e-881e-b095915f8983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9a3627a906480c824cb7cd608cd636, user_id=ce09136115ce4b9ba54fe298325af294, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:33.379689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 848/1695] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:33.380571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc32d10-e899-41e0-a269-9b54d27dc7fd None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:33.381963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fcc32d10-e899-41e0-a269-9b54d27dc7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:33.383392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383ebb9-6449-4c5e-881e-b095915f8983 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:33.408027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 848/1696] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:33 2022] PUT /identity/v3/projects/4e9a3627a906480c824cb7cd608cd636/users/ce09136115ce4b9ba54fe298325af294/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:33.410296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383ebb9-6449-4c5e-881e-b095915f8983 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:33.410430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc32d10-e899-41e0-a269-9b54d27dc7fd None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:33.412850 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b383ebb9-6449-4c5e-881e-b095915f8983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:33.539167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383ebb9-6449-4c5e-881e-b095915f8983 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:33.544278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:33.545205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:33.545490 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:33.545767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] PATH_INFO: `/v3/projects/ecd31990b99c4748a2d3fdbba4528114` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:33.547106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd31990b99c4748a2d3fdbba4528114)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:33.547934 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:33.548958 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:33.549061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:33.550188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:33.550610 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] PATH_INFO: `/v3/users/492970356b0045a7bb7c58a6e652a98e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:33.552831 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=492970356b0045a7bb7c58a6e652a98e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:33.557046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:33.597783 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:33.646092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492970356b0045a7bb7c58a6e652a98e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.647837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492970356b0045a7bb7c58a6e652a98e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.648667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd31990b99c4748a2d3fdbba4528114', 'request_id': 'req-d523edec-82bd-4151-8662-dd02d78a47b1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.648947 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492970356b0045a7bb7c58a6e652a98e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.662238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd31990b99c4748a2d3fdbba4528114', 'request_id': 'req-d523edec-82bd-4151-8662-dd02d78a47b1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.667813 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492970356b0045a7bb7c58a6e652a98e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.674188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd31990b99c4748a2d3fdbba4528114', 'request_id': 'req-d523edec-82bd-4151-8662-dd02d78a47b1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.693362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492970356b0045a7bb7c58a6e652a98e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.703948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] The token cache is being invalidate because project ecd31990b99c4748a2d3fdbba4528114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:32:33.704651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.705557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:33.707721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 849/1697] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:32:33 2022] DELETE /identity/v3/projects/ecd31990b99c4748a2d3fdbba4528114 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:33.709492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:33.712339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:33.718748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 849/1698] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:32:33 2022] DELETE /identity/v3/users/492970356b0045a7bb7c58a6e652a98e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:33.734455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:33.736271 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:33.817521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:33.842455 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523edec-82bd-4151-8662-dd02d78a47b1 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:33.845331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765ce18-1dcc-47ac-ab43-f4d3e4b3e800 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:33.850590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd7a4d-c07e-4f6d-ba60-edb7681aa904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:33.851546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd7a4d-c07e-4f6d-ba60-edb7681aa904 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:33.852001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd7a4d-c07e-4f6d-ba60-edb7681aa904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:33.852605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab6229-03eb-4264-84f2-6af44e299bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:33.853009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd7a4d-c07e-4f6d-ba60-edb7681aa904 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:33.853798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab6229-03eb-4264-84f2-6af44e299bcb admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:33.853909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd7a4d-c07e-4f6d-ba60-edb7681aa904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:33.854250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab6229-03eb-4264-84f2-6af44e299bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:33.854348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd7a4d-c07e-4f6d-ba60-edb7681aa904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:33.854637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab6229-03eb-4264-84f2-6af44e299bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:33.856044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab6229-03eb-4264-84f2-6af44e299bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:33.856983 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd7a4d-c07e-4f6d-ba60-edb7681aa904 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:33.857697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab6229-03eb-4264-84f2-6af44e299bcb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:33.872829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 850/1699] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:33.873863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab6229-03eb-4264-84f2-6af44e299bcb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:33.876374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 850/1700] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:32:33.877771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30762713-929f-48ff-8b00-153d0757c509 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:33.878084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30762713-929f-48ff-8b00-153d0757c509 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:33.878368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30762713-929f-48ff-8b00-153d0757c509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:33.881054 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ceab6229-03eb-4264-84f2-6af44e299bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:33.900348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-30762713-929f-48ff-8b00-153d0757c509 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:33.902933 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-30762713-929f-48ff-8b00-153d0757c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:33.919868 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 851/1701] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:33.919868 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30762713-929f-48ff-8b00-153d0757c509 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:33.923587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-30762713-929f-48ff-8b00-153d0757c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:33.937190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30762713-929f-48ff-8b00-153d0757c509 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:33.959193 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d0409-c2fb-4187-aa86-10e5e8aeea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:33.961320 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d0409-c2fb-4187-aa86-10e5e8aeea51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:33.961624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d0409-c2fb-4187-aa86-10e5e8aeea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:33.961916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d0409-c2fb-4187-aa86-10e5e8aeea51 admin admin] PATH_INFO: `/v3/projects/4e9a3627a906480c824cb7cd608cd636/users/ce09136115ce4b9ba54fe298325af294/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:33.968750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d0409-c2fb-4187-aa86-10e5e8aeea51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9a3627a906480c824cb7cd608cd636, user_id=ce09136115ce4b9ba54fe298325af294, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:33.976505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d0409-c2fb-4187-aa86-10e5e8aeea51 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:33.990617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab6229-03eb-4264-84f2-6af44e299bcb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:34.003744 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 852/1702] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:33 2022] PUT /identity/v3/projects/4e9a3627a906480c824cb7cd608cd636/users/ce09136115ce4b9ba54fe298325af294/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:34.004794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d0409-c2fb-4187-aa86-10e5e8aeea51 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:34.094634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a3565-8ec0-4a7b-8209-b11bc7bb7d24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:34.095726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a3565-8ec0-4a7b-8209-b11bc7bb7d24 service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:34.096845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a3565-8ec0-4a7b-8209-b11bc7bb7d24 service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:34.097866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a3565-8ec0-4a7b-8209-b11bc7bb7d24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:34.100280 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3d2a3565-8ec0-4a7b-8209-b11bc7bb7d24 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:34.142162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d0409-c2fb-4187-aa86-10e5e8aeea51 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:34.157741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839c184-e350-4634-a0ed-42596f453e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:34.158832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c184-e350-4634-a0ed-42596f453e75 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:34.158832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c184-e350-4634-a0ed-42596f453e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:34.159079 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c184-e350-4634-a0ed-42596f453e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:34.160689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839c184-e350-4634-a0ed-42596f453e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:34.164378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839c184-e350-4634-a0ed-42596f453e75 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:34.190511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a3565-8ec0-4a7b-8209-b11bc7bb7d24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:34.192767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a3565-8ec0-4a7b-8209-b11bc7bb7d24 service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:34.208794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 851/1703] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:32:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:32:34.226940 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 853/1704] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:34 2022] POST /identity/v3/projects => generated 357 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:34.241982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e35c1-afd6-4f14-88f2-e28cd98cb091 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:34.241982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e35c1-afd6-4f14-88f2-e28cd98cb091 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:34.241982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e35c1-afd6-4f14-88f2-e28cd98cb091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:34.250891 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c8ff-cc52-49e1-bf3f-de59c22ce9d0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:34.251027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:34.251114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c8ff-cc52-49e1-bf3f-de59c22ce9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:34.251114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985c8ff-cc52-49e1-bf3f-de59c22ce9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:34.311324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0f3e35c1-afd6-4f14-88f2-e28cd98cb091 None None] MFA Rules not processed for user `ce09136115ce4b9ba54fe298325af294`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:34.315438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6985c8ff-cc52-49e1-bf3f-de59c22ce9d0 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:34.317539 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6985c8ff-cc52-49e1-bf3f-de59c22ce9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:34.318353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0f3e35c1-afd6-4f14-88f2-e28cd98cb091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:34.372648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:34.491701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 852/1705] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:34.492906 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985c8ff-cc52-49e1-bf3f-de59c22ce9d0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:34.511745 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 854/1706] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:34.532145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e35c1-afd6-4f14-88f2-e28cd98cb091 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:34.546380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985c8ff-cc52-49e1-bf3f-de59c22ce9d0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:34.559090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac416a-747e-4b12-a3c0-e45ed4435563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:34.561673 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac416a-747e-4b12-a3c0-e45ed4435563 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:34.562070 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac416a-747e-4b12-a3c0-e45ed4435563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:34.562797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac416a-747e-4b12-a3c0-e45ed4435563 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:34.564000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac416a-747e-4b12-a3c0-e45ed4435563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:34.565292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e35c1-afd6-4f14-88f2-e28cd98cb091 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:34.569811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac416a-747e-4b12-a3c0-e45ed4435563 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:34.581685 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cace3f5-ddc3-4467-be67-2e6cbab5ae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:34.582739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cace3f5-ddc3-4467-be67-2e6cbab5ae16 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:34.583308 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cace3f5-ddc3-4467-be67-2e6cbab5ae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:34.583699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cace3f5-ddc3-4467-be67-2e6cbab5ae16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:34.584779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cace3f5-ddc3-4467-be67-2e6cbab5ae16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:34.586831 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cace3f5-ddc3-4467-be67-2e6cbab5ae16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:34.588617 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cace3f5-ddc3-4467-be67-2e6cbab5ae16 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:34.619984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 853/1707] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:34 2022] POST /identity/v3/users => generated 279 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:34.624315 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac416a-747e-4b12-a3c0-e45ed4435563 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:34.642920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 855/1708] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:32:34.642920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cace3f5-ddc3-4467-be67-2e6cbab5ae16 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:34.643294 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-18ac416a-747e-4b12-a3c0-e45ed4435563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:34.671994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cace3f5-ddc3-4467-be67-2e6cbab5ae16 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:34.693109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8191d-e728-4871-a86f-a0550a5f8360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:34.693996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8191d-e728-4871-a86f-a0550a5f8360 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:34.694365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8191d-e728-4871-a86f-a0550a5f8360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:34.694751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8191d-e728-4871-a86f-a0550a5f8360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:34.695627 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8191d-e728-4871-a86f-a0550a5f8360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:34.697407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8191d-e728-4871-a86f-a0550a5f8360 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:34.723061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 856/1709] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:34.723061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8191d-e728-4871-a86f-a0550a5f8360 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:34.746517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8191d-e728-4871-a86f-a0550a5f8360 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:34.762539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bba6aa-b0f1-4c29-adda-58b41a9045d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:34.763364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bba6aa-b0f1-4c29-adda-58b41a9045d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:34.763754 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bba6aa-b0f1-4c29-adda-58b41a9045d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:34.764198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bba6aa-b0f1-4c29-adda-58b41a9045d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:34.765184 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bba6aa-b0f1-4c29-adda-58b41a9045d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:34.767662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bba6aa-b0f1-4c29-adda-58b41a9045d8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:34.820356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac416a-747e-4b12-a3c0-e45ed4435563 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:34.835949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cea602-5ba4-420c-aa7e-41f9367a30b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:34.836674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cea602-5ba4-420c-aa7e-41f9367a30b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:34.836991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cea602-5ba4-420c-aa7e-41f9367a30b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:34.837297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cea602-5ba4-420c-aa7e-41f9367a30b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:34.874110 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 857/1710] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:34 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:34.875067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bba6aa-b0f1-4c29-adda-58b41a9045d8 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:34.876698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cea602-5ba4-420c-aa7e-41f9367a30b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:34.899779 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cea602-5ba4-420c-aa7e-41f9367a30b4 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:34.954295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 854/1711] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:34.955607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cea602-5ba4-420c-aa7e-41f9367a30b4 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:34.971575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cea602-5ba4-420c-aa7e-41f9367a30b4 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:35.063746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb2632-7c1f-407e-9fea-63670b5406c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:35.065183 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb2632-7c1f-407e-9fea-63670b5406c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:35.065613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb2632-7c1f-407e-9fea-63670b5406c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:35.066001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb2632-7c1f-407e-9fea-63670b5406c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:35.068011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb2632-7c1f-407e-9fea-63670b5406c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:35.070983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb2632-7c1f-407e-9fea-63670b5406c9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:35.109516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 855/1712] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:34 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:35.110525 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb2632-7c1f-407e-9fea-63670b5406c9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:35.113423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-27fb2632-7c1f-407e-9fea-63670b5406c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:35.118683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bba6aa-b0f1-4c29-adda-58b41a9045d8 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:35.130859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb2632-7c1f-407e-9fea-63670b5406c9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:35.135462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd8fc7-3d86-4974-a666-b37949b3931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:35.136163 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd8fc7-3d86-4974-a666-b37949b3931d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:35.136448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd8fc7-3d86-4974-a666-b37949b3931d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:35.136740 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd8fc7-3d86-4974-a666-b37949b3931d admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:35.138471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:35.139591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:35.139776 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:35.140021 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] PATH_INFO: `/v3/projects/012c77c36c7a4325aaa900399324cdee` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:35.140688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd8fc7-3d86-4974-a666-b37949b3931d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:35.142336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=012c77c36c7a4325aaa900399324cdee)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:35.145870 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:35.149273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd8fc7-3d86-4974-a666-b37949b3931d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:35.179123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 858/1713] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:35.182591 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd8fc7-3d86-4974-a666-b37949b3931d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:35.223138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd8fc7-3d86-4974-a666-b37949b3931d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:35.239172 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd567c7-5fd8-432c-a867-878b86552650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:35.240212 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd567c7-5fd8-432c-a867-878b86552650 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:35.240491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd567c7-5fd8-432c-a867-878b86552650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:35.240791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd567c7-5fd8-432c-a867-878b86552650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:35.241807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd567c7-5fd8-432c-a867-878b86552650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:35.245472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd567c7-5fd8-432c-a867-878b86552650 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:35.272314 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:35.289755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012c77c36c7a4325aaa900399324cdee', 'request_id': 'req-11ccf996-3219-4fa2-9564-d5c9a705c6bd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:35.295825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 859/1714] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:35.298355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd567c7-5fd8-432c-a867-878b86552650 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:35.303539 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012c77c36c7a4325aaa900399324cdee', 'request_id': 'req-11ccf996-3219-4fa2-9564-d5c9a705c6bd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:35.319779 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012c77c36c7a4325aaa900399324cdee', 'request_id': 'req-11ccf996-3219-4fa2-9564-d5c9a705c6bd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:35.353079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] The token cache is being invalidate because project 012c77c36c7a4325aaa900399324cdee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:32:35.353406 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:35.355687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:35.365524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 856/1715] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:32:35 2022] DELETE /identity/v3/projects/012c77c36c7a4325aaa900399324cdee => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:35.366775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:35.369979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:35.432396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:35.518550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd567c7-5fd8-432c-a867-878b86552650 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:35.588847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccf996-3219-4fa2-9564-d5c9a705c6bd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:35.602148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef12ff2-da84-44aa-9d58-ebe2716e7686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:35.608067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef12ff2-da84-44aa-9d58-ebe2716e7686 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:35.609018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef12ff2-da84-44aa-9d58-ebe2716e7686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:35.609018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef12ff2-da84-44aa-9d58-ebe2716e7686 admin admin] PATH_INFO: `/v3/projects/e8711961542a4eba9a059f8da9115d68/users/b39805476b6f49f5b714923e4e56226b/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:35.676027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef12ff2-da84-44aa-9d58-ebe2716e7686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8711961542a4eba9a059f8da9115d68, user_id=b39805476b6f49f5b714923e4e56226b, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:35.684540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef12ff2-da84-44aa-9d58-ebe2716e7686 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:35.694981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb791f-78fb-44ba-86c7-caa4fdc58d77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:35.697948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb791f-78fb-44ba-86c7-caa4fdc58d77 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:35.698774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb791f-78fb-44ba-86c7-caa4fdc58d77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:35.699930 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb791f-78fb-44ba-86c7-caa4fdc58d77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:35.705192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ddbb791f-78fb-44ba-86c7-caa4fdc58d77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:35.726310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 857/1716] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:35 2022] PUT /identity/v3/projects/e8711961542a4eba9a059f8da9115d68/users/b39805476b6f49f5b714923e4e56226b/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:35.727360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef12ff2-da84-44aa-9d58-ebe2716e7686 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:35.730315 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cef12ff2-da84-44aa-9d58-ebe2716e7686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:35.926932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef12ff2-da84-44aa-9d58-ebe2716e7686 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:35.934570 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5851ef-61a5-4403-9f69-5381569ac3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:35.935393 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5851ef-61a5-4403-9f69-5381569ac3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:35.935780 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5851ef-61a5-4403-9f69-5381569ac3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:35.935969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5851ef-61a5-4403-9f69-5381569ac3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:35.936690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5851ef-61a5-4403-9f69-5381569ac3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:35.938803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5851ef-61a5-4403-9f69-5381569ac3b0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:35.962133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 858/1717] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:35.964483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a1839-c4ae-4732-aedb-4e68d8b4c663 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:35.965234 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a1839-c4ae-4732-aedb-4e68d8b4c663 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:35.965762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a1839-c4ae-4732-aedb-4e68d8b4c663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:36.018142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb791f-78fb-44ba-86c7-caa4fdc58d77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:36.021908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-733a1839-c4ae-4732-aedb-4e68d8b4c663 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:36.023008 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb791f-78fb-44ba-86c7-caa4fdc58d77 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:36.028288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-733a1839-c4ae-4732-aedb-4e68d8b4c663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:36.051447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 860/1718] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:36.053296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d5b21-936f-474e-967c-94bc9a8bc25b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:36.053806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d5b21-936f-474e-967c-94bc9a8bc25b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:36.054291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d5b21-936f-474e-967c-94bc9a8bc25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:36.073104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 859/1719] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:36.073104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e108cd-f4bd-4113-a029-367c431005f1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:36.073104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e108cd-f4bd-4113-a029-367c431005f1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:36.073104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e108cd-f4bd-4113-a029-367c431005f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:36.119810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3e1d5b21-936f-474e-967c-94bc9a8bc25b None None] MFA Rules not processed for user `b39805476b6f49f5b714923e4e56226b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:36.124757 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3e1d5b21-936f-474e-967c-94bc9a8bc25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:36.142764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-20e108cd-f4bd-4113-a029-367c431005f1 None None] MFA Rules not processed for user `d2ea8fd0ebfd42fdbed9a989d85c8787`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:36.146820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-20e108cd-f4bd-4113-a029-367c431005f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:36.294420 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:36.384388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 860/1720] 10.222.0.66 () {58 vars in 1015 bytes} [Thu May 26 12:32:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:36.391124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e108cd-f4bd-4113-a029-367c431005f1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:36.449686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 861/1721] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:36 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:36.451837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c5f13-c633-435e-9797-0963bd3cf20d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:36.452175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c5f13-c633-435e-9797-0963bd3cf20d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:36.452416 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c5f13-c633-435e-9797-0963bd3cf20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:36.482450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e108cd-f4bd-4113-a029-367c431005f1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:36.506297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aed43-2206-46ce-93b7-3fb42df0bd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:36.507220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aed43-2206-46ce-93b7-3fb42df0bd3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:36.507502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aed43-2206-46ce-93b7-3fb42df0bd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:36.507915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aed43-2206-46ce-93b7-3fb42df0bd3a admin admin] PATH_INFO: `/v3/projects/63450cb20d5b40838d84ec02179ba232/users/6d5078c1b2444f73a7d20d0726ebec36/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:36.538688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ac9c5f13-c633-435e-9797-0963bd3cf20d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:36.540274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ac9c5f13-c633-435e-9797-0963bd3cf20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:36.573866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7aed43-2206-46ce-93b7-3fb42df0bd3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63450cb20d5b40838d84ec02179ba232, user_id=6d5078c1b2444f73a7d20d0726ebec36, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:36.586307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7aed43-2206-46ce-93b7-3fb42df0bd3a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:36.586739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 862/1722] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:36.587645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c5f13-c633-435e-9797-0963bd3cf20d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:36.621737 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c5f13-c633-435e-9797-0963bd3cf20d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:36.640231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 861/1723] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:36 2022] PUT /identity/v3/projects/63450cb20d5b40838d84ec02179ba232/users/6d5078c1b2444f73a7d20d0726ebec36/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:36.640231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aed43-2206-46ce-93b7-3fb42df0bd3a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:36.640231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fa7aed43-2206-46ce-93b7-3fb42df0bd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:36.703120 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:36.859707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7a7ae-5e88-4ac4-8b8c-0651e2dacb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:36.860418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7a7ae-5e88-4ac4-8b8c-0651e2dacb9d admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:36.860689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7a7ae-5e88-4ac4-8b8c-0651e2dacb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:36.860996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7a7ae-5e88-4ac4-8b8c-0651e2dacb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:36.861716 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7a7ae-5e88-4ac4-8b8c-0651e2dacb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:36.873346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aed43-2206-46ce-93b7-3fb42df0bd3a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:36.874862 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7a7ae-5e88-4ac4-8b8c-0651e2dacb9d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:36.887720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f7f1c-f8f4-4f37-84e9-da53e701f3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:36.888461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f7f1c-f8f4-4f37-84e9-da53e701f3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:36.888800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f7f1c-f8f4-4f37-84e9-da53e701f3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:36.889087 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f7f1c-f8f4-4f37-84e9-da53e701f3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:36.925671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f7f1c-f8f4-4f37-84e9-da53e701f3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:36.929763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f7f1c-f8f4-4f37-84e9-da53e701f3d5 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:36.971438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 862/1724] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:36.975599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 863/1725] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:36 2022] POST /identity/v3/projects => generated 357 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:36.977277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7a7ae-5e88-4ac4-8b8c-0651e2dacb9d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:36.977606 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad74a1-773a-4dc7-a4fb-2737e46d7eea None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:36.978067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad74a1-773a-4dc7-a4fb-2737e46d7eea None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:36.978360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad74a1-773a-4dc7-a4fb-2737e46d7eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:37.085878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-27ad74a1-773a-4dc7-a4fb-2737e46d7eea None None] MFA Rules not processed for user `7b14606965a74c71881595c71bdd2d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:37.087432 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-27ad74a1-773a-4dc7-a4fb-2737e46d7eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:37.217460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7a7ae-5e88-4ac4-8b8c-0651e2dacb9d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:37.252800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065111d8-a56c-418a-9f02-ff9f8ef7850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:37.257559 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065111d8-a56c-418a-9f02-ff9f8ef7850d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:37.262244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065111d8-a56c-418a-9f02-ff9f8ef7850d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:37.264473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065111d8-a56c-418a-9f02-ff9f8ef7850d admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:37.269366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065111d8-a56c-418a-9f02-ff9f8ef7850d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:37.277801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065111d8-a56c-418a-9f02-ff9f8ef7850d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:37.293772 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065111d8-a56c-418a-9f02-ff9f8ef7850d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:37.348978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 863/1726] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:37.350527 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c249a-60c7-4e16-8c52-17ff30cf1c55 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:37.350826 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c249a-60c7-4e16-8c52-17ff30cf1c55 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:37.351117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c249a-60c7-4e16-8c52-17ff30cf1c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:37.374595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 864/1727] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:32:37.374595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065111d8-a56c-418a-9f02-ff9f8ef7850d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:37.403031 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065111d8-a56c-418a-9f02-ff9f8ef7850d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:37.420927 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d104436-f165-421e-83ec-3bedf1d0ae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:37.422216 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d104436-f165-421e-83ec-3bedf1d0ae99 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:37.422216 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d104436-f165-421e-83ec-3bedf1d0ae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:37.422439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d104436-f165-421e-83ec-3bedf1d0ae99 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:37.423151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d104436-f165-421e-83ec-3bedf1d0ae99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:37.432384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d104436-f165-421e-83ec-3bedf1d0ae99 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:37.446159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-746c249a-60c7-4e16-8c52-17ff30cf1c55 None None] MFA Rules not processed for user `6d5078c1b2444f73a7d20d0726ebec36`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:37.450868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-746c249a-60c7-4e16-8c52-17ff30cf1c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:37.494532 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 865/1728] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:37 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:37.496103 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d104436-f165-421e-83ec-3bedf1d0ae99 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:37.505453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6d104436-f165-421e-83ec-3bedf1d0ae99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:37.628601 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:37.703025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 864/1729] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:37.703025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c249a-60c7-4e16-8c52-17ff30cf1c55 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:37.710101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d104436-f165-421e-83ec-3bedf1d0ae99 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:37.732953 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45435fea-9028-4b7d-a66f-91ec4b0dc3cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:37.733663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45435fea-9028-4b7d-a66f-91ec4b0dc3cd service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:37.733979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45435fea-9028-4b7d-a66f-91ec4b0dc3cd service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:37.734232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45435fea-9028-4b7d-a66f-91ec4b0dc3cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:37.754062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c249a-60c7-4e16-8c52-17ff30cf1c55 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:37.757859 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45435fea-9028-4b7d-a66f-91ec4b0dc3cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:37.760183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45435fea-9028-4b7d-a66f-91ec4b0dc3cd service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:37.772314 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f542-215d-480c-931f-34c1ab6cecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:37.773905 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f542-215d-480c-931f-34c1ab6cecce admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:37.774202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f542-215d-480c-931f-34c1ab6cecce admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:37.774496 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f542-215d-480c-931f-34c1ab6cecce admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:37.775219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902f542-215d-480c-931f-34c1ab6cecce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:37.785962 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902f542-215d-480c-931f-34c1ab6cecce admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:37.786743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 866/1730] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:37.800074 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45435fea-9028-4b7d-a66f-91ec4b0dc3cd service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:37.847797 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45435fea-9028-4b7d-a66f-91ec4b0dc3cd service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:37.865795 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efa57e-0368-4cc7-96da-53f4af0621d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:37.867125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efa57e-0368-4cc7-96da-53f4af0621d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:37.867125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efa57e-0368-4cc7-96da-53f4af0621d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:37.867125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efa57e-0368-4cc7-96da-53f4af0621d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:37.867365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efa57e-0368-4cc7-96da-53f4af0621d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:37.881717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96efa57e-0368-4cc7-96da-53f4af0621d0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:37.886358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 865/1731] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:37 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:37.889004 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:37.891678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f542-215d-480c-931f-34c1ab6cecce admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:37.930523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 867/1732] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:37.935592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efa57e-0368-4cc7-96da-53f4af0621d0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:37.978077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efa57e-0368-4cc7-96da-53f4af0621d0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:38.112777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f542-215d-480c-931f-34c1ab6cecce admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:38.136127 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562b8f7-b7b5-4a78-98f3-abb5c17f2780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:38.136860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562b8f7-b7b5-4a78-98f3-abb5c17f2780 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:38.137724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562b8f7-b7b5-4a78-98f3-abb5c17f2780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:38.143663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562b8f7-b7b5-4a78-98f3-abb5c17f2780 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:38.150552 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562b8f7-b7b5-4a78-98f3-abb5c17f2780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:38.153039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562b8f7-b7b5-4a78-98f3-abb5c17f2780 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:38.203351 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d63f3-3b10-4272-bc16-bcec594c406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:38.204211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d63f3-3b10-4272-bc16-bcec594c406f admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:38.204492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d63f3-3b10-4272-bc16-bcec594c406f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:38.204788 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d63f3-3b10-4272-bc16-bcec594c406f admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:38.205509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d63f3-3b10-4272-bc16-bcec594c406f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:38.207520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d63f3-3b10-4272-bc16-bcec594c406f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:38.256017 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 866/1733] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:37 2022] POST /identity/v3/projects => generated 365 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:38.257337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562b8f7-b7b5-4a78-98f3-abb5c17f2780 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:38.269637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 868/1734] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:37 2022] POST /identity/v3/users => generated 294 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:38.272694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d63f3-3b10-4272-bc16-bcec594c406f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:38.303338 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d63f3-3b10-4272-bc16-bcec594c406f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:38.424732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66ce58-9740-43db-8a1b-2fd25730b16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:38.425613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66ce58-9740-43db-8a1b-2fd25730b16d admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:38.426014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66ce58-9740-43db-8a1b-2fd25730b16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:38.426913 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66ce58-9740-43db-8a1b-2fd25730b16d admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:38.427992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66ce58-9740-43db-8a1b-2fd25730b16d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:38.430165 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66ce58-9740-43db-8a1b-2fd25730b16d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:38.500443 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 869/1735] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:38 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:38.501307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66ce58-9740-43db-8a1b-2fd25730b16d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:38.513607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562b8f7-b7b5-4a78-98f3-abb5c17f2780 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:38.527825 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c3963-3fee-41dc-adc9-bf9756bb3c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:38.529922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c3963-3fee-41dc-adc9-bf9756bb3c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:38.530470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c3963-3fee-41dc-adc9-bf9756bb3c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:38.531161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c3963-3fee-41dc-adc9-bf9756bb3c08 admin admin] PATH_INFO: `/v3/projects/19c977441f454231922455a6638b7336/users/072faa07eb8f4c88bc3eb89340071f6a/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:38.566585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c3963-3fee-41dc-adc9-bf9756bb3c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c977441f454231922455a6638b7336, user_id=072faa07eb8f4c88bc3eb89340071f6a, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:38.569150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66ce58-9740-43db-8a1b-2fd25730b16d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:38.573149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c3963-3fee-41dc-adc9-bf9756bb3c08 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:38.604029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129dd26-bfa1-4932-8500-961f55d0836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:38.605946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129dd26-bfa1-4932-8500-961f55d0836d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:38.616646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129dd26-bfa1-4932-8500-961f55d0836d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:38.617905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129dd26-bfa1-4932-8500-961f55d0836d admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:38.618832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129dd26-bfa1-4932-8500-961f55d0836d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:38.622296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129dd26-bfa1-4932-8500-961f55d0836d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:38.636807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 867/1736] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:38 2022] PUT /identity/v3/projects/19c977441f454231922455a6638b7336/users/072faa07eb8f4c88bc3eb89340071f6a/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:38.636807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c3963-3fee-41dc-adc9-bf9756bb3c08 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:38.679981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 870/1737] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:38.683480 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129dd26-bfa1-4932-8500-961f55d0836d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:38.718420 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129dd26-bfa1-4932-8500-961f55d0836d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:38.767819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:38.861376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c3963-3fee-41dc-adc9-bf9756bb3c08 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:38.874350 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8aa39-33a5-48e9-ae13-fb0455c1f7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:38.875047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8aa39-33a5-48e9-ae13-fb0455c1f7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:38.875447 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8aa39-33a5-48e9-ae13-fb0455c1f7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:38.877061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8aa39-33a5-48e9-ae13-fb0455c1f7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:38.882249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8aa39-33a5-48e9-ae13-fb0455c1f7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:38.885916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8aa39-33a5-48e9-ae13-fb0455c1f7ea admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:38.939545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 868/1738] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:38.940815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8aa39-33a5-48e9-ae13-fb0455c1f7ea admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:38.969550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8aa39-33a5-48e9-ae13-fb0455c1f7ea admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:38.983002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a88e9-4ac0-43a2-acb7-56e0b9023d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:38.983713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a88e9-4ac0-43a2-acb7-56e0b9023d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:38.984005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a88e9-4ac0-43a2-acb7-56e0b9023d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:38.984289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a88e9-4ac0-43a2-acb7-56e0b9023d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:38.985345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a88e9-4ac0-43a2-acb7-56e0b9023d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:38.990221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a88e9-4ac0-43a2-acb7-56e0b9023d16 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:39.016209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 869/1739] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:39.018327 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a88e9-4ac0-43a2-acb7-56e0b9023d16 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:39.026094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e556580-176f-4171-9b48-58b8a8d46294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:39.028095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e556580-176f-4171-9b48-58b8a8d46294 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:39.029043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e556580-176f-4171-9b48-58b8a8d46294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:39.032939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e556580-176f-4171-9b48-58b8a8d46294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:39.034056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e556580-176f-4171-9b48-58b8a8d46294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:39.043290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a88e9-4ac0-43a2-acb7-56e0b9023d16 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:39.044441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e556580-176f-4171-9b48-58b8a8d46294 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:39.055644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082612f-faa6-4315-86f5-7446b54a29b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:39.056627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082612f-faa6-4315-86f5-7446b54a29b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:39.056980 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082612f-faa6-4315-86f5-7446b54a29b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:39.058438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082612f-faa6-4315-86f5-7446b54a29b1 admin admin] PATH_INFO: `/v3/projects/a18074b39a68400098bf1b8132d0d75b/users/c9104325c3294947a2287383d5d5f173/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:39.084905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 871/1740] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:39.095318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e556580-176f-4171-9b48-58b8a8d46294 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:39.096082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082612f-faa6-4315-86f5-7446b54a29b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18074b39a68400098bf1b8132d0d75b, user_id=c9104325c3294947a2287383d5d5f173, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:39.098829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082612f-faa6-4315-86f5-7446b54a29b1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:39.111539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:39.130931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e556580-176f-4171-9b48-58b8a8d46294 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:39.136092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 870/1741] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:39 2022] PUT /identity/v3/projects/a18074b39a68400098bf1b8132d0d75b/users/c9104325c3294947a2287383d5d5f173/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:39.137631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082612f-faa6-4315-86f5-7446b54a29b1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:39.364938 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c8685-82d0-4c94-b960-5ce892cf62b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:39.376550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c8685-82d0-4c94-b960-5ce892cf62b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:39.386326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c8685-82d0-4c94-b960-5ce892cf62b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:39.386326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c8685-82d0-4c94-b960-5ce892cf62b2 admin admin] PATH_INFO: `/v3/projects/72cb9e3ba31a415c9c01e53836b7a277/users/af8552b5bfa942679cde3b10b43c6f3c/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:39.404807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082612f-faa6-4315-86f5-7446b54a29b1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:39.429445 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de1e31-91d1-42e1-a35a-a87b5d5fa4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:39.431360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de1e31-91d1-42e1-a35a-a87b5d5fa4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:39.431800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de1e31-91d1-42e1-a35a-a87b5d5fa4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:39.433434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de1e31-91d1-42e1-a35a-a87b5d5fa4d7 admin admin] PATH_INFO: `/v3/projects/19c977441f454231922455a6638b7336/users/072faa07eb8f4c88bc3eb89340071f6a/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:39.437387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de1e31-91d1-42e1-a35a-a87b5d5fa4d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c977441f454231922455a6638b7336, user_id=072faa07eb8f4c88bc3eb89340071f6a, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:39.441830 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de1e31-91d1-42e1-a35a-a87b5d5fa4d7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:39.491420 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c8685-82d0-4c94-b960-5ce892cf62b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72cb9e3ba31a415c9c01e53836b7a277, user_id=af8552b5bfa942679cde3b10b43c6f3c, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:39.504047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c8685-82d0-4c94-b960-5ce892cf62b2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:39.506684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 871/1742] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:39 2022] PUT /identity/v3/projects/19c977441f454231922455a6638b7336/users/072faa07eb8f4c88bc3eb89340071f6a/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:39.508267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de1e31-91d1-42e1-a35a-a87b5d5fa4d7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:39.577564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 872/1743] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:39 2022] PUT /identity/v3/projects/72cb9e3ba31a415c9c01e53836b7a277/users/af8552b5bfa942679cde3b10b43c6f3c/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:39.579319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89647a-6edd-428b-8c95-b5603decb93f None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:39.587972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89647a-6edd-428b-8c95-b5603decb93f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:39.588451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89647a-6edd-428b-8c95-b5603decb93f None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:39.594928 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 873/1744] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:32:39 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:39.601011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f50f77-b666-4961-a7ad-74e9f62cd203 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:39.608929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f50f77-b666-4961-a7ad-74e9f62cd203 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:39.608929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f50f77-b666-4961-a7ad-74e9f62cd203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:39.713777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-45f50f77-b666-4961-a7ad-74e9f62cd203 None None] MFA Rules not processed for user `072faa07eb8f4c88bc3eb89340071f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:39.719040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-45f50f77-b666-4961-a7ad-74e9f62cd203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:39.793064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de1e31-91d1-42e1-a35a-a87b5d5fa4d7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:39.917835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:40.010524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec72f02-1900-460e-9689-25fe9919b9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:40.012694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec72f02-1900-460e-9689-25fe9919b9ec admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:40.013031 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec72f02-1900-460e-9689-25fe9919b9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:40.013311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec72f02-1900-460e-9689-25fe9919b9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:40.014071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec72f02-1900-460e-9689-25fe9919b9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:40.015723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec72f02-1900-460e-9689-25fe9919b9ec admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:40.075190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 874/1745] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:40.082992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84923-788a-4c8a-a900-257ef040dd10 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:40.083328 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84923-788a-4c8a-a900-257ef040dd10 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:40.083572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84923-788a-4c8a-a900-257ef040dd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:40.120287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 872/1746] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 613 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:40.130407 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1425-7487-47cf-8d2a-c34e34881dcd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:40.130707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1425-7487-47cf-8d2a-c34e34881dcd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:40.130995 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1425-7487-47cf-8d2a-c34e34881dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:40.200851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-29f84923-788a-4c8a-a900-257ef040dd10 None None] MFA Rules not processed for user `af8552b5bfa942679cde3b10b43c6f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:40.204911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-29f84923-788a-4c8a-a900-257ef040dd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:40.205040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-dd1a1425-7487-47cf-8d2a-c34e34881dcd None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:40.205725 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dd1a1425-7487-47cf-8d2a-c34e34881dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:40.435162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 873/1747] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:40.436090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a1425-7487-47cf-8d2a-c34e34881dcd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:40.441608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dd1a1425-7487-47cf-8d2a-c34e34881dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:40.626066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:40.646744 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 875/1748] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 571 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:40.648032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84923-788a-4c8a-a900-257ef040dd10 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:40.696739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84923-788a-4c8a-a900-257ef040dd10 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:40.710706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a1425-7487-47cf-8d2a-c34e34881dcd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:40.711124 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b818350-5e33-44a6-8626-ebd7204bc5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:40.712117 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b818350-5e33-44a6-8626-ebd7204bc5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:40.712520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b818350-5e33-44a6-8626-ebd7204bc5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:40.712932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b818350-5e33-44a6-8626-ebd7204bc5e4 admin admin] PATH_INFO: `/v3/projects/a18074b39a68400098bf1b8132d0d75b/users/c9104325c3294947a2287383d5d5f173/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:40.716854 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b818350-5e33-44a6-8626-ebd7204bc5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18074b39a68400098bf1b8132d0d75b, user_id=c9104325c3294947a2287383d5d5f173, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:40.727457 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b818350-5e33-44a6-8626-ebd7204bc5e4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:40.734620 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c941b13-4a3d-4900-847c-9885414a3b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:40.735502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c941b13-4a3d-4900-847c-9885414a3b83 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:40.738074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c941b13-4a3d-4900-847c-9885414a3b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:40.738550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c941b13-4a3d-4900-847c-9885414a3b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:40.765519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 876/1749] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:40 2022] PUT /identity/v3/projects/a18074b39a68400098bf1b8132d0d75b/users/c9104325c3294947a2287383d5d5f173/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:40.766873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b818350-5e33-44a6-8626-ebd7204bc5e4 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:40.775899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2b818350-5e33-44a6-8626-ebd7204bc5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:40.789457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c941b13-4a3d-4900-847c-9885414a3b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:40.790958 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c941b13-4a3d-4900-847c-9885414a3b83 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:40.847331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 874/1750] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:40 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:40.848299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c941b13-4a3d-4900-847c-9885414a3b83 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:40.873485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c941b13-4a3d-4900-847c-9885414a3b83 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:41.044993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a91c6-a279-4391-b079-80eae50382ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:41.047729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a91c6-a279-4391-b079-80eae50382ec admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:41.048022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a91c6-a279-4391-b079-80eae50382ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:41.048426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a91c6-a279-4391-b079-80eae50382ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:41.049077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a91c6-a279-4391-b079-80eae50382ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:41.051441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a91c6-a279-4391-b079-80eae50382ec admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:41.081458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:41.097584 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b818350-5e33-44a6-8626-ebd7204bc5e4 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:41.117931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059f5d7-f4bf-4e6b-9f70-c22ee0b55627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:41.122045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059f5d7-f4bf-4e6b-9f70-c22ee0b55627 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:41.122045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059f5d7-f4bf-4e6b-9f70-c22ee0b55627 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:41.122045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059f5d7-f4bf-4e6b-9f70-c22ee0b55627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:41.127918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 875/1751] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:40 2022] POST /identity/v3/projects => generated 383 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:41.130340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2413f-dad6-45bc-bc9a-f525409466a8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:41.132285 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2413f-dad6-45bc-bc9a-f525409466a8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:41.132685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2413f-dad6-45bc-bc9a-f525409466a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:41.152497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059f5d7-f4bf-4e6b-9f70-c22ee0b55627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:41.160586 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059f5d7-f4bf-4e6b-9f70-c22ee0b55627 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:41.199620 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 877/1752] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:41.202142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059f5d7-f4bf-4e6b-9f70-c22ee0b55627 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:41.211524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-45d2413f-dad6-45bc-bc9a-f525409466a8 None None] MFA Rules not processed for user `c9104325c3294947a2287383d5d5f173`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:41.217380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-45d2413f-dad6-45bc-bc9a-f525409466a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:41.396296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059f5d7-f4bf-4e6b-9f70-c22ee0b55627 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:41.426502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 876/1753] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:41.428320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2413f-dad6-45bc-bc9a-f525409466a8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:41.631817 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f7436-2dfa-45f9-8d81-21683229329f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:41.632814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f7436-2dfa-45f9-8d81-21683229329f service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:41.633251 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f7436-2dfa-45f9-8d81-21683229329f service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:41.633632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f7436-2dfa-45f9-8d81-21683229329f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:41.683008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2413f-dad6-45bc-bc9a-f525409466a8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:41.718034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253888-d0e4-4a7d-a292-81e9841489ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:41.719230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253888-d0e4-4a7d-a292-81e9841489ce admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:41.720588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253888-d0e4-4a7d-a292-81e9841489ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:41.721392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253888-d0e4-4a7d-a292-81e9841489ce admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:41.722503 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20253888-d0e4-4a7d-a292-81e9841489ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:41.726633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20253888-d0e4-4a7d-a292-81e9841489ce admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:41.789793 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 877/1754] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:41 2022] POST /identity/v3/users => generated 298 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:41.790893 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253888-d0e4-4a7d-a292-81e9841489ce admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:41.801776 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-20253888-d0e4-4a7d-a292-81e9841489ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:41.837125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:41.849992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253888-d0e4-4a7d-a292-81e9841489ce admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:41.863826 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c7124-b483-4946-9cf0-146b42fba0c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:41.864878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7124-b483-4946-9cf0-146b42fba0c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:41.875861 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7124-b483-4946-9cf0-146b42fba0c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:41.876600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c7124-b483-4946-9cf0-146b42fba0c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:41.889395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c7124-b483-4946-9cf0-146b42fba0c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:41.899490 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c7124-b483-4946-9cf0-146b42fba0c5 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:41.940460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f7436-2dfa-45f9-8d81-21683229329f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:41.950622 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 878/1755] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:41.952547 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c7124-b483-4946-9cf0-146b42fba0c5 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:41.955992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f7436-2dfa-45f9-8d81-21683229329f service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:41.993334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c7124-b483-4946-9cf0-146b42fba0c5 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:42.023666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 878/1756] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 822 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:42.026601 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f94a07-4095-4e96-bd04-55d06d209f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:42.027615 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94a07-4095-4e96-bd04-55d06d209f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:42.029925 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94a07-4095-4e96-bd04-55d06d209f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:42.030246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94a07-4095-4e96-bd04-55d06d209f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:42.031075 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f94a07-4095-4e96-bd04-55d06d209f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:42.044652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f94a07-4095-4e96-bd04-55d06d209f7f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:42.133784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 879/1757] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:42.134078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f7436-2dfa-45f9-8d81-21683229329f service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:42.162000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f7436-2dfa-45f9-8d81-21683229329f service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:42.199065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1e832-d20d-4f06-8656-be55eddf19ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:42.228158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1e832-d20d-4f06-8656-be55eddf19ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:42.230965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1e832-d20d-4f06-8656-be55eddf19ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:42.233926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1e832-d20d-4f06-8656-be55eddf19ad admin admin] PATH_INFO: `/v3/projects/a4363325cb9d4cababebc1612eba707c/users/339781a4ebe54512824a1950fe9a3953/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:42.321451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1e832-d20d-4f06-8656-be55eddf19ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4363325cb9d4cababebc1612eba707c, user_id=339781a4ebe54512824a1950fe9a3953, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:42.331623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1e832-d20d-4f06-8656-be55eddf19ad admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:42.391251 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 879/1758] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:42 2022] PUT /identity/v3/projects/a4363325cb9d4cababebc1612eba707c/users/339781a4ebe54512824a1950fe9a3953/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:32:42.392662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f94a07-4095-4e96-bd04-55d06d209f7f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:42.419232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f94a07-4095-4e96-bd04-55d06d209f7f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:42.455180 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1e832-d20d-4f06-8656-be55eddf19ad admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:42.535566 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:42.636871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1e832-d20d-4f06-8656-be55eddf19ad admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:42.648862 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951738c2-39f5-490f-ae2e-a5ccaf1b2fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:42.649603 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67938201-2a9d-42b9-b756-88ff0c245f47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:42.650425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67938201-2a9d-42b9-b756-88ff0c245f47 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:42.650760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67938201-2a9d-42b9-b756-88ff0c245f47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:42.651134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67938201-2a9d-42b9-b756-88ff0c245f47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:42.651262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951738c2-39f5-490f-ae2e-a5ccaf1b2fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:42.653287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951738c2-39f5-490f-ae2e-a5ccaf1b2fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:42.654986 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951738c2-39f5-490f-ae2e-a5ccaf1b2fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:42.656483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951738c2-39f5-490f-ae2e-a5ccaf1b2fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:42.662603 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951738c2-39f5-490f-ae2e-a5ccaf1b2fbd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:42.699398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 880/1759] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:42.702547 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951738c2-39f5-490f-ae2e-a5ccaf1b2fbd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:42.763502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951738c2-39f5-490f-ae2e-a5ccaf1b2fbd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:42.792681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982494-a332-4237-9f93-d9b26e91ef94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:42.800253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982494-a332-4237-9f93-d9b26e91ef94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:42.800561 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982494-a332-4237-9f93-d9b26e91ef94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:42.800884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c982494-a332-4237-9f93-d9b26e91ef94 admin admin] PATH_INFO: `/v3/projects/a4363325cb9d4cababebc1612eba707c/users/339781a4ebe54512824a1950fe9a3953/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:42.804386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67938201-2a9d-42b9-b756-88ff0c245f47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:42.805980 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67938201-2a9d-42b9-b756-88ff0c245f47 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:42.810519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c982494-a332-4237-9f93-d9b26e91ef94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4363325cb9d4cababebc1612eba707c, user_id=339781a4ebe54512824a1950fe9a3953, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:42.813415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c982494-a332-4237-9f93-d9b26e91ef94 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:42.853537 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 880/1760] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:32:42.868653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 881/1761] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:42 2022] PUT /identity/v3/projects/a4363325cb9d4cababebc1612eba707c/users/339781a4ebe54512824a1950fe9a3953/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:42.895386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7c523-f3a3-457f-a81c-dba7e85cebd3 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:42.896570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7c523-f3a3-457f-a81c-dba7e85cebd3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:42.897667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7c523-f3a3-457f-a81c-dba7e85cebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:43.036838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a4c7c523-f3a3-457f-a81c-dba7e85cebd3 None None] MFA Rules not processed for user `339781a4ebe54512824a1950fe9a3953`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:43.038416 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a4c7c523-f3a3-457f-a81c-dba7e85cebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:43.424517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:43.436226 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 881/1762] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 549 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:43.447117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982494-a332-4237-9f93-d9b26e91ef94 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:43.609774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c982494-a332-4237-9f93-d9b26e91ef94 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:43.647614 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac62cd-608b-4aca-b058-ddb6a96edd26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:43.649788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac62cd-608b-4aca-b058-ddb6a96edd26 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:43.650843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac62cd-608b-4aca-b058-ddb6a96edd26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:43.652536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac62cd-608b-4aca-b058-ddb6a96edd26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:43.685235 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac62cd-608b-4aca-b058-ddb6a96edd26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:43.692427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac62cd-608b-4aca-b058-ddb6a96edd26 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:43.728028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 882/1763] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:44.942025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7c523-f3a3-457f-a81c-dba7e85cebd3 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:45.194218 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7c523-f3a3-457f-a81c-dba7e85cebd3 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:45.203722 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:45.204633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:45.205064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:45.205225 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] PATH_INFO: `/v3/users/af8552b5bfa942679cde3b10b43c6f3c` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:45.220270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8552b5bfa942679cde3b10b43c6f3c)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:45.232121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:45.372178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8552b5bfa942679cde3b10b43c6f3c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:45.373374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8552b5bfa942679cde3b10b43c6f3c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:45.374128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8552b5bfa942679cde3b10b43c6f3c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:45.408567 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8552b5bfa942679cde3b10b43c6f3c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:45.419053 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8552b5bfa942679cde3b10b43c6f3c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:45.446851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 882/1764] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:32:44 2022] DELETE /identity/v3/users/af8552b5bfa942679cde3b10b43c6f3c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:45.452703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9762f66-55e5-4e58-acc4-d106575084dc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:45.453244 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9762f66-55e5-4e58-acc4-d106575084dc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:45.453621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9762f66-55e5-4e58-acc4-d106575084dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:45.481700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d9762f66-55e5-4e58-acc4-d106575084dc None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:45.483234 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d9762f66-55e5-4e58-acc4-d106575084dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:45.570176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 883/1765] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:45.581947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:45.583472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:45.651505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff03f2-4fa3-468f-ab67-209771529cc4 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:45.657629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d82ac-82df-465d-9e1c-18ae4c9ff071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:45.658314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d82ac-82df-465d-9e1c-18ae4c9ff071 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:45.659185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d82ac-82df-465d-9e1c-18ae4c9ff071 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:45.659482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d82ac-82df-465d-9e1c-18ae4c9ff071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:45.670712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d82ac-82df-465d-9e1c-18ae4c9ff071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:45.672150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d82ac-82df-465d-9e1c-18ae4c9ff071 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:45.684849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 883/1766] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:45.695191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be4eb-3058-498a-ae28-78d6eea3abec None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:45.695521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be4eb-3058-498a-ae28-78d6eea3abec None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:45.696108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338be4eb-3058-498a-ae28-78d6eea3abec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:45.754222 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-338be4eb-3058-498a-ae28-78d6eea3abec None None] MFA Rules not processed for user `c21602eca99d48d8824c0f5c1693d573`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:45.755829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-338be4eb-3058-498a-ae28-78d6eea3abec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:45.923240 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:45.951506 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 884/1767] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:45.955119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef3dfc-89f0-4af4-9bbf-6e889a619b0d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:45.955611 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef3dfc-89f0-4af4-9bbf-6e889a619b0d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:45.955686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef3dfc-89f0-4af4-9bbf-6e889a619b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:45.988427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-46ef3dfc-89f0-4af4-9bbf-6e889a619b0d None None] MFA Rules not processed for user `c21602eca99d48d8824c0f5c1693d573`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:45.990645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-46ef3dfc-89f0-4af4-9bbf-6e889a619b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:46.020843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 884/1768] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:46.025104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba93fb9-4243-4135-a0de-48cedc6d0c80 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:46.025610 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba93fb9-4243-4135-a0de-48cedc6d0c80 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:46.025898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba93fb9-4243-4135-a0de-48cedc6d0c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:46.040389 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef3dfc-89f0-4af4-9bbf-6e889a619b0d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:46.044238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-46ef3dfc-89f0-4af4-9bbf-6e889a619b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:46.087132 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:46.101834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6ba93fb9-4243-4135-a0de-48cedc6d0c80 None None] MFA Rules not processed for user `c90e6a7a7265480ca4c817d633da4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:46.104013 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6ba93fb9-4243-4135-a0de-48cedc6d0c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:46.234992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef3dfc-89f0-4af4-9bbf-6e889a619b0d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:46.255098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde3abe-0fab-409a-af83-960c35f03cdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:46.264281 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde3abe-0fab-409a-af83-960c35f03cdc service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:46.264580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde3abe-0fab-409a-af83-960c35f03cdc service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:46.264910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde3abe-0fab-409a-af83-960c35f03cdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:46.300156 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde3abe-0fab-409a-af83-960c35f03cdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:46.307550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde3abe-0fab-409a-af83-960c35f03cdc service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:46.316802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 885/1769] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:46.334737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba93fb9-4243-4135-a0de-48cedc6d0c80 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:46.337102 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6ba93fb9-4243-4135-a0de-48cedc6d0c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:46.351590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 885/1770] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:46.353941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde3abe-0fab-409a-af83-960c35f03cdc service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:46.359764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dcde3abe-0fab-409a-af83-960c35f03cdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:46.389187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba93fb9-4243-4135-a0de-48cedc6d0c80 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:46.419801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde3abe-0fab-409a-af83-960c35f03cdc service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:46.426471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cbf48-73e7-473e-a231-f7887922659f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:46.427089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cbf48-73e7-473e-a231-f7887922659f service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:46.427376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cbf48-73e7-473e-a231-f7887922659f service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:46.427656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cbf48-73e7-473e-a231-f7887922659f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:46.435368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:46.436430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:46.436533 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:46.437104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8 admin admin] PATH_INFO: `/v3/projects/72cb9e3ba31a415c9c01e53836b7a277` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:46.446263 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72cb9e3ba31a415c9c01e53836b7a277)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:46.452742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:46.460948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cbf48-73e7-473e-a231-f7887922659f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:46.475075 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cbf48-73e7-473e-a231-f7887922659f service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:46.513169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 886/1771] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:46.602877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72cb9e3ba31a415c9c01e53836b7a277', 'request_id': 'req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:46.623108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72cb9e3ba31a415c9c01e53836b7a277', 'request_id': 'req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:46.639170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72cb9e3ba31a415c9c01e53836b7a277', 'request_id': 'req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:46.676825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8 admin admin] The token cache is being invalidate because project 72cb9e3ba31a415c9c01e53836b7a277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:32:46.677493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:46.679229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-fe6b970c-3c54-4d8c-af4f-d0118c35d3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:46.684540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 886/1772] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:32:46 2022] DELETE /identity/v3/projects/72cb9e3ba31a415c9c01e53836b7a277 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:46.689015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cbf48-73e7-473e-a231-f7887922659f service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:46.718531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cbf48-73e7-473e-a231-f7887922659f service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:46.770726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1104a6-ce41-462c-9118-67a00e1421e5 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:46.771055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1104a6-ce41-462c-9118-67a00e1421e5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:46.771300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1104a6-ce41-462c-9118-67a00e1421e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:46.805064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-cf1104a6-ce41-462c-9118-67a00e1421e5 None None] MFA Rules not processed for user `7b14606965a74c71881595c71bdd2d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:46.806306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cf1104a6-ce41-462c-9118-67a00e1421e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:46.924762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212b2eb-de7e-4144-a526-2f544f1c8709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:46.925704 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212b2eb-de7e-4144-a526-2f544f1c8709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:46.928620 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212b2eb-de7e-4144-a526-2f544f1c8709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:46.929672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212b2eb-de7e-4144-a526-2f544f1c8709 admin admin] PATH_INFO: `/v3/users/339781a4ebe54512824a1950fe9a3953` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:46.933353 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212b2eb-de7e-4144-a526-2f544f1c8709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=339781a4ebe54512824a1950fe9a3953)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:46.939494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212b2eb-de7e-4144-a526-2f544f1c8709 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:46.986660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 887/1773] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:32:47.098428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2212b2eb-de7e-4144-a526-2f544f1c8709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '339781a4ebe54512824a1950fe9a3953'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:47.100276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2212b2eb-de7e-4144-a526-2f544f1c8709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '339781a4ebe54512824a1950fe9a3953'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:47.101889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2212b2eb-de7e-4144-a526-2f544f1c8709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '339781a4ebe54512824a1950fe9a3953'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:47.127475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2212b2eb-de7e-4144-a526-2f544f1c8709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '339781a4ebe54512824a1950fe9a3953'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:47.139249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2212b2eb-de7e-4144-a526-2f544f1c8709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '339781a4ebe54512824a1950fe9a3953'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:47.142627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:47.183272 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 887/1774] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:32:46 2022] DELETE /identity/v3/users/339781a4ebe54512824a1950fe9a3953 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:48.237253 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7fe74-5167-492d-bc5f-e5d45f85d889 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:48.238143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7fe74-5167-492d-bc5f-e5d45f85d889 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:48.238600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7fe74-5167-492d-bc5f-e5d45f85d889 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:48.240571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 888/1775] 10.222.0.39 () {54 vars in 912 bytes} [Thu May 26 12:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:32:48.248308 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d2c3c-019b-4a28-aa75-cbcfc1f2a495 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:48.249311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d2c3c-019b-4a28-aa75-cbcfc1f2a495 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:48.249824 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d2c3c-019b-4a28-aa75-cbcfc1f2a495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:48.319816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e08d2c3c-019b-4a28-aa75-cbcfc1f2a495 None None] MFA Rules not processed for user `d2ea8fd0ebfd42fdbed9a989d85c8787`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:48.329038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e08d2c3c-019b-4a28-aa75-cbcfc1f2a495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:48.506160 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ac3c-782b-4823-ab3e-7b99e6e0b0eb None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:48.506911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ac3c-782b-4823-ab3e-7b99e6e0b0eb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:48.507441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72ac3c-782b-4823-ab3e-7b99e6e0b0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:48.529298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0c72ac3c-782b-4823-ab3e-7b99e6e0b0eb None None] MFA Rules not processed for user `c21602eca99d48d8824c0f5c1693d573`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:48.531417 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0c72ac3c-782b-4823-ab3e-7b99e6e0b0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:48.571161 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:48.587393 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 888/1776] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:32:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:32:48.588376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d2c3c-019b-4a28-aa75-cbcfc1f2a495 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:48.594419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e08d2c3c-019b-4a28-aa75-cbcfc1f2a495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:48.799380 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 889/1777] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:32:48.799380 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72ac3c-782b-4823-ab3e-7b99e6e0b0eb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:48.819689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0c72ac3c-782b-4823-ab3e-7b99e6e0b0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:48.869928 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d2c3c-019b-4a28-aa75-cbcfc1f2a495 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:48.900481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e3166-67b8-40d0-82a7-46e80baca15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:48.902503 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3166-67b8-40d0-82a7-46e80baca15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:48.903011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3166-67b8-40d0-82a7-46e80baca15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:48.914917 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e3166-67b8-40d0-82a7-46e80baca15e admin admin] PATH_INFO: `/v3/projects/a4363325cb9d4cababebc1612eba707c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:48.914917 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e3166-67b8-40d0-82a7-46e80baca15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4363325cb9d4cababebc1612eba707c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:48.914917 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e3166-67b8-40d0-82a7-46e80baca15e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:48.915249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72ac3c-782b-4823-ab3e-7b99e6e0b0eb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:48.948980 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ce46f-8292-44b8-9289-b85cc6173c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:48.950576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ce46f-8292-44b8-9289-b85cc6173c38 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:48.953709 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ce46f-8292-44b8-9289-b85cc6173c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:48.953875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ce46f-8292-44b8-9289-b85cc6173c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:49.002183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ce46f-8292-44b8-9289-b85cc6173c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:49.009092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ce46f-8292-44b8-9289-b85cc6173c38 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:49.044968 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 890/1778] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:49.049528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a99e3166-67b8-40d0-82a7-46e80baca15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4363325cb9d4cababebc1612eba707c', 'request_id': 'req-a99e3166-67b8-40d0-82a7-46e80baca15e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:49.067969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a99e3166-67b8-40d0-82a7-46e80baca15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4363325cb9d4cababebc1612eba707c', 'request_id': 'req-a99e3166-67b8-40d0-82a7-46e80baca15e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:49.075396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a99e3166-67b8-40d0-82a7-46e80baca15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4363325cb9d4cababebc1612eba707c', 'request_id': 'req-a99e3166-67b8-40d0-82a7-46e80baca15e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:49.110814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a99e3166-67b8-40d0-82a7-46e80baca15e admin admin] The token cache is being invalidate because project a4363325cb9d4cababebc1612eba707c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:32:49.111203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a99e3166-67b8-40d0-82a7-46e80baca15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:49.111962 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a99e3166-67b8-40d0-82a7-46e80baca15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:49.118046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 889/1779] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:32:48 2022] DELETE /identity/v3/projects/a4363325cb9d4cababebc1612eba707c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:49.125507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e6508-fcb8-473b-b0d7-f8756fac786d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:49.126045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e6508-fcb8-473b-b0d7-f8756fac786d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:49.126474 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e6508-fcb8-473b-b0d7-f8756fac786d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:49.210671 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0d5e6508-fcb8-473b-b0d7-f8756fac786d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:49.214937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0d5e6508-fcb8-473b-b0d7-f8756fac786d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:49.469890 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 891/1780] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:49.486613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d2f56-d11e-472f-a9cc-155bff78e5cc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:49.487679 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d2f56-d11e-472f-a9cc-155bff78e5cc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:49.488110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d2f56-d11e-472f-a9cc-155bff78e5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:49.521865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-178d2f56-d11e-472f-a9cc-155bff78e5cc None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:49.526014 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-178d2f56-d11e-472f-a9cc-155bff78e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:49.566506 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 890/1781] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:49.579971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e6508-fcb8-473b-b0d7-f8756fac786d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:49.600194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e6508-fcb8-473b-b0d7-f8756fac786d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:49.614415 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb03d34-751d-4ed7-b780-4a5632dd5680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:49.615512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb03d34-751d-4ed7-b780-4a5632dd5680 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:49.616022 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb03d34-751d-4ed7-b780-4a5632dd5680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:49.617689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb03d34-751d-4ed7-b780-4a5632dd5680 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:49.619372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb03d34-751d-4ed7-b780-4a5632dd5680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:49.619956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb03d34-751d-4ed7-b780-4a5632dd5680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:49.625531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb03d34-751d-4ed7-b780-4a5632dd5680 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:49.663486 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 892/1782] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:32:49.668137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d2f56-d11e-472f-a9cc-155bff78e5cc None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:49.683583 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d2f56-d11e-472f-a9cc-155bff78e5cc None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:49.694971 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc3e76-6e6b-48f5-8198-a28f4ef0db46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:49.696974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc3e76-6e6b-48f5-8198-a28f4ef0db46 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:49.701105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc3e76-6e6b-48f5-8198-a28f4ef0db46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:49.701670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc3e76-6e6b-48f5-8198-a28f4ef0db46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:49.702621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc3e76-6e6b-48f5-8198-a28f4ef0db46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:49.705064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc3e76-6e6b-48f5-8198-a28f4ef0db46 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:49.807219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 891/1783] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:49 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:49.809772 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb03d34-751d-4ed7-b780-4a5632dd5680 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:49.822004 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb03d34-751d-4ed7-b780-4a5632dd5680 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:49.871674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896879c4-44a5-4613-851d-41786a110e65 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:49.871950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896879c4-44a5-4613-851d-41786a110e65 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:49.872333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896879c4-44a5-4613-851d-41786a110e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:49.888951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:49.956741 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-896879c4-44a5-4613-851d-41786a110e65 None None] MFA Rules not processed for user `c90e6a7a7265480ca4c817d633da4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:49.967628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-896879c4-44a5-4613-851d-41786a110e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:50.141987 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be879b-df52-4dbd-ba90-156e5910a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:50.142705 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be879b-df52-4dbd-ba90-156e5910a2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:50.142995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be879b-df52-4dbd-ba90-156e5910a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:50.143388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be879b-df52-4dbd-ba90-156e5910a2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:50.144277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be879b-df52-4dbd-ba90-156e5910a2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:50.170820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be879b-df52-4dbd-ba90-156e5910a2a3 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:50.172070 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 892/1784] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:32:50.221357 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 893/1785] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:49 2022] POST /identity/v3/users => generated 291 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:32:50.221921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896879c4-44a5-4613-851d-41786a110e65 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:50.242617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896879c4-44a5-4613-851d-41786a110e65 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:50.266875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5e4a6-5c66-4e9c-9263-0d0497787a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:50.267603 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5e4a6-5c66-4e9c-9263-0d0497787a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:50.267897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5e4a6-5c66-4e9c-9263-0d0497787a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:50.268225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5e4a6-5c66-4e9c-9263-0d0497787a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:50.268997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5e4a6-5c66-4e9c-9263-0d0497787a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:50.270624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5e4a6-5c66-4e9c-9263-0d0497787a2e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:50.319445 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 893/1786] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:32:50.320568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be879b-df52-4dbd-ba90-156e5910a2a3 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:50.332597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be879b-df52-4dbd-ba90-156e5910a2a3 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:50.359688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5c443-a29f-47c2-aec4-b85b2f6f50ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:50.360587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5c443-a29f-47c2-aec4-b85b2f6f50ca admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:50.361068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5c443-a29f-47c2-aec4-b85b2f6f50ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:50.361520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5c443-a29f-47c2-aec4-b85b2f6f50ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:50.362426 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5c443-a29f-47c2-aec4-b85b2f6f50ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:50.364214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5c443-a29f-47c2-aec4-b85b2f6f50ca admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:50.385527 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5e4a6-5c66-4e9c-9263-0d0497787a2e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:50.385729 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 894/1787] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:50.394026 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5e4a6-5c66-4e9c-9263-0d0497787a2e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:50.399446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d494556-c5dc-48b7-b0b0-37825f9e41da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:50.400501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d494556-c5dc-48b7-b0b0-37825f9e41da admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:50.402340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d494556-c5dc-48b7-b0b0-37825f9e41da admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:50.402340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d494556-c5dc-48b7-b0b0-37825f9e41da admin admin] PATH_INFO: `/v3/projects/54dfbba8df0248ee995a184bbbb73a65/users/9d7834b6a0e243d79e125f419cc6dd64/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:50.420594 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d494556-c5dc-48b7-b0b0-37825f9e41da admin admin] RBAC: Authorizing `identity:create_grant(project_id=54dfbba8df0248ee995a184bbbb73a65, user_id=9d7834b6a0e243d79e125f419cc6dd64, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:50.423633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d494556-c5dc-48b7-b0b0-37825f9e41da admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:50.446355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 894/1788] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:50 2022] PUT /identity/v3/projects/54dfbba8df0248ee995a184bbbb73a65/users/9d7834b6a0e243d79e125f419cc6dd64/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:50.462796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62514d-23bc-40f1-aef7-5f87d54271a9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:50.463281 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62514d-23bc-40f1-aef7-5f87d54271a9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:50.465151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62514d-23bc-40f1-aef7-5f87d54271a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:50.511270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7a62514d-23bc-40f1-aef7-5f87d54271a9 None None] MFA Rules not processed for user `9d7834b6a0e243d79e125f419cc6dd64`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:50.517373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7a62514d-23bc-40f1-aef7-5f87d54271a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:50.548538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:50.642818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 895/1789] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:50.649664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d494556-c5dc-48b7-b0b0-37825f9e41da admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:50.833564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d494556-c5dc-48b7-b0b0-37825f9e41da admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:50.853149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5464c1b-0270-499e-aeea-486d584683bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:50.854018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5464c1b-0270-499e-aeea-486d584683bd admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:50.854392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5464c1b-0270-499e-aeea-486d584683bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:50.855476 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5464c1b-0270-499e-aeea-486d584683bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:50.856354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5464c1b-0270-499e-aeea-486d584683bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:50.860360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5464c1b-0270-499e-aeea-486d584683bd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:50.932366 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 895/1790] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:50 2022] POST /identity/v3/projects => generated 379 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:50.932468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62514d-23bc-40f1-aef7-5f87d54271a9 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:50.960807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62514d-23bc-40f1-aef7-5f87d54271a9 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:51.135344 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba98d63-128e-417f-8680-a01484c91d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:51.137723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba98d63-128e-417f-8680-a01484c91d29 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:51.141245 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba98d63-128e-417f-8680-a01484c91d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:51.141659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba98d63-128e-417f-8680-a01484c91d29 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:51.142695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba98d63-128e-417f-8680-a01484c91d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:51.144837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba98d63-128e-417f-8680-a01484c91d29 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:51.208981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 896/1791] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:50 2022] POST /identity/v3/users => generated 296 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:32:51.213073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5464c1b-0270-499e-aeea-486d584683bd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:51.233398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5464c1b-0270-499e-aeea-486d584683bd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:51.262234 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d60c98-0b74-4fcc-a228-ec5d389852bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:51.265057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d60c98-0b74-4fcc-a228-ec5d389852bf admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:51.266038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d60c98-0b74-4fcc-a228-ec5d389852bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:51.266515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d60c98-0b74-4fcc-a228-ec5d389852bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:51.268894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d60c98-0b74-4fcc-a228-ec5d389852bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:51.271894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d60c98-0b74-4fcc-a228-ec5d389852bf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:51.322140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba98d63-128e-417f-8680-a01484c91d29 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:51.323962 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 896/1792] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:32:51.361440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba98d63-128e-417f-8680-a01484c91d29 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:51.366204 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67bdcc-9476-436c-a4d3-367fff0bde3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:51.367123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67bdcc-9476-436c-a4d3-367fff0bde3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:51.367403 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67bdcc-9476-436c-a4d3-367fff0bde3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:51.367676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67bdcc-9476-436c-a4d3-367fff0bde3a admin admin] PATH_INFO: `/v3/projects/b6e810e2126f458da6738fd132c44455/users/da83b74419de4c81bde3a59b4da77c3d/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:51.428272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67bdcc-9476-436c-a4d3-367fff0bde3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e810e2126f458da6738fd132c44455, user_id=da83b74419de4c81bde3a59b4da77c3d, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:51.443270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67bdcc-9476-436c-a4d3-367fff0bde3a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:51.477103 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 897/1793] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:51 2022] PUT /identity/v3/projects/b6e810e2126f458da6738fd132c44455/users/da83b74419de4c81bde3a59b4da77c3d/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:32:51.481850 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d60c98-0b74-4fcc-a228-ec5d389852bf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:51.497072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d60c98-0b74-4fcc-a228-ec5d389852bf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:51.587487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:51.636523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95943939-1d17-4c2d-b7bb-176ce340d00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:51.639323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95943939-1d17-4c2d-b7bb-176ce340d00d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:51.639561 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95943939-1d17-4c2d-b7bb-176ce340d00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:51.641416 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95943939-1d17-4c2d-b7bb-176ce340d00d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:51.644810 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95943939-1d17-4c2d-b7bb-176ce340d00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:51.653516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95943939-1d17-4c2d-b7bb-176ce340d00d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:51.738756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 897/1794] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:51.744778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67bdcc-9476-436c-a4d3-367fff0bde3a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:51.767720 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67bdcc-9476-436c-a4d3-367fff0bde3a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:51.804002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4e266-8718-4a5a-9203-ccce598307ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:51.813930 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4e266-8718-4a5a-9203-ccce598307ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:51.814452 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4e266-8718-4a5a-9203-ccce598307ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:51.814962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4e266-8718-4a5a-9203-ccce598307ce admin admin] PATH_INFO: `/v3/projects/b6e810e2126f458da6738fd132c44455/users/da83b74419de4c81bde3a59b4da77c3d/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:51.870494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4e266-8718-4a5a-9203-ccce598307ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e810e2126f458da6738fd132c44455, user_id=da83b74419de4c81bde3a59b4da77c3d, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:51.884238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4e266-8718-4a5a-9203-ccce598307ce admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:51.937349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 898/1795] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:51 2022] PUT /identity/v3/projects/b6e810e2126f458da6738fd132c44455/users/da83b74419de4c81bde3a59b4da77c3d/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:51.950880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0059d-dc58-4a5e-a75d-63773c10d0bd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:51.951169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0059d-dc58-4a5e-a75d-63773c10d0bd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:51.951465 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0059d-dc58-4a5e-a75d-63773c10d0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:52.029573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-93c0059d-dc58-4a5e-a75d-63773c10d0bd None None] MFA Rules not processed for user `da83b74419de4c81bde3a59b4da77c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:52.031879 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-93c0059d-dc58-4a5e-a75d-63773c10d0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:52.333997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 898/1796] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:52.766879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4e266-8718-4a5a-9203-ccce598307ce admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:52.768927 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-06e4e266-8718-4a5a-9203-ccce598307ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:53.065056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4e266-8718-4a5a-9203-ccce598307ce admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:53.072640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4edfb5-162a-4cc1-b9a8-dcf50a6984f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:53.074221 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4edfb5-162a-4cc1-b9a8-dcf50a6984f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:53.074787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4edfb5-162a-4cc1-b9a8-dcf50a6984f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:53.075224 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4edfb5-162a-4cc1-b9a8-dcf50a6984f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:53.099565 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4edfb5-162a-4cc1-b9a8-dcf50a6984f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:53.101053 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4edfb5-162a-4cc1-b9a8-dcf50a6984f6 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:53.126234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 899/1797] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:55.050544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0059d-dc58-4a5e-a75d-63773c10d0bd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:55.129897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0059d-dc58-4a5e-a75d-63773c10d0bd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:55.134814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:55.135698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:55.136558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:55.137044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] PATH_INFO: `/v3/users/9d7834b6a0e243d79e125f419cc6dd64` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:55.140433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7834b6a0e243d79e125f419cc6dd64)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:55.141237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:55.202558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7834b6a0e243d79e125f419cc6dd64'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:55.203298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7834b6a0e243d79e125f419cc6dd64'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:55.204002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7834b6a0e243d79e125f419cc6dd64'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:55.216763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7834b6a0e243d79e125f419cc6dd64'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:55.221892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:55.224145 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7834b6a0e243d79e125f419cc6dd64'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:55.239642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 899/1798] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:32:55 2022] DELETE /identity/v3/users/9d7834b6a0e243d79e125f419cc6dd64 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:55.244422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca027bb5-d8f4-409e-9e7a-d10e39770302 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:55.244934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca027bb5-d8f4-409e-9e7a-d10e39770302 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:55.245235 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca027bb5-d8f4-409e-9e7a-d10e39770302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:55.291806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ca027bb5-d8f4-409e-9e7a-d10e39770302 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:55.293265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ca027bb5-d8f4-409e-9e7a-d10e39770302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:55.298844 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:55.394026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 900/1799] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:55.407490 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:55.409331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:55.485513 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ddfc4-f5fa-4c1d-b14a-09a5b8341814 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:55.489565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aae847-4fe0-4afb-8ac2-95102d0fb6ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:55.490310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aae847-4fe0-4afb-8ac2-95102d0fb6ad service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:55.490665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aae847-4fe0-4afb-8ac2-95102d0fb6ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:55.491035 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aae847-4fe0-4afb-8ac2-95102d0fb6ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:55.501587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aae847-4fe0-4afb-8ac2-95102d0fb6ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:55.503083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aae847-4fe0-4afb-8ac2-95102d0fb6ad service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:55.514323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 900/1800] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:32:55.940685 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca027bb5-d8f4-409e-9e7a-d10e39770302 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:55.942326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ca027bb5-d8f4-409e-9e7a-d10e39770302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:55.955279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca027bb5-d8f4-409e-9e7a-d10e39770302 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:55.960011 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:55.960921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:55.961212 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:55.961477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] PATH_INFO: `/v3/projects/54dfbba8df0248ee995a184bbbb73a65` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:55.962665 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54dfbba8df0248ee995a184bbbb73a65)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:55.964947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:56.030066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54dfbba8df0248ee995a184bbbb73a65', 'request_id': 'req-05049635-569e-4ee1-b533-9ac0d2cbf35b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:56.039755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54dfbba8df0248ee995a184bbbb73a65', 'request_id': 'req-05049635-569e-4ee1-b533-9ac0d2cbf35b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:56.047941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54dfbba8df0248ee995a184bbbb73a65', 'request_id': 'req-05049635-569e-4ee1-b533-9ac0d2cbf35b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:56.062334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] The token cache is being invalidate because project 54dfbba8df0248ee995a184bbbb73a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:32:56.062620 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:56.063288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:56.064958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 901/1801] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:32:55 2022] DELETE /identity/v3/projects/54dfbba8df0248ee995a184bbbb73a65 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:56.070309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aae847-4fe0-4afb-8ac2-95102d0fb6ad service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:56.085242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aae847-4fe0-4afb-8ac2-95102d0fb6ad service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:56.181124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8acb4-ffac-4d02-8760-6f0a434c729a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:56.182155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8acb4-ffac-4d02-8760-6f0a434c729a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:56.183168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8acb4-ffac-4d02-8760-6f0a434c729a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:56.183304 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8acb4-ffac-4d02-8760-6f0a434c729a admin admin] PATH_INFO: `/v3/users/da83b74419de4c81bde3a59b4da77c3d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:56.184889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8acb4-ffac-4d02-8760-6f0a434c729a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da83b74419de4c81bde3a59b4da77c3d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:56.187864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8acb4-ffac-4d02-8760-6f0a434c729a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:56.264051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-59a8acb4-ffac-4d02-8760-6f0a434c729a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da83b74419de4c81bde3a59b4da77c3d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:56.265285 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-59a8acb4-ffac-4d02-8760-6f0a434c729a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da83b74419de4c81bde3a59b4da77c3d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:56.266311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-59a8acb4-ffac-4d02-8760-6f0a434c729a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da83b74419de4c81bde3a59b4da77c3d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:56.302120 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-59a8acb4-ffac-4d02-8760-6f0a434c729a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da83b74419de4c81bde3a59b4da77c3d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:56.335429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-59a8acb4-ffac-4d02-8760-6f0a434c729a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da83b74419de4c81bde3a59b4da77c3d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:56.366385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 901/1802] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:32:56 2022] DELETE /identity/v3/users/da83b74419de4c81bde3a59b4da77c3d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:56.810100 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:56.813851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:56.833168 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05049635-569e-4ee1-b533-9ac0d2cbf35b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:56.920703 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7491b9b-f148-4005-ad01-898672f1d7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:56.921606 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7491b9b-f148-4005-ad01-898672f1d7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:56.921895 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7491b9b-f148-4005-ad01-898672f1d7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:56.922177 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7491b9b-f148-4005-ad01-898672f1d7ed admin admin] PATH_INFO: `/v3/projects/b6e810e2126f458da6738fd132c44455` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:56.923388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7491b9b-f148-4005-ad01-898672f1d7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e810e2126f458da6738fd132c44455)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:56.925316 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7491b9b-f148-4005-ad01-898672f1d7ed admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:56.987671 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:57.007114 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b7491b9b-f148-4005-ad01-898672f1d7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e810e2126f458da6738fd132c44455', 'request_id': 'req-b7491b9b-f148-4005-ad01-898672f1d7ed'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:57.016562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b7491b9b-f148-4005-ad01-898672f1d7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e810e2126f458da6738fd132c44455', 'request_id': 'req-b7491b9b-f148-4005-ad01-898672f1d7ed'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:57.025194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b7491b9b-f148-4005-ad01-898672f1d7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e810e2126f458da6738fd132c44455', 'request_id': 'req-b7491b9b-f148-4005-ad01-898672f1d7ed'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:57.047477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b7491b9b-f148-4005-ad01-898672f1d7ed admin admin] The token cache is being invalidate because project b6e810e2126f458da6738fd132c44455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:32:57.047924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b7491b9b-f148-4005-ad01-898672f1d7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:57.049085 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b7491b9b-f148-4005-ad01-898672f1d7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:32:57.052275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 902/1803] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:32:56 2022] DELETE /identity/v3/projects/b6e810e2126f458da6738fd132c44455 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:57.062613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cd117-8011-401e-a9b0-3f1333943a46 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:57.063191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cd117-8011-401e-a9b0-3f1333943a46 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:57.063476 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cd117-8011-401e-a9b0-3f1333943a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:57.096427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ca3cd117-8011-401e-a9b0-3f1333943a46 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:57.098383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ca3cd117-8011-401e-a9b0-3f1333943a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:57.104119 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:32:57.190696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 902/1804] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:57.198926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53729f-71d9-4c62-bbde-61fd1f562417 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:57.199300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53729f-71d9-4c62-bbde-61fd1f562417 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:57.200154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53729f-71d9-4c62-bbde-61fd1f562417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:57.220244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ce53729f-71d9-4c62-bbde-61fd1f562417 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:57.221481 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ce53729f-71d9-4c62-bbde-61fd1f562417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:57.230188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 903/1805] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:57.235151 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cd117-8011-401e-a9b0-3f1333943a46 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:57.244898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cd117-8011-401e-a9b0-3f1333943a46 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:57.250381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c74a-dba4-4444-adc2-275cdf8bb355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:57.251040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c74a-dba4-4444-adc2-275cdf8bb355 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:57.251324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c74a-dba4-4444-adc2-275cdf8bb355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:57.251594 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c74a-dba4-4444-adc2-275cdf8bb355 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:57.252333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5c74a-dba4-4444-adc2-275cdf8bb355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:32:57.252639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5c74a-dba4-4444-adc2-275cdf8bb355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:57.254614 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5c74a-dba4-4444-adc2-275cdf8bb355 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:57.271973 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 903/1806] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:32:57.273789 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53729f-71d9-4c62-bbde-61fd1f562417 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:57.288790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53729f-71d9-4c62-bbde-61fd1f562417 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:57.301120 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ac084-ab68-4eef-b89e-69a3b4aed339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:57.301806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ac084-ab68-4eef-b89e-69a3b4aed339 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:57.302095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ac084-ab68-4eef-b89e-69a3b4aed339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:57.302378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ac084-ab68-4eef-b89e-69a3b4aed339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:57.303090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ac084-ab68-4eef-b89e-69a3b4aed339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:57.305043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014ac084-ab68-4eef-b89e-69a3b4aed339 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:57.337151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 904/1807] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:32:57 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:57.342665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c74a-dba4-4444-adc2-275cdf8bb355 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:57.354538 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c74a-dba4-4444-adc2-275cdf8bb355 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:57.415257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d7531-902a-4424-bd13-225f726ccf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:57.415853 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d7531-902a-4424-bd13-225f726ccf71 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:57.416144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d7531-902a-4424-bd13-225f726ccf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:57.416423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d7531-902a-4424-bd13-225f726ccf71 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:57.417291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d7531-902a-4424-bd13-225f726ccf71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:57.419239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d7531-902a-4424-bd13-225f726ccf71 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:57.439645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 904/1808] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:32:57 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:32:57.443830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ac084-ab68-4eef-b89e-69a3b4aed339 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:57.455042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014ac084-ab68-4eef-b89e-69a3b4aed339 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:57.459793 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b44b7d-4889-4aca-bf76-3845f488ff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:57.460479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b44b7d-4889-4aca-bf76-3845f488ff89 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:57.460805 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b44b7d-4889-4aca-bf76-3845f488ff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:57.461088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b44b7d-4889-4aca-bf76-3845f488ff89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:57.461849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b44b7d-4889-4aca-bf76-3845f488ff89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:57.463443 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b44b7d-4889-4aca-bf76-3845f488ff89 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:57.480491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 905/1809] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:57.484118 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d7531-902a-4424-bd13-225f726ccf71 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:57.494286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d7531-902a-4424-bd13-225f726ccf71 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:57.499011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff88993-8eae-402b-94cd-7fca9aec4a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:57.499670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff88993-8eae-402b-94cd-7fca9aec4a29 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:57.499952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff88993-8eae-402b-94cd-7fca9aec4a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:57.500225 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff88993-8eae-402b-94cd-7fca9aec4a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:57.501033 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff88993-8eae-402b-94cd-7fca9aec4a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:57.502624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff88993-8eae-402b-94cd-7fca9aec4a29 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:57.514966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 905/1810] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:32:57.519157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b44b7d-4889-4aca-bf76-3845f488ff89 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:57.531278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b44b7d-4889-4aca-bf76-3845f488ff89 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:57.536351 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1a64b-416b-4c87-9765-c601b099c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:57.537349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1a64b-416b-4c87-9765-c601b099c13c admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:57.537724 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1a64b-416b-4c87-9765-c601b099c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:57.538104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1a64b-416b-4c87-9765-c601b099c13c admin admin] PATH_INFO: `/v3/projects/28acbbc77de64248b48d496c8e02f97e/users/d6083dbb831e4e238c5e9e4d053248a0/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:57.553892 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1a64b-416b-4c87-9765-c601b099c13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=28acbbc77de64248b48d496c8e02f97e, user_id=d6083dbb831e4e238c5e9e4d053248a0, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:57.556590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1a64b-416b-4c87-9765-c601b099c13c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:57.570707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 906/1811] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:32:57 2022] PUT /identity/v3/projects/28acbbc77de64248b48d496c8e02f97e/users/d6083dbb831e4e238c5e9e4d053248a0/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:32:57.582750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b70c1b-239d-4e0a-9f56-3c5afd556ef0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:57.583043 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b70c1b-239d-4e0a-9f56-3c5afd556ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:57.583349 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b70c1b-239d-4e0a-9f56-3c5afd556ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:57.623725 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e4b70c1b-239d-4e0a-9f56-3c5afd556ef0 None None] MFA Rules not processed for user `d6083dbb831e4e238c5e9e4d053248a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:32:57.625832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e4b70c1b-239d-4e0a-9f56-3c5afd556ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:57.741474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 906/1812] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:32:57.761258 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1a64b-416b-4c87-9765-c601b099c13c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:32:57.763016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-48f1a64b-416b-4c87-9765-c601b099c13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:32:57.829154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1a64b-416b-4c87-9765-c601b099c13c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:32:57.833028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5832ba5-988a-4efc-b828-742429904f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:32:57.833690 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5832ba5-988a-4efc-b828-742429904f2d service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:32:57.833974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5832ba5-988a-4efc-b828-742429904f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:32:57.834248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5832ba5-988a-4efc-b828-742429904f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:32:57.847059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5832ba5-988a-4efc-b828-742429904f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:32:57.857869 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5832ba5-988a-4efc-b828-742429904f2d service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:32:57.875051 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 907/1813] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:32:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:33:03.344168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b70c1b-239d-4e0a-9f56-3c5afd556ef0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:03.356759 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:03.481391 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b70c1b-239d-4e0a-9f56-3c5afd556ef0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:03.501835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:03.503041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:03.503654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:03.504924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] PATH_INFO: `/v3/users/d6083dbb831e4e238c5e9e4d053248a0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:03.506465 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6083dbb831e4e238c5e9e4d053248a0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:03.511545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:03.583002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6083dbb831e4e238c5e9e4d053248a0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:03.583663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6083dbb831e4e238c5e9e4d053248a0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:03.584286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6083dbb831e4e238c5e9e4d053248a0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:03.599287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6083dbb831e4e238c5e9e4d053248a0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:03.619732 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6083dbb831e4e238c5e9e4d053248a0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:03.637429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 907/1814] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:33:03 2022] DELETE /identity/v3/users/d6083dbb831e4e238c5e9e4d053248a0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:33:03.642054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4a71f-3507-4f63-bcfa-4e9c16551fb9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:03.642664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4a71f-3507-4f63-bcfa-4e9c16551fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:03.642664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4a71f-3507-4f63-bcfa-4e9c16551fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:03.663938 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-dab4a71f-3507-4f63-bcfa-4e9c16551fb9 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:03.665178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dab4a71f-3507-4f63-bcfa-4e9c16551fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:03.734776 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 908/1815] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:03.754339 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:03.758074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:03.892354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9143b16-deab-4529-98d5-d829b2f41a27 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:03.902924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470461fc-5dbe-46c5-8d13-62d9053f7319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:03.902924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470461fc-5dbe-46c5-8d13-62d9053f7319 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:03.902924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470461fc-5dbe-46c5-8d13-62d9053f7319 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:03.902924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470461fc-5dbe-46c5-8d13-62d9053f7319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:03.921591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470461fc-5dbe-46c5-8d13-62d9053f7319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:03.924303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470461fc-5dbe-46c5-8d13-62d9053f7319 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:03.940790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 908/1816] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:33:04.581991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4a71f-3507-4f63-bcfa-4e9c16551fb9 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:04.584332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dab4a71f-3507-4f63-bcfa-4e9c16551fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:04.631129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:04.655886 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4a71f-3507-4f63-bcfa-4e9c16551fb9 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:04.678091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f004a1d-7e45-4e93-a4e8-42bbc3231593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:04.684443 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f004a1d-7e45-4e93-a4e8-42bbc3231593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:04.685734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f004a1d-7e45-4e93-a4e8-42bbc3231593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:04.693150 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f004a1d-7e45-4e93-a4e8-42bbc3231593 admin admin] PATH_INFO: `/v3/users/6d5078c1b2444f73a7d20d0726ebec36` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:04.697104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f004a1d-7e45-4e93-a4e8-42bbc3231593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5078c1b2444f73a7d20d0726ebec36)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:04.701188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f004a1d-7e45-4e93-a4e8-42bbc3231593 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:04.863991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6f004a1d-7e45-4e93-a4e8-42bbc3231593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5078c1b2444f73a7d20d0726ebec36'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:04.866452 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6f004a1d-7e45-4e93-a4e8-42bbc3231593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5078c1b2444f73a7d20d0726ebec36'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:04.869818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6f004a1d-7e45-4e93-a4e8-42bbc3231593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5078c1b2444f73a7d20d0726ebec36'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:04.930957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6f004a1d-7e45-4e93-a4e8-42bbc3231593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5078c1b2444f73a7d20d0726ebec36'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:04.956370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6f004a1d-7e45-4e93-a4e8-42bbc3231593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5078c1b2444f73a7d20d0726ebec36'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:04.974880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470461fc-5dbe-46c5-8d13-62d9053f7319 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:04.977605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-470461fc-5dbe-46c5-8d13-62d9053f7319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:04.993151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 909/1817] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:33:04 2022] DELETE /identity/v3/users/6d5078c1b2444f73a7d20d0726ebec36 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:04.999965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7121c-f93a-4d81-a0da-cb21882ec50d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:05.000616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7121c-f93a-4d81-a0da-cb21882ec50d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:05.001114 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7121c-f93a-4d81-a0da-cb21882ec50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:05.017216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470461fc-5dbe-46c5-8d13-62d9053f7319 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:05.066580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-cbf7121c-f93a-4d81-a0da-cb21882ec50d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:05.070721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cbf7121c-f93a-4d81-a0da-cb21882ec50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:05.166199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:05.230325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 910/1818] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:05.279354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b61936-3656-45ad-9d50-a57d8dadb271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:05.280887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61936-3656-45ad-9d50-a57d8dadb271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:05.281354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61936-3656-45ad-9d50-a57d8dadb271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:05.281758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b61936-3656-45ad-9d50-a57d8dadb271 admin admin] PATH_INFO: `/v3/projects/28acbbc77de64248b48d496c8e02f97e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:05.284577 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b61936-3656-45ad-9d50-a57d8dadb271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28acbbc77de64248b48d496c8e02f97e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:05.287267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b61936-3656-45ad-9d50-a57d8dadb271 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:05.311445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7121c-f93a-4d81-a0da-cb21882ec50d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:05.313318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cbf7121c-f93a-4d81-a0da-cb21882ec50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:05.419578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a5b61936-3656-45ad-9d50-a57d8dadb271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28acbbc77de64248b48d496c8e02f97e', 'request_id': 'req-a5b61936-3656-45ad-9d50-a57d8dadb271'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:05.442272 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a5b61936-3656-45ad-9d50-a57d8dadb271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28acbbc77de64248b48d496c8e02f97e', 'request_id': 'req-a5b61936-3656-45ad-9d50-a57d8dadb271'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:05.458695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a5b61936-3656-45ad-9d50-a57d8dadb271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28acbbc77de64248b48d496c8e02f97e', 'request_id': 'req-a5b61936-3656-45ad-9d50-a57d8dadb271'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:05.477329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7121c-f93a-4d81-a0da-cb21882ec50d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:05.490378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a5b61936-3656-45ad-9d50-a57d8dadb271 admin admin] The token cache is being invalidate because project 28acbbc77de64248b48d496c8e02f97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:33:05.492323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a5b61936-3656-45ad-9d50-a57d8dadb271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:05.493952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a5b61936-3656-45ad-9d50-a57d8dadb271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:05.500505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 909/1819] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:33:04 2022] DELETE /identity/v3/projects/28acbbc77de64248b48d496c8e02f97e => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:05.507136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439607b-c225-4348-a123-1087e1589908 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:05.507400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439607b-c225-4348-a123-1087e1589908 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:05.507782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439607b-c225-4348-a123-1087e1589908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:05.556037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2439607b-c225-4348-a123-1087e1589908 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:05.560365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2439607b-c225-4348-a123-1087e1589908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:05.565920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:05.645987 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa41d5a-2ae9-47d4-a2a6-5289c3c5d79c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:05.648559 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa41d5a-2ae9-47d4-a2a6-5289c3c5d79c service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:05.652629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa41d5a-2ae9-47d4-a2a6-5289c3c5d79c service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:05.652930 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa41d5a-2ae9-47d4-a2a6-5289c3c5d79c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:05.657934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5fa41d5a-2ae9-47d4-a2a6-5289c3c5d79c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:05.723890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 910/1820] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:05.733632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b133b73-8527-458a-a274-f62ce5a3233c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:05.734083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b133b73-8527-458a-a274-f62ce5a3233c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:05.735202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b133b73-8527-458a-a274-f62ce5a3233c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:05.785185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4b133b73-8527-458a-a274-f62ce5a3233c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:05.788637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4b133b73-8527-458a-a274-f62ce5a3233c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:05.814262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 911/1821] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:33:05.819598 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b133b73-8527-458a-a274-f62ce5a3233c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:05.862432 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa41d5a-2ae9-47d4-a2a6-5289c3c5d79c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:05.864630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa41d5a-2ae9-47d4-a2a6-5289c3c5d79c service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:05.872954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b133b73-8527-458a-a274-f62ce5a3233c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:05.895486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b4872-8318-4577-9443-192b93dab7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:05.896241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4872-8318-4577-9443-192b93dab7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:05.896652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4872-8318-4577-9443-192b93dab7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:05.896908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4872-8318-4577-9443-192b93dab7e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:05.898219 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 911/1822] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:33:05.898582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b4872-8318-4577-9443-192b93dab7e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:33:05.898912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b4872-8318-4577-9443-192b93dab7e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:05.901366 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b4872-8318-4577-9443-192b93dab7e8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:05.923492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 912/1823] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:33:05.924848 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa41d5a-2ae9-47d4-a2a6-5289c3c5d79c service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:05.938476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa41d5a-2ae9-47d4-a2a6-5289c3c5d79c service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:05.945742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff233893-9737-4a08-866d-d3f6a2ccf46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:05.946639 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233893-9737-4a08-866d-d3f6a2ccf46d admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:05.947186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233893-9737-4a08-866d-d3f6a2ccf46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:05.948099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233893-9737-4a08-866d-d3f6a2ccf46d admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:05.949587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff233893-9737-4a08-866d-d3f6a2ccf46d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:05.954053 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff233893-9737-4a08-866d-d3f6a2ccf46d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:05.991484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 912/1824] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:33:05 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:33:05.997937 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b4872-8318-4577-9443-192b93dab7e8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:06.013827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b4872-8318-4577-9443-192b93dab7e8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:06.095174 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:06.135401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406cd0e-060b-4126-a772-67f5b4c370e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:06.136973 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406cd0e-060b-4126-a772-67f5b4c370e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:06.137464 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406cd0e-060b-4126-a772-67f5b4c370e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:06.137734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406cd0e-060b-4126-a772-67f5b4c370e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:06.138689 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406cd0e-060b-4126-a772-67f5b4c370e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:06.141165 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406cd0e-060b-4126-a772-67f5b4c370e5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:06.205871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 913/1825] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:33:05 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:33:06.207110 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff233893-9737-4a08-866d-d3f6a2ccf46d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:06.223556 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff233893-9737-4a08-866d-d3f6a2ccf46d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:06.240569 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e54cd-5351-4156-ab81-045c895c2359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:06.242151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e54cd-5351-4156-ab81-045c895c2359 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:06.242449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e54cd-5351-4156-ab81-045c895c2359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:06.242735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e54cd-5351-4156-ab81-045c895c2359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:06.243491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e54cd-5351-4156-ab81-045c895c2359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:06.245661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e54cd-5351-4156-ab81-045c895c2359 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:06.261809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 913/1826] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:33:06.263908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406cd0e-060b-4126-a772-67f5b4c370e5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:06.279072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406cd0e-060b-4126-a772-67f5b4c370e5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:06.285365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89576254-bd3f-4732-ac6e-cddbd6982072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:06.286848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89576254-bd3f-4732-ac6e-cddbd6982072 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:06.287234 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89576254-bd3f-4732-ac6e-cddbd6982072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:06.288068 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89576254-bd3f-4732-ac6e-cddbd6982072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:06.289137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89576254-bd3f-4732-ac6e-cddbd6982072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:06.291778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89576254-bd3f-4732-ac6e-cddbd6982072 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:06.333781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 914/1827] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:33:06.342499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e54cd-5351-4156-ab81-045c895c2359 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:06.361144 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e54cd-5351-4156-ab81-045c895c2359 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:06.367981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70451f14-dcee-4c4d-99cd-07250e5d58d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:06.369310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70451f14-dcee-4c4d-99cd-07250e5d58d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:06.369747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70451f14-dcee-4c4d-99cd-07250e5d58d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:06.371038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70451f14-dcee-4c4d-99cd-07250e5d58d0 admin admin] PATH_INFO: `/v3/projects/1262e1a887bf44b0ae7fa8ac522e1250/users/c30a4258c6024a7c9ef1fbd694fa9bfd/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:06.391537 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70451f14-dcee-4c4d-99cd-07250e5d58d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1262e1a887bf44b0ae7fa8ac522e1250, user_id=c30a4258c6024a7c9ef1fbd694fa9bfd, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:06.406514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70451f14-dcee-4c4d-99cd-07250e5d58d0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:06.461592 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2f77f-51b4-460e-8ff2-50f175341b57 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:06.462489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2f77f-51b4-460e-8ff2-50f175341b57 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:06.463058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2f77f-51b4-460e-8ff2-50f175341b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:06.471283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 914/1828] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:33:06 2022] PUT /identity/v3/projects/1262e1a887bf44b0ae7fa8ac522e1250/users/c30a4258c6024a7c9ef1fbd694fa9bfd/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:06.517908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-60f2f77f-51b4-460e-8ff2-50f175341b57 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:06.519162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-60f2f77f-51b4-460e-8ff2-50f175341b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:06.701230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 915/1829] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:33:06.784917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70451f14-dcee-4c4d-99cd-07250e5d58d0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:06.787337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-70451f14-dcee-4c4d-99cd-07250e5d58d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:06.922991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70451f14-dcee-4c4d-99cd-07250e5d58d0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:06.946321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13513a1c-ec43-42ef-8070-21b7dda2caad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:06.947337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13513a1c-ec43-42ef-8070-21b7dda2caad service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:06.950043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13513a1c-ec43-42ef-8070-21b7dda2caad service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:06.950511 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13513a1c-ec43-42ef-8070-21b7dda2caad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:06.997069 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13513a1c-ec43-42ef-8070-21b7dda2caad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:07.000100 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13513a1c-ec43-42ef-8070-21b7dda2caad service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:07.028563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 915/1830] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:33:07.920701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348b852-f6c5-47f5-86d2-6664b019da40 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:07.921395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348b852-f6c5-47f5-86d2-6664b019da40 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:07.921849 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348b852-f6c5-47f5-86d2-6664b019da40 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:07.925260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 916/1831] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:33:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:33:07.937423 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea5552-dbea-4f8e-a9c7-674bd9d84706 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:07.937880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea5552-dbea-4f8e-a9c7-674bd9d84706 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:07.937961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea5552-dbea-4f8e-a9c7-674bd9d84706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:07.971070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3aea5552-dbea-4f8e-a9c7-674bd9d84706 None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:07.973064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3aea5552-dbea-4f8e-a9c7-674bd9d84706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:08.001761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:08.085983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348b852-f6c5-47f5-86d2-6664b019da40 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:08.091218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5348b852-f6c5-47f5-86d2-6664b019da40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:08.096619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 916/1832] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:08.119140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348b852-f6c5-47f5-86d2-6664b019da40 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:08.128385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:08.130504 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:08.131041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:08.132999 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94 admin admin] PATH_INFO: `/v3/projects/63450cb20d5b40838d84ec02179ba232` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:08.134959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63450cb20d5b40838d84ec02179ba232)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:08.138887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:08.201035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea5552-dbea-4f8e-a9c7-674bd9d84706 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:08.202651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3aea5552-dbea-4f8e-a9c7-674bd9d84706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:08.231360 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea5552-dbea-4f8e-a9c7-674bd9d84706 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:08.243392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07af9b-4794-462a-9188-a3fca0771630 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:08.244890 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07af9b-4794-462a-9188-a3fca0771630 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:08.246020 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07af9b-4794-462a-9188-a3fca0771630 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:08.246739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07af9b-4794-462a-9188-a3fca0771630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:08.272023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07af9b-4794-462a-9188-a3fca0771630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:08.276926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07af9b-4794-462a-9188-a3fca0771630 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:08.278096 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63450cb20d5b40838d84ec02179ba232', 'request_id': 'req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:08.294755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63450cb20d5b40838d84ec02179ba232', 'request_id': 'req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:08.303735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63450cb20d5b40838d84ec02179ba232', 'request_id': 'req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:08.316450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 917/1833] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:33:08.344947 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94 admin admin] The token cache is being invalidate because project 63450cb20d5b40838d84ec02179ba232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:33:08.344947 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:08.345810 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-da6fa4f0-d47a-42d5-97a2-aca8595e9f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:08.353509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 917/1834] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:33:08 2022] DELETE /identity/v3/projects/63450cb20d5b40838d84ec02179ba232 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:08.360430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07af9b-4794-462a-9188-a3fca0771630 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:08.382111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07af9b-4794-462a-9188-a3fca0771630 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:08.662986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383fdc8-4d22-4c6d-a454-9a82c686e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:08.663998 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383fdc8-4d22-4c6d-a454-9a82c686e98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:08.668291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383fdc8-4d22-4c6d-a454-9a82c686e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:08.669054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383fdc8-4d22-4c6d-a454-9a82c686e98a admin admin] PATH_INFO: `/v3/users/c9104325c3294947a2287383d5d5f173` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:08.673814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383fdc8-4d22-4c6d-a454-9a82c686e98a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9104325c3294947a2287383d5d5f173)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:08.679413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383fdc8-4d22-4c6d-a454-9a82c686e98a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:08.793470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6383fdc8-4d22-4c6d-a454-9a82c686e98a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9104325c3294947a2287383d5d5f173'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:08.796562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6383fdc8-4d22-4c6d-a454-9a82c686e98a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9104325c3294947a2287383d5d5f173'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:08.797517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6383fdc8-4d22-4c6d-a454-9a82c686e98a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9104325c3294947a2287383d5d5f173'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:08.829012 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6383fdc8-4d22-4c6d-a454-9a82c686e98a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9104325c3294947a2287383d5d5f173'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:08.846058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6383fdc8-4d22-4c6d-a454-9a82c686e98a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9104325c3294947a2287383d5d5f173'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:08.898905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 918/1835] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:33:08 2022] DELETE /identity/v3/users/c9104325c3294947a2287383d5d5f173 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:09.437009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93018536-5ef8-40f5-a9d6-1b5ade950d33 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:09.437714 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93018536-5ef8-40f5-a9d6-1b5ade950d33 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:09.438220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93018536-5ef8-40f5-a9d6-1b5ade950d33 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:09.441964 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 918/1836] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:33:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:33:09.490100 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a2c1d-73db-46b4-8c69-2961b0decd8a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:09.490681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a2c1d-73db-46b4-8c69-2961b0decd8a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:09.490681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a2c1d-73db-46b4-8c69-2961b0decd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:09.527207 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-126a2c1d-73db-46b4-8c69-2961b0decd8a None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:09.531240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-126a2c1d-73db-46b4-8c69-2961b0decd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:09.565240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:09.660253 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 919/1837] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:33:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:33:09.802665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93018536-5ef8-40f5-a9d6-1b5ade950d33 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:09.804509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-93018536-5ef8-40f5-a9d6-1b5ade950d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:09.840656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93018536-5ef8-40f5-a9d6-1b5ade950d33 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:09.854076 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c49b16-69d9-4e7f-b037-5386e405b62b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:09.856119 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49b16-69d9-4e7f-b037-5386e405b62b service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:09.856777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49b16-69d9-4e7f-b037-5386e405b62b service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:09.857296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49b16-69d9-4e7f-b037-5386e405b62b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:09.873479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c49b16-69d9-4e7f-b037-5386e405b62b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:09.875212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c49b16-69d9-4e7f-b037-5386e405b62b service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:09.888381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 919/1838] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:33:10.812529 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a2c1d-73db-46b4-8c69-2961b0decd8a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:10.818841 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-126a2c1d-73db-46b4-8c69-2961b0decd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:10.980232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a2c1d-73db-46b4-8c69-2961b0decd8a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:10.988654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a265f63-6c6b-4387-a866-639b6c6ba6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:10.988654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a265f63-6c6b-4387-a866-639b6c6ba6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:10.988654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a265f63-6c6b-4387-a866-639b6c6ba6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:10.988654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a265f63-6c6b-4387-a866-639b6c6ba6b9 admin admin] PATH_INFO: `/v3/projects/a18074b39a68400098bf1b8132d0d75b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:10.990290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a265f63-6c6b-4387-a866-639b6c6ba6b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18074b39a68400098bf1b8132d0d75b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:10.992178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a265f63-6c6b-4387-a866-639b6c6ba6b9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:11.059433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df100c40-1d04-4a02-a438-abd390a43f92 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:11.061030 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df100c40-1d04-4a02-a438-abd390a43f92 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:11.061649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df100c40-1d04-4a02-a438-abd390a43f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:11.064206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6a265f63-6c6b-4387-a866-639b6c6ba6b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18074b39a68400098bf1b8132d0d75b', 'request_id': 'req-6a265f63-6c6b-4387-a866-639b6c6ba6b9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:11.075779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6a265f63-6c6b-4387-a866-639b6c6ba6b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18074b39a68400098bf1b8132d0d75b', 'request_id': 'req-6a265f63-6c6b-4387-a866-639b6c6ba6b9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:11.087643 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6a265f63-6c6b-4387-a866-639b6c6ba6b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18074b39a68400098bf1b8132d0d75b', 'request_id': 'req-6a265f63-6c6b-4387-a866-639b6c6ba6b9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:11.105979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6a265f63-6c6b-4387-a866-639b6c6ba6b9 admin admin] The token cache is being invalidate because project a18074b39a68400098bf1b8132d0d75b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:33:11.106496 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6a265f63-6c6b-4387-a866-639b6c6ba6b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:11.107346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6a265f63-6c6b-4387-a866-639b6c6ba6b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:11.109758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 920/1839] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:33:10 2022] DELETE /identity/v3/projects/a18074b39a68400098bf1b8132d0d75b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:11.113543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-df100c40-1d04-4a02-a438-abd390a43f92 None None] MFA Rules not processed for user `c30a4258c6024a7c9ef1fbd694fa9bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:11.115678 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11eff4-2467-482f-afde-ab0f26728c4f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:11.116379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11eff4-2467-482f-afde-ab0f26728c4f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:11.116875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11eff4-2467-482f-afde-ab0f26728c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:11.120023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-df100c40-1d04-4a02-a438-abd390a43f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:11.141624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8d11eff4-2467-482f-afde-ab0f26728c4f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:11.143849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8d11eff4-2467-482f-afde-ab0f26728c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:11.178480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:11.235282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:11.271653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 921/1840] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:11.280418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e19d6-368e-43fe-a457-489cb942e194 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:11.281065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e19d6-368e-43fe-a457-489cb942e194 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:11.281524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e19d6-368e-43fe-a457-489cb942e194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:11.304289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 920/1841] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:11.310900 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fa7e19d6-368e-43fe-a457-489cb942e194 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:11.311655 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df100c40-1d04-4a02-a438-abd390a43f92 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:11.312653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fa7e19d6-368e-43fe-a457-489cb942e194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:11.313303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-df100c40-1d04-4a02-a438-abd390a43f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:11.324955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 922/1842] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:11.326218 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e19d6-368e-43fe-a457-489cb942e194 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:11.336991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e19d6-368e-43fe-a457-489cb942e194 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:11.343553 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd106e-c622-4491-bf4e-e8a9d37c32ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:11.344313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd106e-c622-4491-bf4e-e8a9d37c32ff admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:11.344599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd106e-c622-4491-bf4e-e8a9d37c32ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:11.344911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd106e-c622-4491-bf4e-e8a9d37c32ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:11.346199 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd106e-c622-4491-bf4e-e8a9d37c32ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:33:11.346513 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd106e-c622-4491-bf4e-e8a9d37c32ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:11.348344 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd106e-c622-4491-bf4e-e8a9d37c32ff admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:11.370623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 923/1843] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:33:11.372010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd106e-c622-4491-bf4e-e8a9d37c32ff admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:11.392529 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd106e-c622-4491-bf4e-e8a9d37c32ff admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:11.399749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a8a9c-057b-4f64-93ae-7c53025fbf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:11.400919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a8a9c-057b-4f64-93ae-7c53025fbf71 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:11.403101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a8a9c-057b-4f64-93ae-7c53025fbf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:11.403584 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a8a9c-057b-4f64-93ae-7c53025fbf71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:11.404592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a8a9c-057b-4f64-93ae-7c53025fbf71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:11.408640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a8a9c-057b-4f64-93ae-7c53025fbf71 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:11.416647 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df100c40-1d04-4a02-a438-abd390a43f92 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:11.421853 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9e110-6f22-4c7b-a55b-eb58c370e93a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:11.422723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9e110-6f22-4c7b-a55b-eb58c370e93a service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:11.423248 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9e110-6f22-4c7b-a55b-eb58c370e93a service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:11.423721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9e110-6f22-4c7b-a55b-eb58c370e93a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:11.436298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9e110-6f22-4c7b-a55b-eb58c370e93a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:11.438186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9e110-6f22-4c7b-a55b-eb58c370e93a service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:11.449490 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 921/1844] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:33:11.452759 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 924/1845] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:33:11 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:33:11.458786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9e110-6f22-4c7b-a55b-eb58c370e93a service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:11.485107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9e110-6f22-4c7b-a55b-eb58c370e93a service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:11.596459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842fe0e-a8bb-44eb-a0d3-8944e2202147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:11.597688 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842fe0e-a8bb-44eb-a0d3-8944e2202147 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:11.598314 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842fe0e-a8bb-44eb-a0d3-8944e2202147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:11.598978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842fe0e-a8bb-44eb-a0d3-8944e2202147 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:11.600363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842fe0e-a8bb-44eb-a0d3-8944e2202147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:11.604094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842fe0e-a8bb-44eb-a0d3-8944e2202147 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:11.635142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 922/1846] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:33:11 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:33:11.640010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a8a9c-057b-4f64-93ae-7c53025fbf71 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:11.650696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a8a9c-057b-4f64-93ae-7c53025fbf71 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:11.656384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c04317-d78e-4e86-a1c5-8407c784784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:11.657649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c04317-d78e-4e86-a1c5-8407c784784c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:11.658032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c04317-d78e-4e86-a1c5-8407c784784c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:11.658478 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c04317-d78e-4e86-a1c5-8407c784784c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:11.659347 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c04317-d78e-4e86-a1c5-8407c784784c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:11.661253 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c04317-d78e-4e86-a1c5-8407c784784c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:11.679735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 925/1847] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:33:11.680968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842fe0e-a8bb-44eb-a0d3-8944e2202147 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:11.692269 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842fe0e-a8bb-44eb-a0d3-8944e2202147 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:11.697543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb918f8-bd89-4257-b1ae-77c0c73ed88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:11.698015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb918f8-bd89-4257-b1ae-77c0c73ed88e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:11.698841 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb918f8-bd89-4257-b1ae-77c0c73ed88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:11.699166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb918f8-bd89-4257-b1ae-77c0c73ed88e admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:11.700016 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb918f8-bd89-4257-b1ae-77c0c73ed88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:11.701675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb918f8-bd89-4257-b1ae-77c0c73ed88e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:11.715892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 923/1848] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:33:11.722409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c04317-d78e-4e86-a1c5-8407c784784c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:11.736441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c04317-d78e-4e86-a1c5-8407c784784c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:11.742637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ead7fb-fc15-441a-83df-c2b14aa8b392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:11.743654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead7fb-fc15-441a-83df-c2b14aa8b392 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:11.743949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead7fb-fc15-441a-83df-c2b14aa8b392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:11.744378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead7fb-fc15-441a-83df-c2b14aa8b392 admin admin] PATH_INFO: `/v3/projects/3b081fcaca0e48b6916e11ab020438af/users/71fe838f33a0453bbe3e5c09bc5c65f8/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:11.765620 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ead7fb-fc15-441a-83df-c2b14aa8b392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b081fcaca0e48b6916e11ab020438af, user_id=71fe838f33a0453bbe3e5c09bc5c65f8, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:11.769721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ead7fb-fc15-441a-83df-c2b14aa8b392 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:11.793864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 926/1849] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:33:11 2022] PUT /identity/v3/projects/3b081fcaca0e48b6916e11ab020438af/users/71fe838f33a0453bbe3e5c09bc5c65f8/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:11.806068 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38995fcc-d541-4da2-bdb0-1038381c7744 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:11.807180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38995fcc-d541-4da2-bdb0-1038381c7744 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:11.808376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38995fcc-d541-4da2-bdb0-1038381c7744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:11.847697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-38995fcc-d541-4da2-bdb0-1038381c7744 None None] MFA Rules not processed for user `71fe838f33a0453bbe3e5c09bc5c65f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:11.848994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-38995fcc-d541-4da2-bdb0-1038381c7744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:11.916877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:11.991516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ead7fb-fc15-441a-83df-c2b14aa8b392 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:11.992639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 924/1850] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:12.075412 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ead7fb-fc15-441a-83df-c2b14aa8b392 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:12.080387 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2268df-09ed-4acf-972e-49bd597dbeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:12.081180 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2268df-09ed-4acf-972e-49bd597dbeff admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:12.081649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2268df-09ed-4acf-972e-49bd597dbeff admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:12.081949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2268df-09ed-4acf-972e-49bd597dbeff admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:12.082648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2268df-09ed-4acf-972e-49bd597dbeff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:12.084539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2268df-09ed-4acf-972e-49bd597dbeff admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:12.127463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 927/1851] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:33:11 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:33:12.132367 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38995fcc-d541-4da2-bdb0-1038381c7744 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:12.149281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38995fcc-d541-4da2-bdb0-1038381c7744 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:12.218004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca587b8d-efa0-4e10-b947-ac7b7efd53df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:12.218854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca587b8d-efa0-4e10-b947-ac7b7efd53df admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:12.219721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca587b8d-efa0-4e10-b947-ac7b7efd53df admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:12.219721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca587b8d-efa0-4e10-b947-ac7b7efd53df admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:12.220118 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca587b8d-efa0-4e10-b947-ac7b7efd53df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:12.222139 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca587b8d-efa0-4e10-b947-ac7b7efd53df admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:12.250571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 925/1852] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:33:12 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:33:12.254539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2268df-09ed-4acf-972e-49bd597dbeff admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:12.267987 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2268df-09ed-4acf-972e-49bd597dbeff admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:12.285586 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f9279-e49e-40f0-80ec-bb7fa4d07c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:12.286564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f9279-e49e-40f0-80ec-bb7fa4d07c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:12.287002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f9279-e49e-40f0-80ec-bb7fa4d07c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:12.287303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f9279-e49e-40f0-80ec-bb7fa4d07c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:12.288033 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f9279-e49e-40f0-80ec-bb7fa4d07c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:12.289696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f9279-e49e-40f0-80ec-bb7fa4d07c5c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:12.303856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 928/1853] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:33:12.308413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca587b8d-efa0-4e10-b947-ac7b7efd53df admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:12.322815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca587b8d-efa0-4e10-b947-ac7b7efd53df admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:12.330355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2745ba4-b85e-445c-9b25-8ac88d028301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:12.331672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745ba4-b85e-445c-9b25-8ac88d028301 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:12.332072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745ba4-b85e-445c-9b25-8ac88d028301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:12.332462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2745ba4-b85e-445c-9b25-8ac88d028301 admin admin] PATH_INFO: `/v3/projects/7349c26554c2418bb4c4c139fcd83b4a/users/9d5edadb1a874cb4869f79ab44a693fc/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:12.359979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2745ba4-b85e-445c-9b25-8ac88d028301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7349c26554c2418bb4c4c139fcd83b4a, user_id=9d5edadb1a874cb4869f79ab44a693fc, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:12.364165 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2745ba4-b85e-445c-9b25-8ac88d028301 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:12.386348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 926/1854] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:33:12 2022] PUT /identity/v3/projects/7349c26554c2418bb4c4c139fcd83b4a/users/9d5edadb1a874cb4869f79ab44a693fc/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:12.391572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f9279-e49e-40f0-80ec-bb7fa4d07c5c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:12.427483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f9279-e49e-40f0-80ec-bb7fa4d07c5c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:12.496476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:12.517668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73010ed-9a0b-4007-a4d5-3cc1cbcf682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:12.518536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73010ed-9a0b-4007-a4d5-3cc1cbcf682d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:12.519025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73010ed-9a0b-4007-a4d5-3cc1cbcf682d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:12.519491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73010ed-9a0b-4007-a4d5-3cc1cbcf682d admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:12.520477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73010ed-9a0b-4007-a4d5-3cc1cbcf682d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:12.522447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73010ed-9a0b-4007-a4d5-3cc1cbcf682d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:12.541368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 929/1855] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:33:12.547389 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2745ba4-b85e-445c-9b25-8ac88d028301 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:12.571048 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2745ba4-b85e-445c-9b25-8ac88d028301 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:12.581070 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b1146-bda4-40ad-b4e8-c4c9ac1bd3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:12.582235 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b1146-bda4-40ad-b4e8-c4c9ac1bd3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:12.582807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b1146-bda4-40ad-b4e8-c4c9ac1bd3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:12.584208 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b1146-bda4-40ad-b4e8-c4c9ac1bd3c3 admin admin] PATH_INFO: `/v3/projects/7349c26554c2418bb4c4c139fcd83b4a/users/9d5edadb1a874cb4869f79ab44a693fc/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:12.586745 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b1146-bda4-40ad-b4e8-c4c9ac1bd3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7349c26554c2418bb4c4c139fcd83b4a, user_id=9d5edadb1a874cb4869f79ab44a693fc, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:12.591202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b1146-bda4-40ad-b4e8-c4c9ac1bd3c3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:12.605867 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 927/1856] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:33:12 2022] PUT /identity/v3/projects/7349c26554c2418bb4c4c139fcd83b4a/users/9d5edadb1a874cb4869f79ab44a693fc/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:33:12.619925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc275b5-39f9-4ede-b3e8-02dda13029d1 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:12.620904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc275b5-39f9-4ede-b3e8-02dda13029d1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:12.621335 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc275b5-39f9-4ede-b3e8-02dda13029d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:12.666239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ecc275b5-39f9-4ede-b3e8-02dda13029d1 None None] MFA Rules not processed for user `9d5edadb1a874cb4869f79ab44a693fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:12.668184 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ecc275b5-39f9-4ede-b3e8-02dda13029d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:12.796789 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 930/1857] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:12.815781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b1146-bda4-40ad-b4e8-c4c9ac1bd3c3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:12.827690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0b9b1146-bda4-40ad-b4e8-c4c9ac1bd3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:12.921067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b1146-bda4-40ad-b4e8-c4c9ac1bd3c3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:12.928411 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0a844-e31a-4ff7-b855-c8fbf997fca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:12.932577 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0a844-e31a-4ff7-b855-c8fbf997fca1 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:12.933034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0a844-e31a-4ff7-b855-c8fbf997fca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:12.933376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0a844-e31a-4ff7-b855-c8fbf997fca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:12.982264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:13.012764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0a844-e31a-4ff7-b855-c8fbf997fca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:13.014408 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0a844-e31a-4ff7-b855-c8fbf997fca1 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:13.035593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352197c-2ce7-4f6f-adb2-b40d5a87081d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:13.036105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352197c-2ce7-4f6f-adb2-b40d5a87081d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:13.036105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352197c-2ce7-4f6f-adb2-b40d5a87081d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:13.056637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 928/1858] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:33:13.057405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a352197c-2ce7-4f6f-adb2-b40d5a87081d None None] MFA Rules not processed for user `c30a4258c6024a7c9ef1fbd694fa9bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:13.058710 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a352197c-2ce7-4f6f-adb2-b40d5a87081d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:13.138609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 931/1859] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:33:13.952005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0a844-e31a-4ff7-b855-c8fbf997fca1 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:13.954582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-17c0a844-e31a-4ff7-b855-c8fbf997fca1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:14.041324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0a844-e31a-4ff7-b855-c8fbf997fca1 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:14.046473 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:14.047355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:14.047638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:14.047908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] PATH_INFO: `/v3/users/b39805476b6f49f5b714923e4e56226b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:14.050437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39805476b6f49f5b714923e4e56226b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:14.052061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:14.101559 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39805476b6f49f5b714923e4e56226b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:14.102206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39805476b6f49f5b714923e4e56226b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:14.102806 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39805476b6f49f5b714923e4e56226b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:14.117580 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39805476b6f49f5b714923e4e56226b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:14.126214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39805476b6f49f5b714923e4e56226b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:14.145617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 929/1860] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:33:13 2022] DELETE /identity/v3/users/b39805476b6f49f5b714923e4e56226b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:14.151182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e1903-5cf2-4ed3-80f6-12d14acec28b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:14.152410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e1903-5cf2-4ed3-80f6-12d14acec28b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:14.153203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e1903-5cf2-4ed3-80f6-12d14acec28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:14.178912 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-136e1903-5cf2-4ed3-80f6-12d14acec28b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:14.180137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-136e1903-5cf2-4ed3-80f6-12d14acec28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:14.255681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 932/1861] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:33:14.263061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:14.265153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:14.350350 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee21d3a-015d-4cbe-9fba-7b7d5faa968f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:14.356469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c3581-ebb0-46c6-89a5-4fa7a2fde7df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:14.357179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c3581-ebb0-46c6-89a5-4fa7a2fde7df service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:14.357739 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c3581-ebb0-46c6-89a5-4fa7a2fde7df service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:14.358031 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c3581-ebb0-46c6-89a5-4fa7a2fde7df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:14.386451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c3581-ebb0-46c6-89a5-4fa7a2fde7df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:14.388426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c3581-ebb0-46c6-89a5-4fa7a2fde7df service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:14.394382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:14.402656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 930/1862] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:33:14.822164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e1903-5cf2-4ed3-80f6-12d14acec28b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:14.823661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-136e1903-5cf2-4ed3-80f6-12d14acec28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:14.836697 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e1903-5cf2-4ed3-80f6-12d14acec28b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:14.842836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:14.843935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:14.844220 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:14.844493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] PATH_INFO: `/v3/projects/e8711961542a4eba9a059f8da9115d68` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:14.845931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8711961542a4eba9a059f8da9115d68)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:14.847852 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:14.858198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:14.922516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8711961542a4eba9a059f8da9115d68', 'request_id': 'req-d47149f4-9d65-41ca-93db-93ca49e1d89e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:14.933854 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8711961542a4eba9a059f8da9115d68', 'request_id': 'req-d47149f4-9d65-41ca-93db-93ca49e1d89e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:14.947302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8711961542a4eba9a059f8da9115d68', 'request_id': 'req-d47149f4-9d65-41ca-93db-93ca49e1d89e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:14.966414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] The token cache is being invalidate because project e8711961542a4eba9a059f8da9115d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:33:14.966715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:14.967461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:14.969182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 933/1863] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:33:14 2022] DELETE /identity/v3/projects/e8711961542a4eba9a059f8da9115d68 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:14.976414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c3581-ebb0-46c6-89a5-4fa7a2fde7df service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:14.997777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c3581-ebb0-46c6-89a5-4fa7a2fde7df service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:15.078277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2a228-5b04-4e43-8b60-40e4d24973ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:15.078648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2a228-5b04-4e43-8b60-40e4d24973ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:15.079017 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2a228-5b04-4e43-8b60-40e4d24973ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:15.079525 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2a228-5b04-4e43-8b60-40e4d24973ff admin admin] PATH_INFO: `/v3/users/072faa07eb8f4c88bc3eb89340071f6a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:15.081005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2a228-5b04-4e43-8b60-40e4d24973ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=072faa07eb8f4c88bc3eb89340071f6a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:15.082937 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2a228-5b04-4e43-8b60-40e4d24973ff admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:15.162927 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-21d2a228-5b04-4e43-8b60-40e4d24973ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072faa07eb8f4c88bc3eb89340071f6a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:15.163939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-21d2a228-5b04-4e43-8b60-40e4d24973ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072faa07eb8f4c88bc3eb89340071f6a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:15.168419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-21d2a228-5b04-4e43-8b60-40e4d24973ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072faa07eb8f4c88bc3eb89340071f6a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:15.186845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-21d2a228-5b04-4e43-8b60-40e4d24973ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072faa07eb8f4c88bc3eb89340071f6a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:15.200979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-21d2a228-5b04-4e43-8b60-40e4d24973ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072faa07eb8f4c88bc3eb89340071f6a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:15.231226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 931/1864] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:33:14 2022] DELETE /identity/v3/users/072faa07eb8f4c88bc3eb89340071f6a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:15.774379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:15.776920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:15.816344 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47149f4-9d65-41ca-93db-93ca49e1d89e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:15.968457 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25036a-e012-459a-a2ba-ce6c22508b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:15.969573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25036a-e012-459a-a2ba-ce6c22508b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:15.970093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25036a-e012-459a-a2ba-ce6c22508b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:15.970440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25036a-e012-459a-a2ba-ce6c22508b07 admin admin] PATH_INFO: `/v3/projects/19c977441f454231922455a6638b7336` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:15.974370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25036a-e012-459a-a2ba-ce6c22508b07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c977441f454231922455a6638b7336)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:15.978674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25036a-e012-459a-a2ba-ce6c22508b07 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:16.089582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5f25036a-e012-459a-a2ba-ce6c22508b07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c977441f454231922455a6638b7336', 'request_id': 'req-5f25036a-e012-459a-a2ba-ce6c22508b07'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:16.112172 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5f25036a-e012-459a-a2ba-ce6c22508b07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c977441f454231922455a6638b7336', 'request_id': 'req-5f25036a-e012-459a-a2ba-ce6c22508b07'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:16.131458 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5f25036a-e012-459a-a2ba-ce6c22508b07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c977441f454231922455a6638b7336', 'request_id': 'req-5f25036a-e012-459a-a2ba-ce6c22508b07'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:16.171474 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5f25036a-e012-459a-a2ba-ce6c22508b07 admin admin] The token cache is being invalidate because project 19c977441f454231922455a6638b7336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:33:16.171983 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5f25036a-e012-459a-a2ba-ce6c22508b07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:16.173101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5f25036a-e012-459a-a2ba-ce6c22508b07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:16.181556 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 934/1865] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:33:15 2022] DELETE /identity/v3/projects/19c977441f454231922455a6638b7336 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:16.184536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b02a5-2466-402b-82d7-b4723450f783 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:16.185195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b02a5-2466-402b-82d7-b4723450f783 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:16.185195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b02a5-2466-402b-82d7-b4723450f783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:16.211822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9e6b02a5-2466-402b-82d7-b4723450f783 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:16.213487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9e6b02a5-2466-402b-82d7-b4723450f783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:16.308287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 932/1866] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:33:16.319277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7921684-b2c2-4bd6-9087-5d39587d5987 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:16.319692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7921684-b2c2-4bd6-9087-5d39587d5987 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:16.320045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7921684-b2c2-4bd6-9087-5d39587d5987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:16.344887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b7921684-b2c2-4bd6-9087-5d39587d5987 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:16.346308 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b7921684-b2c2-4bd6-9087-5d39587d5987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:16.355268 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 935/1867] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:16.359566 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b02a5-2466-402b-82d7-b4723450f783 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:16.372005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b02a5-2466-402b-82d7-b4723450f783 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:16.378692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939577c-c37d-4487-b731-ddae78e90e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:16.379694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939577c-c37d-4487-b731-ddae78e90e41 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:16.380144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939577c-c37d-4487-b731-ddae78e90e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:16.380558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939577c-c37d-4487-b731-ddae78e90e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:16.381692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939577c-c37d-4487-b731-ddae78e90e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:33:16.382152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939577c-c37d-4487-b731-ddae78e90e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:16.384661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939577c-c37d-4487-b731-ddae78e90e41 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:16.404551 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 933/1868] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:33:16.408977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7921684-b2c2-4bd6-9087-5d39587d5987 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:16.418933 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7921684-b2c2-4bd6-9087-5d39587d5987 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:16.424099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8433e9-c1dd-4340-9b46-84f3593f1778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:16.424963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8433e9-c1dd-4340-9b46-84f3593f1778 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:16.425309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8433e9-c1dd-4340-9b46-84f3593f1778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:16.425654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8433e9-c1dd-4340-9b46-84f3593f1778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:16.426424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8433e9-c1dd-4340-9b46-84f3593f1778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:16.428575 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8433e9-c1dd-4340-9b46-84f3593f1778 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:16.443961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:16.458818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 936/1869] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:33:16 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:33:16.469136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939577c-c37d-4487-b731-ddae78e90e41 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:16.476803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:16.480792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939577c-c37d-4487-b731-ddae78e90e41 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:16.549555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b242e6-d3a7-4826-b8e7-70c2c07379e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:16.550216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b242e6-d3a7-4826-b8e7-70c2c07379e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:16.550505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b242e6-d3a7-4826-b8e7-70c2c07379e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:16.550785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b242e6-d3a7-4826-b8e7-70c2c07379e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:16.551484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b242e6-d3a7-4826-b8e7-70c2c07379e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:16.553472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b242e6-d3a7-4826-b8e7-70c2c07379e8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:16.576750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 934/1870] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:33:16 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:33:16.579651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8433e9-c1dd-4340-9b46-84f3593f1778 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:16.590193 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8433e9-c1dd-4340-9b46-84f3593f1778 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:16.594931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26b1a0-9f56-43ae-8c00-f522c4b97faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:16.595602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26b1a0-9f56-43ae-8c00-f522c4b97faa admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:16.595888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26b1a0-9f56-43ae-8c00-f522c4b97faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:16.596166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26b1a0-9f56-43ae-8c00-f522c4b97faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:16.596996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26b1a0-9f56-43ae-8c00-f522c4b97faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:16.598544 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26b1a0-9f56-43ae-8c00-f522c4b97faa admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:16.615403 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 937/1871] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:33:16.616603 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b242e6-d3a7-4826-b8e7-70c2c07379e8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:16.627450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b242e6-d3a7-4826-b8e7-70c2c07379e8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:16.632220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd843b52-3c87-44aa-8ed9-32acc927ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:16.632920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd843b52-3c87-44aa-8ed9-32acc927ce03 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:16.633231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd843b52-3c87-44aa-8ed9-32acc927ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:16.633514 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd843b52-3c87-44aa-8ed9-32acc927ce03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:16.634323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd843b52-3c87-44aa-8ed9-32acc927ce03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:16.636554 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd843b52-3c87-44aa-8ed9-32acc927ce03 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:16.652473 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 935/1872] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:33:16.653902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26b1a0-9f56-43ae-8c00-f522c4b97faa admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:16.665107 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26b1a0-9f56-43ae-8c00-f522c4b97faa admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:16.670299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83325965-8899-4acf-8389-dbb35fb66010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:16.671189 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83325965-8899-4acf-8389-dbb35fb66010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:16.671474 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83325965-8899-4acf-8389-dbb35fb66010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:16.671753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83325965-8899-4acf-8389-dbb35fb66010 admin admin] PATH_INFO: `/v3/projects/96dd50da0f364191bab24b088c1ff540/users/77117aa73ab2417f980d215c2271d460/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:16.688887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83325965-8899-4acf-8389-dbb35fb66010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96dd50da0f364191bab24b088c1ff540, user_id=77117aa73ab2417f980d215c2271d460, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:16.691614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83325965-8899-4acf-8389-dbb35fb66010 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:16.706929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 938/1873] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:33:16 2022] PUT /identity/v3/projects/96dd50da0f364191bab24b088c1ff540/users/77117aa73ab2417f980d215c2271d460/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:16.718495 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b7bd3-f3b8-4e58-9f79-5323b1970275 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:16.718787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b7bd3-f3b8-4e58-9f79-5323b1970275 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:16.719063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b7bd3-f3b8-4e58-9f79-5323b1970275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:16.750941 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-428b7bd3-f3b8-4e58-9f79-5323b1970275 None None] MFA Rules not processed for user `77117aa73ab2417f980d215c2271d460`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:16.752158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-428b7bd3-f3b8-4e58-9f79-5323b1970275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:16.838406 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 936/1874] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:16.843223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83325965-8899-4acf-8389-dbb35fb66010 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:16.927314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83325965-8899-4acf-8389-dbb35fb66010 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:16.932139 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23486c2e-be33-493a-9125-3164b697b19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:16.933650 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23486c2e-be33-493a-9125-3164b697b19b admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:16.934051 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23486c2e-be33-493a-9125-3164b697b19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:16.934329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23486c2e-be33-493a-9125-3164b697b19b admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:16.935038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23486c2e-be33-493a-9125-3164b697b19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:16.936977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23486c2e-be33-493a-9125-3164b697b19b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:16.966375 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 939/1875] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:33:16 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:33:16.970821 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b7bd3-f3b8-4e58-9f79-5323b1970275 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:16.982719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b7bd3-f3b8-4e58-9f79-5323b1970275 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:17.050233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a7fc-0d38-4f0f-ae13-9fc2a1e037a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:17.050914 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a7fc-0d38-4f0f-ae13-9fc2a1e037a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:17.051194 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a7fc-0d38-4f0f-ae13-9fc2a1e037a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:17.051469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85a7fc-0d38-4f0f-ae13-9fc2a1e037a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:17.052181 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85a7fc-0d38-4f0f-ae13-9fc2a1e037a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:17.054149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85a7fc-0d38-4f0f-ae13-9fc2a1e037a8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:17.075791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 937/1876] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:33:16 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:33:17.079778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23486c2e-be33-493a-9125-3164b697b19b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:17.090258 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23486c2e-be33-493a-9125-3164b697b19b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:17.095916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66d0ab-f99a-43e1-a53d-3e5fa6405ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:17.096591 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d0ab-f99a-43e1-a53d-3e5fa6405ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:17.096942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d0ab-f99a-43e1-a53d-3e5fa6405ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:17.097217 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d0ab-f99a-43e1-a53d-3e5fa6405ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:17.098010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66d0ab-f99a-43e1-a53d-3e5fa6405ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:17.100127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66d0ab-f99a-43e1-a53d-3e5fa6405ea6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:17.113280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 940/1877] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:33:17.117548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a7fc-0d38-4f0f-ae13-9fc2a1e037a8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:17.127942 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:17.135529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85a7fc-0d38-4f0f-ae13-9fc2a1e037a8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:17.148844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bc40f-a087-4e2e-b4c0-41ba45e31fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:17.149781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bc40f-a087-4e2e-b4c0-41ba45e31fab admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:17.150069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bc40f-a087-4e2e-b4c0-41ba45e31fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:17.150349 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bc40f-a087-4e2e-b4c0-41ba45e31fab admin admin] PATH_INFO: `/v3/projects/174198e8e4be4394b7a4bf1a67783319/users/da81e9ad14f74cd193bb53d832a3b833/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:17.171621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bc40f-a087-4e2e-b4c0-41ba45e31fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=174198e8e4be4394b7a4bf1a67783319, user_id=da81e9ad14f74cd193bb53d832a3b833, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:17.175681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90bc40f-a087-4e2e-b4c0-41ba45e31fab admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:17.194967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 938/1878] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:33:17 2022] PUT /identity/v3/projects/174198e8e4be4394b7a4bf1a67783319/users/da81e9ad14f74cd193bb53d832a3b833/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:33:17.196556 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66d0ab-f99a-43e1-a53d-3e5fa6405ea6 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:17.208467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66d0ab-f99a-43e1-a53d-3e5fa6405ea6 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:17.268926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7e567-d0b6-4018-a36e-82a8b1f187ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:17.269665 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7e567-d0b6-4018-a36e-82a8b1f187ce admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:17.269999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7e567-d0b6-4018-a36e-82a8b1f187ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:17.270283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7e567-d0b6-4018-a36e-82a8b1f187ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:17.271015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7e567-d0b6-4018-a36e-82a8b1f187ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:17.272641 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7e567-d0b6-4018-a36e-82a8b1f187ce admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:17.283436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 941/1879] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:33:17.287735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bc40f-a087-4e2e-b4c0-41ba45e31fab admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:17.299359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bc40f-a087-4e2e-b4c0-41ba45e31fab admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:17.305829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321a33-fd59-413c-9434-58e68112af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:17.306741 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321a33-fd59-413c-9434-58e68112af23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:17.307025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321a33-fd59-413c-9434-58e68112af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:17.307307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38321a33-fd59-413c-9434-58e68112af23 admin admin] PATH_INFO: `/v3/projects/174198e8e4be4394b7a4bf1a67783319/users/da81e9ad14f74cd193bb53d832a3b833/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:17.309401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38321a33-fd59-413c-9434-58e68112af23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=174198e8e4be4394b7a4bf1a67783319, user_id=da81e9ad14f74cd193bb53d832a3b833, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:17.312479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38321a33-fd59-413c-9434-58e68112af23 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:17.325449 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 939/1880] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:33:17 2022] PUT /identity/v3/projects/174198e8e4be4394b7a4bf1a67783319/users/da81e9ad14f74cd193bb53d832a3b833/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:17.335911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45747c93-62c0-4eea-9f5c-e844d7009a40 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:17.336201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45747c93-62c0-4eea-9f5c-e844d7009a40 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:17.336482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45747c93-62c0-4eea-9f5c-e844d7009a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:17.370654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-45747c93-62c0-4eea-9f5c-e844d7009a40 None None] MFA Rules not processed for user `da81e9ad14f74cd193bb53d832a3b833`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:17.371805 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-45747c93-62c0-4eea-9f5c-e844d7009a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:17.394886 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:17.452979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 942/1881] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:17.464806 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321a33-fd59-413c-9434-58e68112af23 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:17.466738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-38321a33-fd59-413c-9434-58e68112af23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:17.544589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38321a33-fd59-413c-9434-58e68112af23 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:17.548838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99783c7-318b-4161-a544-917f2bc1aa66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:17.549661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99783c7-318b-4161-a544-917f2bc1aa66 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:17.549972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99783c7-318b-4161-a544-917f2bc1aa66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:17.550273 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99783c7-318b-4161-a544-917f2bc1aa66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:17.614176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99783c7-318b-4161-a544-917f2bc1aa66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:17.615647 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99783c7-318b-4161-a544-917f2bc1aa66 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:17.626252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 940/1882] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:33:22.185688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45747c93-62c0-4eea-9f5c-e844d7009a40 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:22.200229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45747c93-62c0-4eea-9f5c-e844d7009a40 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:22.207095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285950e-796f-4c53-937d-18b4d66f718d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:22.207780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285950e-796f-4c53-937d-18b4d66f718d service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:22.208069 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285950e-796f-4c53-937d-18b4d66f718d service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:22.208362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285950e-796f-4c53-937d-18b4d66f718d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:22.210229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3285950e-796f-4c53-937d-18b4d66f718d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:22.290197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285950e-796f-4c53-937d-18b4d66f718d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:22.292208 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285950e-796f-4c53-937d-18b4d66f718d service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:22.301981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 943/1883] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:33:27.621092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=62,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:32.297582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=50 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:33.858118 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99783c7-318b-4161-a544-917f2bc1aa66 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:33.868165 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99783c7-318b-4161-a544-917f2bc1aa66 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:33.873499 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af0253-e78a-4665-88ec-adac2396cc7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:33.874260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0253-e78a-4665-88ec-adac2396cc7d service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:33.874662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0253-e78a-4665-88ec-adac2396cc7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:33.875959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0253-e78a-4665-88ec-adac2396cc7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:33.892017 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af0253-e78a-4665-88ec-adac2396cc7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:33.893707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af0253-e78a-4665-88ec-adac2396cc7d service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:33.907084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 941/1884] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:33:43.901022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:54.682386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285950e-796f-4c53-937d-18b4d66f718d service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:54.683879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3285950e-796f-4c53-937d-18b4d66f718d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:54.751277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285950e-796f-4c53-937d-18b4d66f718d service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:54.755825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:54.756696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:54.757002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:54.757272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] PATH_INFO: `/v3/users/71fe838f33a0453bbe3e5c09bc5c65f8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:54.759067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=71fe838f33a0453bbe3e5c09bc5c65f8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:54.761204 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:54.806707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71fe838f33a0453bbe3e5c09bc5c65f8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:54.807370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71fe838f33a0453bbe3e5c09bc5c65f8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:54.807985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71fe838f33a0453bbe3e5c09bc5c65f8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:54.819777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71fe838f33a0453bbe3e5c09bc5c65f8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:54.827598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71fe838f33a0453bbe3e5c09bc5c65f8'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:54.840671 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 944/1885] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:33:54 2022] DELETE /identity/v3/users/71fe838f33a0453bbe3e5c09bc5c65f8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:54.845453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a768fc-0f10-41af-bfd0-e5738b1780d3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:54.845955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a768fc-0f10-41af-bfd0-e5738b1780d3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:54.846180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a768fc-0f10-41af-bfd0-e5738b1780d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:54.864525 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-98a768fc-0f10-41af-bfd0-e5738b1780d3 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:54.865789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-98a768fc-0f10-41af-bfd0-e5738b1780d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:54.933019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 942/1886] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:54.942880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:54.944369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:55.010823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a4955-6deb-4995-8660-726a90013d4f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:55.014853 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb2bda-cfb0-42fe-aaf7-274ada23ee76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:55.015508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb2bda-cfb0-42fe-aaf7-274ada23ee76 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:55.015792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb2bda-cfb0-42fe-aaf7-274ada23ee76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:55.016091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb2bda-cfb0-42fe-aaf7-274ada23ee76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:55.026941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb2bda-cfb0-42fe-aaf7-274ada23ee76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:55.028380 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb2bda-cfb0-42fe-aaf7-274ada23ee76 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:55.038265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 945/1887] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:33:55.309008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a768fc-0f10-41af-bfd0-e5738b1780d3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:55.310437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-98a768fc-0f10-41af-bfd0-e5738b1780d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:55.322436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a768fc-0f10-41af-bfd0-e5738b1780d3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:55.327360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:55.328277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:55.328569 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:55.328872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] PATH_INFO: `/v3/projects/3b081fcaca0e48b6916e11ab020438af` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:55.330101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b081fcaca0e48b6916e11ab020438af)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:55.332109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:55.386438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b081fcaca0e48b6916e11ab020438af', 'request_id': 'req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:55.394019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b081fcaca0e48b6916e11ab020438af', 'request_id': 'req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:55.400682 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b081fcaca0e48b6916e11ab020438af', 'request_id': 'req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:55.410805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] The token cache is being invalidate because project 3b081fcaca0e48b6916e11ab020438af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:33:55.411095 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:55.411726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:55.413312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 943/1888] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:33:55 2022] DELETE /identity/v3/projects/3b081fcaca0e48b6916e11ab020438af => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:55.417947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb2bda-cfb0-42fe-aaf7-274ada23ee76 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:55.427550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb2bda-cfb0-42fe-aaf7-274ada23ee76 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:55.446062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:55.488055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb6cc2-0d25-4306-8e1a-adf773f1afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:55.488977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb6cc2-0d25-4306-8e1a-adf773f1afd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:55.489266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb6cc2-0d25-4306-8e1a-adf773f1afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:55.489541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb6cc2-0d25-4306-8e1a-adf773f1afd3 admin admin] PATH_INFO: `/v3/users/9d5edadb1a874cb4869f79ab44a693fc` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:55.490755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb6cc2-0d25-4306-8e1a-adf773f1afd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5edadb1a874cb4869f79ab44a693fc)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:55.492663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fb6cc2-0d25-4306-8e1a-adf773f1afd3 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:55.568702 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-46fb6cc2-0d25-4306-8e1a-adf773f1afd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5edadb1a874cb4869f79ab44a693fc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:55.569487 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-46fb6cc2-0d25-4306-8e1a-adf773f1afd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5edadb1a874cb4869f79ab44a693fc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:55.570231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-46fb6cc2-0d25-4306-8e1a-adf773f1afd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5edadb1a874cb4869f79ab44a693fc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:55.590134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-46fb6cc2-0d25-4306-8e1a-adf773f1afd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5edadb1a874cb4869f79ab44a693fc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:55.598190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-46fb6cc2-0d25-4306-8e1a-adf773f1afd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5edadb1a874cb4869f79ab44a693fc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:55.618037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 946/1889] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:33:55 2022] DELETE /identity/v3/users/9d5edadb1a874cb4869f79ab44a693fc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:55.970526 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:55.972108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:55.991363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c96ff3-6a01-4be8-a9e3-7a074192d3ef admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:56.065455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:56.066474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.066769 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.067054 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] PATH_INFO: `/v3/projects/7349c26554c2418bb4c4c139fcd83b4a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.068315 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7349c26554c2418bb4c4c139fcd83b4a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:56.070271 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:56.107206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:56.130263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7349c26554c2418bb4c4c139fcd83b4a', 'request_id': 'req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:56.139717 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7349c26554c2418bb4c4c139fcd83b4a', 'request_id': 'req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:56.148387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7349c26554c2418bb4c4c139fcd83b4a', 'request_id': 'req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:56.163940 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] The token cache is being invalidate because project 7349c26554c2418bb4c4c139fcd83b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:33:56.164855 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:56.167977 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:56.169646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 944/1890] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:33:55 2022] DELETE /identity/v3/projects/7349c26554c2418bb4c4c139fcd83b4a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:56.175766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a4bf4-7df9-441d-982f-12e4adb0dcb2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.176196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a4bf4-7df9-441d-982f-12e4adb0dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.176301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a4bf4-7df9-441d-982f-12e4adb0dcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.185809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:56.190731 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:56.195639 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-be0a4bf4-7df9-441d-982f-12e4adb0dcb2 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:56.196866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-be0a4bf4-7df9-441d-982f-12e4adb0dcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:56.279857 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b2ac3b-6e1d-4c56-abf7-b0ec6c003e3f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:56.284549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce04b1-975e-4098-97a3-1ef1e96da376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:56.285470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce04b1-975e-4098-97a3-1ef1e96da376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.285753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce04b1-975e-4098-97a3-1ef1e96da376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.286028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce04b1-975e-4098-97a3-1ef1e96da376 admin admin] PATH_INFO: `/v3/users/38ae76bed1274c7a9b4e287694384117` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.287233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce04b1-975e-4098-97a3-1ef1e96da376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ae76bed1274c7a9b4e287694384117)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:56.289367 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce04b1-975e-4098-97a3-1ef1e96da376 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:56.296575 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 947/1891] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:56.304588 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0cc2-7bb3-4cab-9e84-388ef76dbd67 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.305542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0cc2-7bb3-4cab-9e84-388ef76dbd67 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.306570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0cc2-7bb3-4cab-9e84-388ef76dbd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.324827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-dc2c0cc2-7bb3-4cab-9e84-388ef76dbd67 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:56.326038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dc2c0cc2-7bb3-4cab-9e84-388ef76dbd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:56.334051 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 948/1892] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:33:56.337632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-96ce04b1-975e-4098-97a3-1ef1e96da376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ae76bed1274c7a9b4e287694384117'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:56.338376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-96ce04b1-975e-4098-97a3-1ef1e96da376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ae76bed1274c7a9b4e287694384117'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:56.338494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c0cc2-7bb3-4cab-9e84-388ef76dbd67 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:56.339113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-96ce04b1-975e-4098-97a3-1ef1e96da376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ae76bed1274c7a9b4e287694384117'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:56.348244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c0cc2-7bb3-4cab-9e84-388ef76dbd67 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:56.353542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7b97d-0bb7-4755-93af-910c5dba62a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:56.354073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-96ce04b1-975e-4098-97a3-1ef1e96da376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ae76bed1274c7a9b4e287694384117'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:56.354228 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7b97d-0bb7-4755-93af-910c5dba62a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.354516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7b97d-0bb7-4755-93af-910c5dba62a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.354823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7b97d-0bb7-4755-93af-910c5dba62a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.355571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7b97d-0bb7-4755-93af-910c5dba62a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:33:56.355960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7b97d-0bb7-4755-93af-910c5dba62a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:56.357611 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7b97d-0bb7-4755-93af-910c5dba62a1 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:56.364073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-96ce04b1-975e-4098-97a3-1ef1e96da376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ae76bed1274c7a9b4e287694384117'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:56.371808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 949/1893] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:33:56.377046 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7b97d-0bb7-4755-93af-910c5dba62a1 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:56.379185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6ea7b97d-0bb7-4755-93af-910c5dba62a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:56.382344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 945/1894] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:33:56 2022] DELETE /identity/v3/users/38ae76bed1274c7a9b4e287694384117 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:56.387334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f06df-7783-415d-a7b1-5780f863dc66 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.387875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f06df-7783-415d-a7b1-5780f863dc66 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.388158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f06df-7783-415d-a7b1-5780f863dc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.393765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7b97d-0bb7-4755-93af-910c5dba62a1 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:56.405463 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-063f06df-7783-415d-a7b1-5780f863dc66 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:56.406655 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-063f06df-7783-415d-a7b1-5780f863dc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:56.412289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:56.437129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:56.453889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b98f3c-ee8b-479d-8faf-648503690468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:56.454563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b98f3c-ee8b-479d-8faf-648503690468 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.454861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b98f3c-ee8b-479d-8faf-648503690468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.455142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b98f3c-ee8b-479d-8faf-648503690468 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.455855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b98f3c-ee8b-479d-8faf-648503690468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:56.457779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b98f3c-ee8b-479d-8faf-648503690468 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:56.469948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 946/1895] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:33:56.480378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f06df-7783-415d-a7b1-5780f863dc66 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:56.482088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-063f06df-7783-415d-a7b1-5780f863dc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:56.488076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 950/1896] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:33:56 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:33:56.489007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b98f3c-ee8b-479d-8faf-648503690468 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:56.539664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f06df-7783-415d-a7b1-5780f863dc66 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:56.554106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b98f3c-ee8b-479d-8faf-648503690468 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:56.560190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa5c7b-6b64-49fd-acca-f2793dfcc354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:56.560927 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa5c7b-6b64-49fd-acca-f2793dfcc354 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.561583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa5c7b-6b64-49fd-acca-f2793dfcc354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.561862 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa5c7b-6b64-49fd-acca-f2793dfcc354 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.562562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa5c7b-6b64-49fd-acca-f2793dfcc354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:56.564789 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa5c7b-6b64-49fd-acca-f2793dfcc354 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:56.586949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 951/1897] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:33:56 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:33:56.590735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa5c7b-6b64-49fd-acca-f2793dfcc354 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:56.592565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1c99-975f-404e-b1a9-778a8011f16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:56.593259 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1c99-975f-404e-b1a9-778a8011f16c service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.593546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1c99-975f-404e-b1a9-778a8011f16c service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.593821 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c1c99-975f-404e-b1a9-778a8011f16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.600275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa5c7b-6b64-49fd-acca-f2793dfcc354 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:56.603829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c1c99-975f-404e-b1a9-778a8011f16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:56.605370 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c1c99-975f-404e-b1a9-778a8011f16c service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:56.606431 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c8b5c-d742-46ea-8de0-0e6f8927ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:56.607116 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c8b5c-d742-46ea-8de0-0e6f8927ec84 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.607398 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c8b5c-d742-46ea-8de0-0e6f8927ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.607673 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c8b5c-d742-46ea-8de0-0e6f8927ec84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.608422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c8b5c-d742-46ea-8de0-0e6f8927ec84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:56.610314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c8b5c-d742-46ea-8de0-0e6f8927ec84 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:56.615071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 947/1898] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:33:56.621143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 952/1899] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:33:56.624966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1c99-975f-404e-b1a9-778a8011f16c service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:56.634387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c1c99-975f-404e-b1a9-778a8011f16c service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:56.639426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282fe4e-682e-4b40-a983-dd4f1f5ed03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:56.640096 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282fe4e-682e-4b40-a983-dd4f1f5ed03d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.640377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282fe4e-682e-4b40-a983-dd4f1f5ed03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.640655 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282fe4e-682e-4b40-a983-dd4f1f5ed03d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.641419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282fe4e-682e-4b40-a983-dd4f1f5ed03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:56.643012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282fe4e-682e-4b40-a983-dd4f1f5ed03d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:56.653519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 948/1900] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:33:56.658340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c8b5c-d742-46ea-8de0-0e6f8927ec84 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:56.671650 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c8b5c-d742-46ea-8de0-0e6f8927ec84 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:56.676923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cba528-04a7-4271-8481-2c145ab27983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:56.677888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cba528-04a7-4271-8481-2c145ab27983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.678266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cba528-04a7-4271-8481-2c145ab27983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.678609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cba528-04a7-4271-8481-2c145ab27983 admin admin] PATH_INFO: `/v3/projects/dd2c97ddd23f4856b7ea1432b9c7adb6/users/27dac74ce39b46bfbf440885fe1fd9d3/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.696953 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cba528-04a7-4271-8481-2c145ab27983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2c97ddd23f4856b7ea1432b9c7adb6, user_id=27dac74ce39b46bfbf440885fe1fd9d3, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:56.699731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cba528-04a7-4271-8481-2c145ab27983 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:56.713663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 953/1901] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:33:56 2022] PUT /identity/v3/projects/dd2c97ddd23f4856b7ea1432b9c7adb6/users/27dac74ce39b46bfbf440885fe1fd9d3/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:56.725213 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379871b-528f-4fa2-8350-8d1b544c1bae None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.725556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379871b-528f-4fa2-8350-8d1b544c1bae None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.725833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379871b-528f-4fa2-8350-8d1b544c1bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.753650 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1379871b-528f-4fa2-8350-8d1b544c1bae None None] MFA Rules not processed for user `27dac74ce39b46bfbf440885fe1fd9d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:56.754958 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1379871b-528f-4fa2-8350-8d1b544c1bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:56.853397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 949/1902] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:56.865196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cba528-04a7-4271-8481-2c145ab27983 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:56.868053 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-20cba528-04a7-4271-8481-2c145ab27983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:56.930249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cba528-04a7-4271-8481-2c145ab27983 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:56.934105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68d74-1f38-43d7-8188-374f30165c8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:56.934846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68d74-1f38-43d7-8188-374f30165c8a service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:56.935199 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68d74-1f38-43d7-8188-374f30165c8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:56.935555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea68d74-1f38-43d7-8188-374f30165c8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:56.944436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea68d74-1f38-43d7-8188-374f30165c8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:56.946609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea68d74-1f38-43d7-8188-374f30165c8a service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:56.956515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 954/1903] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:33:57.071295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379871b-528f-4fa2-8350-8d1b544c1bae None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:57.072901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1379871b-528f-4fa2-8350-8d1b544c1bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:57.094769 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:57.158613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379871b-528f-4fa2-8350-8d1b544c1bae None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:57.163836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:57.165428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:57.165713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:57.165991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] PATH_INFO: `/v3/projects/628ee9a93ad54e75bda726f6abf4e16b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:57.167595 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=628ee9a93ad54e75bda726f6abf4e16b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:57.169184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:57.220277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '628ee9a93ad54e75bda726f6abf4e16b', 'request_id': 'req-67943efe-b515-422f-8013-78c378f4f877'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.229720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '628ee9a93ad54e75bda726f6abf4e16b', 'request_id': 'req-67943efe-b515-422f-8013-78c378f4f877'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.237398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '628ee9a93ad54e75bda726f6abf4e16b', 'request_id': 'req-67943efe-b515-422f-8013-78c378f4f877'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.249456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] The token cache is being invalidate because project 628ee9a93ad54e75bda726f6abf4e16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:33:57.249709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.250451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.252062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 950/1904] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:33:57 2022] DELETE /identity/v3/projects/628ee9a93ad54e75bda726f6abf4e16b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:57.256735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68d74-1f38-43d7-8188-374f30165c8a service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:57.264183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:57.269119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea68d74-1f38-43d7-8188-374f30165c8a service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:57.346210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80407839-709e-4c78-858c-fd6a1a5af80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:57.347181 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80407839-709e-4c78-858c-fd6a1a5af80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:57.347467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80407839-709e-4c78-858c-fd6a1a5af80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:57.347748 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80407839-709e-4c78-858c-fd6a1a5af80d admin admin] PATH_INFO: `/v3/users/ce09136115ce4b9ba54fe298325af294` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:57.349009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80407839-709e-4c78-858c-fd6a1a5af80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce09136115ce4b9ba54fe298325af294)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:57.351038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80407839-709e-4c78-858c-fd6a1a5af80d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:57.404653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-80407839-709e-4c78-858c-fd6a1a5af80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce09136115ce4b9ba54fe298325af294'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.405365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-80407839-709e-4c78-858c-fd6a1a5af80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce09136115ce4b9ba54fe298325af294'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.406009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-80407839-709e-4c78-858c-fd6a1a5af80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce09136115ce4b9ba54fe298325af294'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.419358 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-80407839-709e-4c78-858c-fd6a1a5af80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce09136115ce4b9ba54fe298325af294'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.426509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-80407839-709e-4c78-858c-fd6a1a5af80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce09136115ce4b9ba54fe298325af294'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.441684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 955/1905] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:33:57 2022] DELETE /identity/v3/users/ce09136115ce4b9ba54fe298325af294 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:33:57.709148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:57.710605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:57.724390 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67943efe-b515-422f-8013-78c378f4f877 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:57.791624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1c30b-913f-443d-8362-19c9ef06a004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:57.792490 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c30b-913f-443d-8362-19c9ef06a004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:57.792803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c30b-913f-443d-8362-19c9ef06a004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:57.793079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c30b-913f-443d-8362-19c9ef06a004 admin admin] PATH_INFO: `/v3/projects/4e9a3627a906480c824cb7cd608cd636` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:57.794256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1c30b-913f-443d-8362-19c9ef06a004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9a3627a906480c824cb7cd608cd636)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:57.796157 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1c30b-913f-443d-8362-19c9ef06a004 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:57.837883 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:57.841838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71c1c30b-913f-443d-8362-19c9ef06a004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9a3627a906480c824cb7cd608cd636', 'request_id': 'req-71c1c30b-913f-443d-8362-19c9ef06a004'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.851251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71c1c30b-913f-443d-8362-19c9ef06a004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9a3627a906480c824cb7cd608cd636', 'request_id': 'req-71c1c30b-913f-443d-8362-19c9ef06a004'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.858649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71c1c30b-913f-443d-8362-19c9ef06a004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9a3627a906480c824cb7cd608cd636', 'request_id': 'req-71c1c30b-913f-443d-8362-19c9ef06a004'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.869000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71c1c30b-913f-443d-8362-19c9ef06a004 admin admin] The token cache is being invalidate because project 4e9a3627a906480c824cb7cd608cd636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:33:57.869292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71c1c30b-913f-443d-8362-19c9ef06a004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.869941 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71c1c30b-913f-443d-8362-19c9ef06a004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:33:57.871509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 951/1906] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:33:57 2022] DELETE /identity/v3/projects/4e9a3627a906480c824cb7cd608cd636 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:57.876234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a2a15-5ecc-4da5-bfdf-5e9eb8fe239f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:57.876521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a2a15-5ecc-4da5-bfdf-5e9eb8fe239f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:57.876836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a2a15-5ecc-4da5-bfdf-5e9eb8fe239f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:57.897343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ab1a2a15-5ecc-4da5-bfdf-5e9eb8fe239f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:57.899051 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ab1a2a15-5ecc-4da5-bfdf-5e9eb8fe239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:57.956565 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 956/1907] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:57.964996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0af272-6907-4957-8b55-9128e976ca13 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:57.965308 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0af272-6907-4957-8b55-9128e976ca13 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:57.965613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0af272-6907-4957-8b55-9128e976ca13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:57.984134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-bf0af272-6907-4957-8b55-9128e976ca13 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:57.985295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bf0af272-6907-4957-8b55-9128e976ca13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:57.993760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 952/1908] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:57.997823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a2a15-5ecc-4da5-bfdf-5e9eb8fe239f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:58.007376 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a2a15-5ecc-4da5-bfdf-5e9eb8fe239f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:58.012303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef126fe-07fc-4a50-97eb-316fc5a62ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:58.013234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef126fe-07fc-4a50-97eb-316fc5a62ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.013515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef126fe-07fc-4a50-97eb-316fc5a62ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.013786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef126fe-07fc-4a50-97eb-316fc5a62ddf admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.014499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef126fe-07fc-4a50-97eb-316fc5a62ddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:33:58.014807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef126fe-07fc-4a50-97eb-316fc5a62ddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:58.016382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef126fe-07fc-4a50-97eb-316fc5a62ddf admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:58.027960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 957/1909] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:33:58.032005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0af272-6907-4957-8b55-9128e976ca13 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:58.041706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0af272-6907-4957-8b55-9128e976ca13 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:58.046441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417033c-00ad-4152-8d41-b1c5b6674e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:58.047074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417033c-00ad-4152-8d41-b1c5b6674e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.047358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417033c-00ad-4152-8d41-b1c5b6674e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.047635 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417033c-00ad-4152-8d41-b1c5b6674e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.048368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417033c-00ad-4152-8d41-b1c5b6674e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:58.050296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417033c-00ad-4152-8d41-b1c5b6674e19 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:58.080910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 953/1910] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:33:58 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:33:58.084904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef126fe-07fc-4a50-97eb-316fc5a62ddf admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:58.095020 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef126fe-07fc-4a50-97eb-316fc5a62ddf admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:58.111327 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:58.169843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64ddeb-3df7-4c44-ad7a-1b9ebf917554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:58.170692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64ddeb-3df7-4c44-ad7a-1b9ebf917554 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.170801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64ddeb-3df7-4c44-ad7a-1b9ebf917554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.171056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64ddeb-3df7-4c44-ad7a-1b9ebf917554 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.171788 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64ddeb-3df7-4c44-ad7a-1b9ebf917554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:58.173701 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64ddeb-3df7-4c44-ad7a-1b9ebf917554 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:58.195547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 958/1911] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:33:58 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:33:58.199718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417033c-00ad-4152-8d41-b1c5b6674e19 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:58.210454 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417033c-00ad-4152-8d41-b1c5b6674e19 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:58.215578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b60c6e-edea-4d98-98f1-9b28ecd5a01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:58.216338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b60c6e-edea-4d98-98f1-9b28ecd5a01a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.216726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b60c6e-edea-4d98-98f1-9b28ecd5a01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.217083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b60c6e-edea-4d98-98f1-9b28ecd5a01a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.217899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b60c6e-edea-4d98-98f1-9b28ecd5a01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:58.219587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b60c6e-edea-4d98-98f1-9b28ecd5a01a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:58.234489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 954/1912] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:33:58.235587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64ddeb-3df7-4c44-ad7a-1b9ebf917554 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:58.246409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64ddeb-3df7-4c44-ad7a-1b9ebf917554 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:58.251521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fea75-c8d3-441e-b252-8142ebdd0613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:58.252194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fea75-c8d3-441e-b252-8142ebdd0613 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.252478 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fea75-c8d3-441e-b252-8142ebdd0613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.252921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fea75-c8d3-441e-b252-8142ebdd0613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.253675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fea75-c8d3-441e-b252-8142ebdd0613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:58.255379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fea75-c8d3-441e-b252-8142ebdd0613 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:58.266943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 959/1913] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:33:58.271138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b60c6e-edea-4d98-98f1-9b28ecd5a01a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:58.281591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b60c6e-edea-4d98-98f1-9b28ecd5a01a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:58.286565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb96487-9b9c-4462-9c39-df4ab4ee7259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:58.287465 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96487-9b9c-4462-9c39-df4ab4ee7259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.287750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96487-9b9c-4462-9c39-df4ab4ee7259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.288287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96487-9b9c-4462-9c39-df4ab4ee7259 admin admin] PATH_INFO: `/v3/projects/3a5e377dad71430891b99330107e71a8/users/75a134de1e3a4737896e902d8585b68a/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.304076 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb96487-9b9c-4462-9c39-df4ab4ee7259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5e377dad71430891b99330107e71a8, user_id=75a134de1e3a4737896e902d8585b68a, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:58.306972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb96487-9b9c-4462-9c39-df4ab4ee7259 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:58.323842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 955/1914] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:33:58 2022] PUT /identity/v3/projects/3a5e377dad71430891b99330107e71a8/users/75a134de1e3a4737896e902d8585b68a/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:58.334791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f24ef-b71f-4ba4-be4e-3f19451653a5 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.335199 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f24ef-b71f-4ba4-be4e-3f19451653a5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.335694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f24ef-b71f-4ba4-be4e-3f19451653a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.363541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-cb1f24ef-b71f-4ba4-be4e-3f19451653a5 None None] MFA Rules not processed for user `75a134de1e3a4737896e902d8585b68a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:58.364894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cb1f24ef-b71f-4ba4-be4e-3f19451653a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:58.430612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 960/1915] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:58.435307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb96487-9b9c-4462-9c39-df4ab4ee7259 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:58.497010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb96487-9b9c-4462-9c39-df4ab4ee7259 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:58.501613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f81310-0c26-4c45-9dda-3beba9d0c314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:58.502283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f81310-0c26-4c45-9dda-3beba9d0c314 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.502567 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f81310-0c26-4c45-9dda-3beba9d0c314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.502847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f81310-0c26-4c45-9dda-3beba9d0c314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.503550 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f81310-0c26-4c45-9dda-3beba9d0c314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:58.505509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f81310-0c26-4c45-9dda-3beba9d0c314 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:58.535919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 956/1916] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:33:58 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:33:58.537083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f24ef-b71f-4ba4-be4e-3f19451653a5 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:58.548193 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f24ef-b71f-4ba4-be4e-3f19451653a5 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:58.611017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edd7c7-3a02-4152-a362-a8b1025bdbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:58.611702 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edd7c7-3a02-4152-a362-a8b1025bdbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.611982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edd7c7-3a02-4152-a362-a8b1025bdbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.612255 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edd7c7-3a02-4152-a362-a8b1025bdbb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.612980 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edd7c7-3a02-4152-a362-a8b1025bdbb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:58.614894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46edd7c7-3a02-4152-a362-a8b1025bdbb7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:58.638241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 961/1917] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:33:58 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:33:58.642262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f81310-0c26-4c45-9dda-3beba9d0c314 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:58.653897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f81310-0c26-4c45-9dda-3beba9d0c314 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:58.667481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c903da-6e10-4560-a6e1-a7c135fc0edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:58.668163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c903da-6e10-4560-a6e1-a7c135fc0edb admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.668450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c903da-6e10-4560-a6e1-a7c135fc0edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.668738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c903da-6e10-4560-a6e1-a7c135fc0edb admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.669493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c903da-6e10-4560-a6e1-a7c135fc0edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:58.671096 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c903da-6e10-4560-a6e1-a7c135fc0edb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:58.682541 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 957/1918] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:33:58.686893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edd7c7-3a02-4152-a362-a8b1025bdbb7 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:58.697561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edd7c7-3a02-4152-a362-a8b1025bdbb7 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:58.702259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7614a1-ef5b-4f77-9770-fb50fecc2015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:58.703145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7614a1-ef5b-4f77-9770-fb50fecc2015 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.703437 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7614a1-ef5b-4f77-9770-fb50fecc2015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.703723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7614a1-ef5b-4f77-9770-fb50fecc2015 admin admin] PATH_INFO: `/v3/projects/dbcf11d847e34c8084cc1d4791abf723/users/8d822140e0cb42c88f462299c1b67cf5/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.706781 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:58.719560 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7614a1-ef5b-4f77-9770-fb50fecc2015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcf11d847e34c8084cc1d4791abf723, user_id=8d822140e0cb42c88f462299c1b67cf5, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:58.722233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7614a1-ef5b-4f77-9770-fb50fecc2015 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:58.735242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 962/1919] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:33:58 2022] PUT /identity/v3/projects/dbcf11d847e34c8084cc1d4791abf723/users/8d822140e0cb42c88f462299c1b67cf5/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:33:58.739142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c903da-6e10-4560-a6e1-a7c135fc0edb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:58.749936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c903da-6e10-4560-a6e1-a7c135fc0edb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:58.792532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:33:58.813871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ada554-6aa1-425b-9242-1789c29b50aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:58.814542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ada554-6aa1-425b-9242-1789c29b50aa admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.814828 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ada554-6aa1-425b-9242-1789c29b50aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.815108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ada554-6aa1-425b-9242-1789c29b50aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.815838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ada554-6aa1-425b-9242-1789c29b50aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:58.817486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ada554-6aa1-425b-9242-1789c29b50aa admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:58.828143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 958/1920] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:33:58.832279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7614a1-ef5b-4f77-9770-fb50fecc2015 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:58.844300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7614a1-ef5b-4f77-9770-fb50fecc2015 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:58.849195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4abda2-e46a-4b4d-851e-9be89a4ca3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:58.850090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4abda2-e46a-4b4d-851e-9be89a4ca3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.850368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4abda2-e46a-4b4d-851e-9be89a4ca3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.850668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4abda2-e46a-4b4d-851e-9be89a4ca3ff admin admin] PATH_INFO: `/v3/projects/dbcf11d847e34c8084cc1d4791abf723/users/8d822140e0cb42c88f462299c1b67cf5/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.853397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4abda2-e46a-4b4d-851e-9be89a4ca3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbcf11d847e34c8084cc1d4791abf723, user_id=8d822140e0cb42c88f462299c1b67cf5, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:58.856017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4abda2-e46a-4b4d-851e-9be89a4ca3ff admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:58.868582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 963/1921] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:33:58 2022] PUT /identity/v3/projects/dbcf11d847e34c8084cc1d4791abf723/users/8d822140e0cb42c88f462299c1b67cf5/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:33:58.883408 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13387a4a-d7b8-4528-9ef2-8759f0cc6b92 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:58.883759 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13387a4a-d7b8-4528-9ef2-8759f0cc6b92 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:58.884109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13387a4a-d7b8-4528-9ef2-8759f0cc6b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:58.914701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-13387a4a-d7b8-4528-9ef2-8759f0cc6b92 None None] MFA Rules not processed for user `8d822140e0cb42c88f462299c1b67cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:33:58.915925 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-13387a4a-d7b8-4528-9ef2-8759f0cc6b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:58.986280 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 959/1922] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:33:58.996954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4abda2-e46a-4b4d-851e-9be89a4ca3ff admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:33:58.998689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5c4abda2-e46a-4b4d-851e-9be89a4ca3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:33:59.059249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4abda2-e46a-4b4d-851e-9be89a4ca3ff admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:33:59.063068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0147f6c6-7616-4d1c-93c2-f050c1b95bb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:33:59.063725 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147f6c6-7616-4d1c-93c2-f050c1b95bb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:33:59.064017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147f6c6-7616-4d1c-93c2-f050c1b95bb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:33:59.064298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0147f6c6-7616-4d1c-93c2-f050c1b95bb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:33:59.074151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147f6c6-7616-4d1c-93c2-f050c1b95bb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:33:59.075606 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0147f6c6-7616-4d1c-93c2-f050c1b95bb5 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:33:59.085663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 964/1923] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:33:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:00.448251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13387a4a-d7b8-4528-9ef2-8759f0cc6b92 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:00.514307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13387a4a-d7b8-4528-9ef2-8759f0cc6b92 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:00.518786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:00.519657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:00.519938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:00.520213 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] PATH_INFO: `/v3/users/75a134de1e3a4737896e902d8585b68a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:00.521431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a134de1e3a4737896e902d8585b68a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:00.523484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:00.572037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a134de1e3a4737896e902d8585b68a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:00.572789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a134de1e3a4737896e902d8585b68a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:00.573434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a134de1e3a4737896e902d8585b68a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:00.587870 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a134de1e3a4737896e902d8585b68a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:00.589950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:00.602144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a134de1e3a4737896e902d8585b68a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:00.618170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 960/1924] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:00 2022] DELETE /identity/v3/users/75a134de1e3a4737896e902d8585b68a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:00.623049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429a903-fd64-438f-b133-1eca8a08922b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:00.623549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429a903-fd64-438f-b133-1eca8a08922b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:00.623637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429a903-fd64-438f-b133-1eca8a08922b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:00.642112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9429a903-fd64-438f-b133-1eca8a08922b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:00.643328 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9429a903-fd64-438f-b133-1eca8a08922b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:00.715808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 965/1925] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:00.722588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:00.723997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:00.785372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e4d2a-eddc-478e-9805-e958efb3ab61 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:00.794242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280d9bf-67fb-4e7f-a977-56325e81d0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:00.794903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280d9bf-67fb-4e7f-a977-56325e81d0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:00.795188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280d9bf-67fb-4e7f-a977-56325e81d0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:00.795471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280d9bf-67fb-4e7f-a977-56325e81d0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:00.805343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280d9bf-67fb-4e7f-a977-56325e81d0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:00.806864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280d9bf-67fb-4e7f-a977-56325e81d0c0 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:00.816239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 961/1926] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:01.100992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429a903-fd64-438f-b133-1eca8a08922b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:01.103063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9429a903-fd64-438f-b133-1eca8a08922b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:01.116683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429a903-fd64-438f-b133-1eca8a08922b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:01.121633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:01.122531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:01.122813 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:01.123088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] PATH_INFO: `/v3/projects/3a5e377dad71430891b99330107e71a8` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:01.124285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5e377dad71430891b99330107e71a8)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:01.126390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:01.174797 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5e377dad71430891b99330107e71a8', 'request_id': 'req-a322dd3b-2d75-42ca-a2b5-faa57c450641'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.182274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5e377dad71430891b99330107e71a8', 'request_id': 'req-a322dd3b-2d75-42ca-a2b5-faa57c450641'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.188686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5e377dad71430891b99330107e71a8', 'request_id': 'req-a322dd3b-2d75-42ca-a2b5-faa57c450641'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.195049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:01.201021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] The token cache is being invalidate because project 3a5e377dad71430891b99330107e71a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:01.201543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.202636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.204260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 966/1927] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:01 2022] DELETE /identity/v3/projects/3a5e377dad71430891b99330107e71a8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:01.208255 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280d9bf-67fb-4e7f-a977-56325e81d0c0 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:01.218572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280d9bf-67fb-4e7f-a977-56325e81d0c0 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:01.275814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fc4dd-cdb1-4ab5-be1e-2c0299b677e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:01.276767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fc4dd-cdb1-4ab5-be1e-2c0299b677e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:01.277102 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fc4dd-cdb1-4ab5-be1e-2c0299b677e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:01.277420 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fc4dd-cdb1-4ab5-be1e-2c0299b677e0 admin admin] PATH_INFO: `/v3/users/8d822140e0cb42c88f462299c1b67cf5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:01.278881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fc4dd-cdb1-4ab5-be1e-2c0299b677e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d822140e0cb42c88f462299c1b67cf5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:01.281029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fc4dd-cdb1-4ab5-be1e-2c0299b677e0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:01.326814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4a7fc4dd-cdb1-4ab5-be1e-2c0299b677e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d822140e0cb42c88f462299c1b67cf5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.327377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4a7fc4dd-cdb1-4ab5-be1e-2c0299b677e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d822140e0cb42c88f462299c1b67cf5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.327985 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4a7fc4dd-cdb1-4ab5-be1e-2c0299b677e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d822140e0cb42c88f462299c1b67cf5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.340307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4a7fc4dd-cdb1-4ab5-be1e-2c0299b677e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d822140e0cb42c88f462299c1b67cf5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.347064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4a7fc4dd-cdb1-4ab5-be1e-2c0299b677e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d822140e0cb42c88f462299c1b67cf5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.359236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 962/1928] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:01 2022] DELETE /identity/v3/users/8d822140e0cb42c88f462299c1b67cf5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:01.652939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:01.654530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:01.668901 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322dd3b-2d75-42ca-a2b5-faa57c450641 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:01.732010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d4acb-d941-45d3-8a1a-d45fd919894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:01.732929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d4acb-d941-45d3-8a1a-d45fd919894c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:01.733255 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d4acb-d941-45d3-8a1a-d45fd919894c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:01.733535 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d4acb-d941-45d3-8a1a-d45fd919894c admin admin] PATH_INFO: `/v3/projects/dbcf11d847e34c8084cc1d4791abf723` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:01.734751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d4acb-d941-45d3-8a1a-d45fd919894c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbcf11d847e34c8084cc1d4791abf723)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:01.736668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d4acb-d941-45d3-8a1a-d45fd919894c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:01.793136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d69d4acb-d941-45d3-8a1a-d45fd919894c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbcf11d847e34c8084cc1d4791abf723', 'request_id': 'req-d69d4acb-d941-45d3-8a1a-d45fd919894c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.803930 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d69d4acb-d941-45d3-8a1a-d45fd919894c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbcf11d847e34c8084cc1d4791abf723', 'request_id': 'req-d69d4acb-d941-45d3-8a1a-d45fd919894c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.812079 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d69d4acb-d941-45d3-8a1a-d45fd919894c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbcf11d847e34c8084cc1d4791abf723', 'request_id': 'req-d69d4acb-d941-45d3-8a1a-d45fd919894c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.823596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d69d4acb-d941-45d3-8a1a-d45fd919894c admin admin] The token cache is being invalidate because project dbcf11d847e34c8084cc1d4791abf723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:01.824175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d69d4acb-d941-45d3-8a1a-d45fd919894c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.824587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d69d4acb-d941-45d3-8a1a-d45fd919894c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:01.826238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 967/1929] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:01 2022] DELETE /identity/v3/projects/dbcf11d847e34c8084cc1d4791abf723 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:01.831077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed5510-ca52-4ed1-bfdc-84a6f716cca8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:01.831562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed5510-ca52-4ed1-bfdc-84a6f716cca8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:01.831727 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed5510-ca52-4ed1-bfdc-84a6f716cca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:01.841348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:01.855702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9eed5510-ca52-4ed1-bfdc-84a6f716cca8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:01.857228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9eed5510-ca52-4ed1-bfdc-84a6f716cca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:01.928610 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 963/1930] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:01.931423 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d699b-9c16-45ff-af82-1fc572ec3b24 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:01.931715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d699b-9c16-45ff-af82-1fc572ec3b24 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:01.932000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d699b-9c16-45ff-af82-1fc572ec3b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:01.950942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-952d699b-9c16-45ff-af82-1fc572ec3b24 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:01.952273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-952d699b-9c16-45ff-af82-1fc572ec3b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:01.960650 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 968/1931] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:01.965311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed5510-ca52-4ed1-bfdc-84a6f716cca8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:01.979238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed5510-ca52-4ed1-bfdc-84a6f716cca8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:01.988876 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db0a80-15b9-4666-81bd-6eac6e1f5b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:01.989562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db0a80-15b9-4666-81bd-6eac6e1f5b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:01.989848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db0a80-15b9-4666-81bd-6eac6e1f5b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:01.990275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db0a80-15b9-4666-81bd-6eac6e1f5b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:01.991035 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db0a80-15b9-4666-81bd-6eac6e1f5b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:01.991349 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db0a80-15b9-4666-81bd-6eac6e1f5b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:01.993572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db0a80-15b9-4666-81bd-6eac6e1f5b68 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:02.009763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 964/1932] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:02.013219 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d699b-9c16-45ff-af82-1fc572ec3b24 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:02.024051 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d699b-9c16-45ff-af82-1fc572ec3b24 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:02.029819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c5d0e-a0d4-48e0-965a-44d5ebb7f801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:02.030619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c5d0e-a0d4-48e0-965a-44d5ebb7f801 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:02.031042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c5d0e-a0d4-48e0-965a-44d5ebb7f801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:02.031459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c5d0e-a0d4-48e0-965a-44d5ebb7f801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:02.032477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c5d0e-a0d4-48e0-965a-44d5ebb7f801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:02.034571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c5d0e-a0d4-48e0-965a-44d5ebb7f801 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:02.077182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 969/1933] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:02 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:02.081403 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db0a80-15b9-4666-81bd-6eac6e1f5b68 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:02.101080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db0a80-15b9-4666-81bd-6eac6e1f5b68 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:02.192790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42513f1-99f2-4069-8e37-cfd42582b67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:02.193507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42513f1-99f2-4069-8e37-cfd42582b67e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:02.193796 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42513f1-99f2-4069-8e37-cfd42582b67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:02.194077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42513f1-99f2-4069-8e37-cfd42582b67e admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:02.194777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42513f1-99f2-4069-8e37-cfd42582b67e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:02.196798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42513f1-99f2-4069-8e37-cfd42582b67e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:02.221858 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 965/1934] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:02 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:02.223493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c5d0e-a0d4-48e0-965a-44d5ebb7f801 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:02.234639 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c5d0e-a0d4-48e0-965a-44d5ebb7f801 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:02.239848 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf858d6-e4a8-4993-9bac-a40e346f9ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:02.240531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf858d6-e4a8-4993-9bac-a40e346f9ada admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:02.240855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf858d6-e4a8-4993-9bac-a40e346f9ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:02.241144 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf858d6-e4a8-4993-9bac-a40e346f9ada admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:02.241877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf858d6-e4a8-4993-9bac-a40e346f9ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:02.244013 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf858d6-e4a8-4993-9bac-a40e346f9ada admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:02.256024 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 970/1935] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:02.260533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42513f1-99f2-4069-8e37-cfd42582b67e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:02.271263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42513f1-99f2-4069-8e37-cfd42582b67e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:02.276099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20454b1f-5354-49db-9632-a1bc98a7c013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:02.276807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20454b1f-5354-49db-9632-a1bc98a7c013 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:02.277096 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20454b1f-5354-49db-9632-a1bc98a7c013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:02.277374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20454b1f-5354-49db-9632-a1bc98a7c013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:02.278110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20454b1f-5354-49db-9632-a1bc98a7c013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:02.279717 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20454b1f-5354-49db-9632-a1bc98a7c013 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:02.290521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 966/1936] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:02.295035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf858d6-e4a8-4993-9bac-a40e346f9ada admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:02.305806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf858d6-e4a8-4993-9bac-a40e346f9ada admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:02.310668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9301a0a-4cdf-41c4-b1a3-b423ffaeeded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:02.311601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9301a0a-4cdf-41c4-b1a3-b423ffaeeded admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:02.311882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9301a0a-4cdf-41c4-b1a3-b423ffaeeded admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:02.312156 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9301a0a-4cdf-41c4-b1a3-b423ffaeeded admin admin] PATH_INFO: `/v3/projects/a24fb47eef9e45de92584a59f0513e03/users/d86a09f75f0049118135f2a41b3a48dc/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:02.327534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9301a0a-4cdf-41c4-b1a3-b423ffaeeded admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24fb47eef9e45de92584a59f0513e03, user_id=d86a09f75f0049118135f2a41b3a48dc, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:02.330342 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9301a0a-4cdf-41c4-b1a3-b423ffaeeded admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:02.344973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 971/1937] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:02 2022] PUT /identity/v3/projects/a24fb47eef9e45de92584a59f0513e03/users/d86a09f75f0049118135f2a41b3a48dc/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:02.356836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c8af7-1337-4dc2-9f6b-23474f2abe24 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:02.357125 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c8af7-1337-4dc2-9f6b-23474f2abe24 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:02.357471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c8af7-1337-4dc2-9f6b-23474f2abe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:02.385585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9f3c8af7-1337-4dc2-9f6b-23474f2abe24 None None] MFA Rules not processed for user `d86a09f75f0049118135f2a41b3a48dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:02.386835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9f3c8af7-1337-4dc2-9f6b-23474f2abe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:02.453677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:02.461646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 967/1938] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:02.463580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9301a0a-4cdf-41c4-b1a3-b423ffaeeded admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:02.491056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:02.530293 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9301a0a-4cdf-41c4-b1a3-b423ffaeeded admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:02.535218 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5cd83-ed07-45e0-b3fc-0dcf37d085c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:02.535890 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5cd83-ed07-45e0-b3fc-0dcf37d085c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:02.536179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5cd83-ed07-45e0-b3fc-0dcf37d085c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:02.536463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5cd83-ed07-45e0-b3fc-0dcf37d085c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:02.537208 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5cd83-ed07-45e0-b3fc-0dcf37d085c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:02.539468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5cd83-ed07-45e0-b3fc-0dcf37d085c6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:02.572480 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 972/1939] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:02 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:02.576364 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c8af7-1337-4dc2-9f6b-23474f2abe24 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:02.591385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c8af7-1337-4dc2-9f6b-23474f2abe24 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:02.664283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3bbf3-baab-4538-8650-ab4a15f0faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:02.665004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3bbf3-baab-4538-8650-ab4a15f0faab admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:02.665290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3bbf3-baab-4538-8650-ab4a15f0faab admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:02.665775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3bbf3-baab-4538-8650-ab4a15f0faab admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:02.666299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3bbf3-baab-4538-8650-ab4a15f0faab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:02.668292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3bbf3-baab-4538-8650-ab4a15f0faab admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:02.691568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 968/1940] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:02 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:02.696510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5cd83-ed07-45e0-b3fc-0dcf37d085c6 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:02.708321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5cd83-ed07-45e0-b3fc-0dcf37d085c6 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:02.715323 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022755a4-6af1-4f70-82e3-2436b35e16bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:02.716154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022755a4-6af1-4f70-82e3-2436b35e16bd admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:02.716389 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022755a4-6af1-4f70-82e3-2436b35e16bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:02.716648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022755a4-6af1-4f70-82e3-2436b35e16bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:02.717633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022755a4-6af1-4f70-82e3-2436b35e16bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:02.719447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022755a4-6af1-4f70-82e3-2436b35e16bd admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:02.733466 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 973/1941] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:02.738515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3bbf3-baab-4538-8650-ab4a15f0faab admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:02.751920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3bbf3-baab-4538-8650-ab4a15f0faab admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:02.758575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1db1-1a36-4251-9cb2-b56d4ca28a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:02.759569 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1db1-1a36-4251-9cb2-b56d4ca28a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:02.760227 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1db1-1a36-4251-9cb2-b56d4ca28a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:02.760227 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a1db1-1a36-4251-9cb2-b56d4ca28a6d admin admin] PATH_INFO: `/v3/projects/9a5a5afcb5bd48a7bd1cd7c702a60544/users/d138b88c2bbb44dcbc4d5487435a9a2e/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:02.781006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1db1-1a36-4251-9cb2-b56d4ca28a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5a5afcb5bd48a7bd1cd7c702a60544, user_id=d138b88c2bbb44dcbc4d5487435a9a2e, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:02.783679 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a1db1-1a36-4251-9cb2-b56d4ca28a6d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:02.798561 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 969/1942] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:02 2022] PUT /identity/v3/projects/9a5a5afcb5bd48a7bd1cd7c702a60544/users/d138b88c2bbb44dcbc4d5487435a9a2e/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:02.803152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022755a4-6af1-4f70-82e3-2436b35e16bd admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:02.816127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022755a4-6af1-4f70-82e3-2436b35e16bd admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:02.882005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa97a5-7191-4d82-8637-9eff924cf2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:02.883230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa97a5-7191-4d82-8637-9eff924cf2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:02.883692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa97a5-7191-4d82-8637-9eff924cf2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:02.885738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa97a5-7191-4d82-8637-9eff924cf2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:02.885738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa97a5-7191-4d82-8637-9eff924cf2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:02.886792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa97a5-7191-4d82-8637-9eff924cf2ae admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:02.900498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 974/1943] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:02.901684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1db1-1a36-4251-9cb2-b56d4ca28a6d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:02.912301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a1db1-1a36-4251-9cb2-b56d4ca28a6d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:02.917505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b1b2e-3541-45d4-9670-358d46becd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:02.918822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b1b2e-3541-45d4-9670-358d46becd2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:02.919104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b1b2e-3541-45d4-9670-358d46becd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:02.919378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b1b2e-3541-45d4-9670-358d46becd2e admin admin] PATH_INFO: `/v3/projects/9a5a5afcb5bd48a7bd1cd7c702a60544/users/d138b88c2bbb44dcbc4d5487435a9a2e/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:02.921976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b1b2e-3541-45d4-9670-358d46becd2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5a5afcb5bd48a7bd1cd7c702a60544, user_id=d138b88c2bbb44dcbc4d5487435a9a2e, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:02.924607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b1b2e-3541-45d4-9670-358d46becd2e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:02.935619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 970/1944] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:02 2022] PUT /identity/v3/projects/9a5a5afcb5bd48a7bd1cd7c702a60544/users/d138b88c2bbb44dcbc4d5487435a9a2e/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:02.947395 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70d109-32c3-4568-9f59-b108c8cec531 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:02.947690 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70d109-32c3-4568-9f59-b108c8cec531 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:02.947971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70d109-32c3-4568-9f59-b108c8cec531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:02.975677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9c70d109-32c3-4568-9f59-b108c8cec531 None None] MFA Rules not processed for user `d138b88c2bbb44dcbc4d5487435a9a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:02.976961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9c70d109-32c3-4568-9f59-b108c8cec531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:03.046814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 975/1945] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:03.058838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b1b2e-3541-45d4-9670-358d46becd2e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:03.060585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-264b1b2e-3541-45d4-9670-358d46becd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:03.120202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b1b2e-3541-45d4-9670-358d46becd2e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:03.123987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa7ac5-cecf-4a77-b4d1-c95527541454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:03.124651 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa7ac5-cecf-4a77-b4d1-c95527541454 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:03.124973 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa7ac5-cecf-4a77-b4d1-c95527541454 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:03.125251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa7ac5-cecf-4a77-b4d1-c95527541454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:03.139658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa7ac5-cecf-4a77-b4d1-c95527541454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:03.141049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa7ac5-cecf-4a77-b4d1-c95527541454 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:03.151625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 971/1946] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:03.261585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70d109-32c3-4568-9f59-b108c8cec531 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:03.298554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:03.366842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70d109-32c3-4568-9f59-b108c8cec531 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:03.376349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:03.377474 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:03.377791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:03.378034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] PATH_INFO: `/v3/users/d86a09f75f0049118135f2a41b3a48dc` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:03.380014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86a09f75f0049118135f2a41b3a48dc)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:03.382035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:03.471342 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86a09f75f0049118135f2a41b3a48dc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:03.472339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86a09f75f0049118135f2a41b3a48dc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:03.473876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86a09f75f0049118135f2a41b3a48dc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:03.490756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86a09f75f0049118135f2a41b3a48dc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:03.499827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86a09f75f0049118135f2a41b3a48dc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:03.518435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 976/1947] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:03 2022] DELETE /identity/v3/users/d86a09f75f0049118135f2a41b3a48dc => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:03.524079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49abf7-0e17-42da-8a4c-f8d0e58e939a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:03.524362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49abf7-0e17-42da-8a4c-f8d0e58e939a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:03.524660 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49abf7-0e17-42da-8a4c-f8d0e58e939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:03.544086 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-af49abf7-0e17-42da-8a4c-f8d0e58e939a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:03.545336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-af49abf7-0e17-42da-8a4c-f8d0e58e939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:03.610245 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:03.625624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 972/1948] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:03.635761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:03.637913 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:03.736538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840f503-99de-4fc9-bfd1-65ac03fabe61 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:03.748881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af533b-c82b-4c55-90f5-b1174d724e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:03.749732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af533b-c82b-4c55-90f5-b1174d724e4d service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:03.750121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af533b-c82b-4c55-90f5-b1174d724e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:03.750501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af533b-c82b-4c55-90f5-b1174d724e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:03.763348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af533b-c82b-4c55-90f5-b1174d724e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:03.765048 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af533b-c82b-4c55-90f5-b1174d724e4d service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:03.780780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 977/1949] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:04.379454 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49abf7-0e17-42da-8a4c-f8d0e58e939a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:04.381082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-af49abf7-0e17-42da-8a4c-f8d0e58e939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:04.405582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49abf7-0e17-42da-8a4c-f8d0e58e939a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:04.411570 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:04.412516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:04.412829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:04.413107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] PATH_INFO: `/v3/projects/a24fb47eef9e45de92584a59f0513e03` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:04.414726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24fb47eef9e45de92584a59f0513e03)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:04.416629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:04.465323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24fb47eef9e45de92584a59f0513e03', 'request_id': 'req-c3b948c3-e704-43e3-ba45-eb95b863db0c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:04.472893 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24fb47eef9e45de92584a59f0513e03', 'request_id': 'req-c3b948c3-e704-43e3-ba45-eb95b863db0c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:04.479807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24fb47eef9e45de92584a59f0513e03', 'request_id': 'req-c3b948c3-e704-43e3-ba45-eb95b863db0c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:04.490410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] The token cache is being invalidate because project a24fb47eef9e45de92584a59f0513e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:04.490727 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:04.491380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:04.493570 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 973/1950] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:04 2022] DELETE /identity/v3/projects/a24fb47eef9e45de92584a59f0513e03 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:04.497549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af533b-c82b-4c55-90f5-b1174d724e4d service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:04.507170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af533b-c82b-4c55-90f5-b1174d724e4d service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:04.554008 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:04.574376 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c467bc-e48f-4f7e-8a7b-ca596c816fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:04.575273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c467bc-e48f-4f7e-8a7b-ca596c816fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:04.575583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c467bc-e48f-4f7e-8a7b-ca596c816fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:04.575864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c467bc-e48f-4f7e-8a7b-ca596c816fac admin admin] PATH_INFO: `/v3/users/d138b88c2bbb44dcbc4d5487435a9a2e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:04.577110 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c467bc-e48f-4f7e-8a7b-ca596c816fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d138b88c2bbb44dcbc4d5487435a9a2e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:04.579158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c467bc-e48f-4f7e-8a7b-ca596c816fac admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:04.632003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b4c467bc-e48f-4f7e-8a7b-ca596c816fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd138b88c2bbb44dcbc4d5487435a9a2e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:04.633484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b4c467bc-e48f-4f7e-8a7b-ca596c816fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd138b88c2bbb44dcbc4d5487435a9a2e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:04.634355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b4c467bc-e48f-4f7e-8a7b-ca596c816fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd138b88c2bbb44dcbc4d5487435a9a2e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:04.649799 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b4c467bc-e48f-4f7e-8a7b-ca596c816fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd138b88c2bbb44dcbc4d5487435a9a2e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:04.657770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b4c467bc-e48f-4f7e-8a7b-ca596c816fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd138b88c2bbb44dcbc4d5487435a9a2e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:04.671679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 978/1951] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:04 2022] DELETE /identity/v3/users/d138b88c2bbb44dcbc4d5487435a9a2e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:05.145911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:05.147533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:05.182441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b948c3-e704-43e3-ba45-eb95b863db0c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:05.261367 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9e38f-9f46-487a-b0ae-39d5ba13923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:05.263049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9e38f-9f46-487a-b0ae-39d5ba13923d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:05.263672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9e38f-9f46-487a-b0ae-39d5ba13923d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:05.264106 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9e38f-9f46-487a-b0ae-39d5ba13923d admin admin] PATH_INFO: `/v3/projects/9a5a5afcb5bd48a7bd1cd7c702a60544` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:05.265605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9e38f-9f46-487a-b0ae-39d5ba13923d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5a5afcb5bd48a7bd1cd7c702a60544)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:05.267883 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9e38f-9f46-487a-b0ae-39d5ba13923d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:05.321368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-21a9e38f-9f46-487a-b0ae-39d5ba13923d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5a5afcb5bd48a7bd1cd7c702a60544', 'request_id': 'req-21a9e38f-9f46-487a-b0ae-39d5ba13923d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:05.329296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-21a9e38f-9f46-487a-b0ae-39d5ba13923d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5a5afcb5bd48a7bd1cd7c702a60544', 'request_id': 'req-21a9e38f-9f46-487a-b0ae-39d5ba13923d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:05.337086 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-21a9e38f-9f46-487a-b0ae-39d5ba13923d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5a5afcb5bd48a7bd1cd7c702a60544', 'request_id': 'req-21a9e38f-9f46-487a-b0ae-39d5ba13923d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:05.348011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-21a9e38f-9f46-487a-b0ae-39d5ba13923d admin admin] The token cache is being invalidate because project 9a5a5afcb5bd48a7bd1cd7c702a60544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:05.348308 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-21a9e38f-9f46-487a-b0ae-39d5ba13923d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:05.349029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-21a9e38f-9f46-487a-b0ae-39d5ba13923d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:05.350683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 974/1952] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:05 2022] DELETE /identity/v3/projects/9a5a5afcb5bd48a7bd1cd7c702a60544 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:05.356565 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b2442-6b87-42bf-ab23-96d61e6fca09 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:05.357083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b2442-6b87-42bf-ab23-96d61e6fca09 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:05.357438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b2442-6b87-42bf-ab23-96d61e6fca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:05.377952 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-010b2442-6b87-42bf-ab23-96d61e6fca09 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:05.379345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-010b2442-6b87-42bf-ab23-96d61e6fca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:05.441288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 979/1953] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:05.449242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bee2f-2178-4dec-97d3-09701848f81f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:05.449725 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bee2f-2178-4dec-97d3-09701848f81f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:05.449959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bee2f-2178-4dec-97d3-09701848f81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:05.469311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9d5bee2f-2178-4dec-97d3-09701848f81f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:05.470629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9d5bee2f-2178-4dec-97d3-09701848f81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:05.479476 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 975/1954] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:05.483700 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b2442-6b87-42bf-ab23-96d61e6fca09 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:05.493626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b2442-6b87-42bf-ab23-96d61e6fca09 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:05.498360 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be36950-f74d-4029-a64d-9c123ca6ad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:05.498963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be36950-f74d-4029-a64d-9c123ca6ad2a admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:05.499253 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be36950-f74d-4029-a64d-9c123ca6ad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:05.499534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be36950-f74d-4029-a64d-9c123ca6ad2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:05.500275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be36950-f74d-4029-a64d-9c123ca6ad2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:05.500590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be36950-f74d-4029-a64d-9c123ca6ad2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:05.502229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be36950-f74d-4029-a64d-9c123ca6ad2a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:05.515278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 980/1955] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:05.519586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bee2f-2178-4dec-97d3-09701848f81f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:05.524888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:05.531340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bee2f-2178-4dec-97d3-09701848f81f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:05.538129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27072341-5d39-49fb-b834-a445881ccc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:05.538929 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072341-5d39-49fb-b834-a445881ccc44 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:05.539498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072341-5d39-49fb-b834-a445881ccc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:05.539720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27072341-5d39-49fb-b834-a445881ccc44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:05.540418 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27072341-5d39-49fb-b834-a445881ccc44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:05.542368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27072341-5d39-49fb-b834-a445881ccc44 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:05.568792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 976/1956] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:05 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:05.573793 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be36950-f74d-4029-a64d-9c123ca6ad2a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:05.583771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be36950-f74d-4029-a64d-9c123ca6ad2a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:05.635172 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:05.650192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834d08c-acc8-4967-a408-b40f126626f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:05.650879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834d08c-acc8-4967-a408-b40f126626f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:05.651167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834d08c-acc8-4967-a408-b40f126626f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:05.651445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834d08c-acc8-4967-a408-b40f126626f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:05.652143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834d08c-acc8-4967-a408-b40f126626f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:05.654090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834d08c-acc8-4967-a408-b40f126626f5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:05.675684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 981/1957] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:05 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:05.679662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27072341-5d39-49fb-b834-a445881ccc44 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:05.690172 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27072341-5d39-49fb-b834-a445881ccc44 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:05.694799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878dc72-da5b-4c0e-898e-6e57cd5f70cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:05.696071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878dc72-da5b-4c0e-898e-6e57cd5f70cb admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:05.696351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878dc72-da5b-4c0e-898e-6e57cd5f70cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:05.696627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878dc72-da5b-4c0e-898e-6e57cd5f70cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:05.697400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878dc72-da5b-4c0e-898e-6e57cd5f70cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:05.699001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878dc72-da5b-4c0e-898e-6e57cd5f70cb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:05.713055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 977/1958] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:05.714462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834d08c-acc8-4967-a408-b40f126626f5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:05.724649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834d08c-acc8-4967-a408-b40f126626f5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:05.729495 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b300f-aebf-47f4-bf50-1cdbb63839e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:05.730167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b300f-aebf-47f4-bf50-1cdbb63839e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:05.730453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b300f-aebf-47f4-bf50-1cdbb63839e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:05.730731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b300f-aebf-47f4-bf50-1cdbb63839e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:05.731872 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b300f-aebf-47f4-bf50-1cdbb63839e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:05.733092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b300f-aebf-47f4-bf50-1cdbb63839e4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:05.743224 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 982/1959] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:05.747351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878dc72-da5b-4c0e-898e-6e57cd5f70cb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:05.759104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878dc72-da5b-4c0e-898e-6e57cd5f70cb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:05.764484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4096be7-6f32-4c26-9553-df1a436e33b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:05.765430 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4096be7-6f32-4c26-9553-df1a436e33b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:05.765723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4096be7-6f32-4c26-9553-df1a436e33b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:05.766007 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4096be7-6f32-4c26-9553-df1a436e33b9 admin admin] PATH_INFO: `/v3/projects/d81b11d026e64475881db3153d01b76f/users/53c8174896dc4b3d96ea21d080528887/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:05.781568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4096be7-6f32-4c26-9553-df1a436e33b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81b11d026e64475881db3153d01b76f, user_id=53c8174896dc4b3d96ea21d080528887, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:05.784243 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4096be7-6f32-4c26-9553-df1a436e33b9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:05.797786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 978/1960] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:05 2022] PUT /identity/v3/projects/d81b11d026e64475881db3153d01b76f/users/53c8174896dc4b3d96ea21d080528887/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:05.809088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274787a-7273-470e-9dbc-e9a00426e673 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:05.809590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274787a-7273-470e-9dbc-e9a00426e673 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:05.810044 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274787a-7273-470e-9dbc-e9a00426e673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:05.840950 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7274787a-7273-470e-9dbc-e9a00426e673 None None] MFA Rules not processed for user `53c8174896dc4b3d96ea21d080528887`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:05.842304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7274787a-7273-470e-9dbc-e9a00426e673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:05.931486 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 983/1961] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:05.936027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4096be7-6f32-4c26-9553-df1a436e33b9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:06.017509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4096be7-6f32-4c26-9553-df1a436e33b9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:06.023385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a747ca0-d22b-41bf-a8e0-79ba370e0803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:06.024213 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a747ca0-d22b-41bf-a8e0-79ba370e0803 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:06.024595 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a747ca0-d22b-41bf-a8e0-79ba370e0803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:06.024995 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a747ca0-d22b-41bf-a8e0-79ba370e0803 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:06.025792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a747ca0-d22b-41bf-a8e0-79ba370e0803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:06.027819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a747ca0-d22b-41bf-a8e0-79ba370e0803 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:06.059101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 979/1962] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:05 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:06.063434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274787a-7273-470e-9dbc-e9a00426e673 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:06.074736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274787a-7273-470e-9dbc-e9a00426e673 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:06.142383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ab1f8-6371-48e5-ba14-e33331964695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:06.143074 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ab1f8-6371-48e5-ba14-e33331964695 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:06.143363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ab1f8-6371-48e5-ba14-e33331964695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:06.143645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ab1f8-6371-48e5-ba14-e33331964695 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:06.144362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ab1f8-6371-48e5-ba14-e33331964695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:06.146374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ab1f8-6371-48e5-ba14-e33331964695 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:06.173021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 984/1963] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:06 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:06.174041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a747ca0-d22b-41bf-a8e0-79ba370e0803 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:06.190870 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a747ca0-d22b-41bf-a8e0-79ba370e0803 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:06.200988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef95d7d-37a7-44a9-bf90-877828e5aded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:06.201680 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef95d7d-37a7-44a9-bf90-877828e5aded admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:06.201997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef95d7d-37a7-44a9-bf90-877828e5aded admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:06.202280 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef95d7d-37a7-44a9-bf90-877828e5aded admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:06.203178 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef95d7d-37a7-44a9-bf90-877828e5aded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:06.204990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef95d7d-37a7-44a9-bf90-877828e5aded admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:06.221678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 980/1964] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:06.225440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ab1f8-6371-48e5-ba14-e33331964695 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:06.238181 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ab1f8-6371-48e5-ba14-e33331964695 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:06.245247 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a0094-64d9-4d8d-8119-254f55704c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:06.246109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a0094-64d9-4d8d-8119-254f55704c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:06.246404 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a0094-64d9-4d8d-8119-254f55704c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:06.246684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a0094-64d9-4d8d-8119-254f55704c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:06.248398 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a0094-64d9-4d8d-8119-254f55704c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:06.250098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a0094-64d9-4d8d-8119-254f55704c50 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:06.268085 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 985/1965] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:06.272353 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef95d7d-37a7-44a9-bf90-877828e5aded admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:06.291357 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef95d7d-37a7-44a9-bf90-877828e5aded admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:06.298344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cef799-c1a6-4573-b451-68e58ac1c53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:06.299368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cef799-c1a6-4573-b451-68e58ac1c53c admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:06.299775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cef799-c1a6-4573-b451-68e58ac1c53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:06.300154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cef799-c1a6-4573-b451-68e58ac1c53c admin admin] PATH_INFO: `/v3/projects/c920b5de6227412ba40409f583502162/users/0cc61703d88a4a139f6aab250ac4f3a1/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:06.322251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cef799-c1a6-4573-b451-68e58ac1c53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c920b5de6227412ba40409f583502162, user_id=0cc61703d88a4a139f6aab250ac4f3a1, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:06.324966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cef799-c1a6-4573-b451-68e58ac1c53c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:06.347836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 981/1966] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:06 2022] PUT /identity/v3/projects/c920b5de6227412ba40409f583502162/users/0cc61703d88a4a139f6aab250ac4f3a1/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:34:06.358960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc5de9-affe-457c-99ee-72eff93c9920 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:06.359498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc5de9-affe-457c-99ee-72eff93c9920 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:06.359498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc5de9-affe-457c-99ee-72eff93c9920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:06.389722 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6adc5de9-affe-457c-99ee-72eff93c9920 None None] MFA Rules not processed for user `0cc61703d88a4a139f6aab250ac4f3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:06.390951 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6adc5de9-affe-457c-99ee-72eff93c9920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:06.419029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:06.464379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 986/1967] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:06.468967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cef799-c1a6-4573-b451-68e58ac1c53c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:06.530696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:06.541203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cef799-c1a6-4573-b451-68e58ac1c53c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:06.546223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dec6e2-b318-4873-9089-0a4b81b70801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:06.546966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dec6e2-b318-4873-9089-0a4b81b70801 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:06.547250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dec6e2-b318-4873-9089-0a4b81b70801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:06.547526 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dec6e2-b318-4873-9089-0a4b81b70801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:06.548232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dec6e2-b318-4873-9089-0a4b81b70801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:06.550212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dec6e2-b318-4873-9089-0a4b81b70801 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:06.576602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 982/1968] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:06 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:06.580760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc5de9-affe-457c-99ee-72eff93c9920 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:06.592015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc5de9-affe-457c-99ee-72eff93c9920 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:06.649986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a18ec0-0511-4835-b165-ae65839c82d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:06.651041 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a18ec0-0511-4835-b165-ae65839c82d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:06.651582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a18ec0-0511-4835-b165-ae65839c82d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:06.652142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a18ec0-0511-4835-b165-ae65839c82d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:06.653236 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a18ec0-0511-4835-b165-ae65839c82d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:06.655982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a18ec0-0511-4835-b165-ae65839c82d4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:06.676874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 987/1969] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:06 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:06.681482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dec6e2-b318-4873-9089-0a4b81b70801 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:06.691808 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dec6e2-b318-4873-9089-0a4b81b70801 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:06.697176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b9c22-9c46-4a36-aac5-c98dd68ed163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:06.697834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b9c22-9c46-4a36-aac5-c98dd68ed163 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:06.698124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b9c22-9c46-4a36-aac5-c98dd68ed163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:06.698406 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b9c22-9c46-4a36-aac5-c98dd68ed163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:06.699136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b9c22-9c46-4a36-aac5-c98dd68ed163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:06.700762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b9c22-9c46-4a36-aac5-c98dd68ed163 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:06.711276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 983/1970] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:06.715429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a18ec0-0511-4835-b165-ae65839c82d4 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:06.725250 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a18ec0-0511-4835-b165-ae65839c82d4 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:06.729867 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042d325-21a9-4c5d-889e-728a307f082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:06.730736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042d325-21a9-4c5d-889e-728a307f082c admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:06.731018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042d325-21a9-4c5d-889e-728a307f082c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:06.731290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042d325-21a9-4c5d-889e-728a307f082c admin admin] PATH_INFO: `/v3/projects/f21fa2ed7a7341e39e4cd381d358edda/users/103fb204ac4046498fa90fa9b4c00b9e/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:06.746196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042d325-21a9-4c5d-889e-728a307f082c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21fa2ed7a7341e39e4cd381d358edda, user_id=103fb204ac4046498fa90fa9b4c00b9e, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:06.748834 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042d325-21a9-4c5d-889e-728a307f082c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:06.770061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 988/1971] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:06 2022] PUT /identity/v3/projects/f21fa2ed7a7341e39e4cd381d358edda/users/103fb204ac4046498fa90fa9b4c00b9e/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:06.774578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b9c22-9c46-4a36-aac5-c98dd68ed163 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:06.784548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b9c22-9c46-4a36-aac5-c98dd68ed163 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:06.840290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f839ca-26e0-4c96-af40-6eba2e69d48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:06.840979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f839ca-26e0-4c96-af40-6eba2e69d48b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:06.841262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f839ca-26e0-4c96-af40-6eba2e69d48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:06.841538 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f839ca-26e0-4c96-af40-6eba2e69d48b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:06.842290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f839ca-26e0-4c96-af40-6eba2e69d48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:06.843922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f839ca-26e0-4c96-af40-6eba2e69d48b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:06.854318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 984/1972] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:06.858399 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042d325-21a9-4c5d-889e-728a307f082c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:06.868899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042d325-21a9-4c5d-889e-728a307f082c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:06.873687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d58c47-2f83-41cc-bb39-307b846864b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:06.874583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d58c47-2f83-41cc-bb39-307b846864b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:06.874870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d58c47-2f83-41cc-bb39-307b846864b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:06.875149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d58c47-2f83-41cc-bb39-307b846864b0 admin admin] PATH_INFO: `/v3/projects/f21fa2ed7a7341e39e4cd381d358edda/users/103fb204ac4046498fa90fa9b4c00b9e/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:06.877206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d58c47-2f83-41cc-bb39-307b846864b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21fa2ed7a7341e39e4cd381d358edda, user_id=103fb204ac4046498fa90fa9b4c00b9e, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:06.879902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d58c47-2f83-41cc-bb39-307b846864b0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:06.891221 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 989/1973] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:06 2022] PUT /identity/v3/projects/f21fa2ed7a7341e39e4cd381d358edda/users/103fb204ac4046498fa90fa9b4c00b9e/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:06.902223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1ee70-7ed5-4720-b6bf-bd6c95617908 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:06.902519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1ee70-7ed5-4720-b6bf-bd6c95617908 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:06.902802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1ee70-7ed5-4720-b6bf-bd6c95617908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:06.929936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-99e1ee70-7ed5-4720-b6bf-bd6c95617908 None None] MFA Rules not processed for user `103fb204ac4046498fa90fa9b4c00b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:06.931180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-99e1ee70-7ed5-4720-b6bf-bd6c95617908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:07.004502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 985/1974] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:07.015910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d58c47-2f83-41cc-bb39-307b846864b0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:07.017625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-50d58c47-2f83-41cc-bb39-307b846864b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:07.075434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d58c47-2f83-41cc-bb39-307b846864b0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:07.078989 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abb27b-43f2-4203-8355-d7bbf0f9b296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:07.079626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abb27b-43f2-4203-8355-d7bbf0f9b296 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:07.079938 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abb27b-43f2-4203-8355-d7bbf0f9b296 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:07.080217 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abb27b-43f2-4203-8355-d7bbf0f9b296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:07.090127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abb27b-43f2-4203-8355-d7bbf0f9b296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:07.091587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abb27b-43f2-4203-8355-d7bbf0f9b296 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:07.100892 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 990/1975] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:07.614809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1ee70-7ed5-4720-b6bf-bd6c95617908 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:07.616202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-99e1ee70-7ed5-4720-b6bf-bd6c95617908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:07.627751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1ee70-7ed5-4720-b6bf-bd6c95617908 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:07.631317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b32398-5898-4728-be1c-b2308f34535d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:07.631950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32398-5898-4728-be1c-b2308f34535d service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:07.632257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32398-5898-4728-be1c-b2308f34535d service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:07.632540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32398-5898-4728-be1c-b2308f34535d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:07.681854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:07.693032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b32398-5898-4728-be1c-b2308f34535d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:07.694459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b32398-5898-4728-be1c-b2308f34535d service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:07.703564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 986/1976] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:17.096753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:17.699431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:26.587941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abb27b-43f2-4203-8355-d7bbf0f9b296 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:26.607238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abb27b-43f2-4203-8355-d7bbf0f9b296 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:26.610823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608f67f-cc42-4f30-9684-e9af094ec089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:26.611463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608f67f-cc42-4f30-9684-e9af094ec089 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:26.611746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608f67f-cc42-4f30-9684-e9af094ec089 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:26.612050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608f67f-cc42-4f30-9684-e9af094ec089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:26.682419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608f67f-cc42-4f30-9684-e9af094ec089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:26.683854 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608f67f-cc42-4f30-9684-e9af094ec089 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:26.692821 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 991/1977] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:34:26.933492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b32398-5898-4728-be1c-b2308f34535d service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:26.934918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-29b32398-5898-4728-be1c-b2308f34535d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:27.096252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b32398-5898-4728-be1c-b2308f34535d service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:27.101603 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:27.102487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:27.102773 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:27.103048 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] PATH_INFO: `/v3/users/77117aa73ab2417f980d215c2271d460` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:27.104274 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77117aa73ab2417f980d215c2271d460)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:27.106240 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:27.157072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77117aa73ab2417f980d215c2271d460'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.157820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77117aa73ab2417f980d215c2271d460'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.158789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77117aa73ab2417f980d215c2271d460'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.173951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77117aa73ab2417f980d215c2271d460'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.181561 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77117aa73ab2417f980d215c2271d460'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.197662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 987/1978] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:26 2022] DELETE /identity/v3/users/77117aa73ab2417f980d215c2271d460 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:27.202302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646400d4-9229-4c1d-bd3a-a9e3bdd27d4d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:27.202610 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646400d4-9229-4c1d-bd3a-a9e3bdd27d4d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:27.202919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646400d4-9229-4c1d-bd3a-a9e3bdd27d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:27.232613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-646400d4-9229-4c1d-bd3a-a9e3bdd27d4d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:27.233796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-646400d4-9229-4c1d-bd3a-a9e3bdd27d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:27.307037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 992/1979] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:27.311730 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:27.313273 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:27.337435 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:27.416056 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba9533-7092-410b-a885-4fba1ab41b76 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:27.419761 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eae692-771d-44e9-be7a-fbd7fe33d9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:27.420403 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eae692-771d-44e9-be7a-fbd7fe33d9ad service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:27.420694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eae692-771d-44e9-be7a-fbd7fe33d9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:27.420999 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eae692-771d-44e9-be7a-fbd7fe33d9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:27.431167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eae692-771d-44e9-be7a-fbd7fe33d9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:27.432634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eae692-771d-44e9-be7a-fbd7fe33d9ad service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:27.442217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 988/1980] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:27.726425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646400d4-9229-4c1d-bd3a-a9e3bdd27d4d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:27.728195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-646400d4-9229-4c1d-bd3a-a9e3bdd27d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:27.740773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646400d4-9229-4c1d-bd3a-a9e3bdd27d4d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:27.746629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:27.747505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:27.747792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:27.748064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] PATH_INFO: `/v3/projects/96dd50da0f364191bab24b088c1ff540` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:27.749289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96dd50da0f364191bab24b088c1ff540)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:27.751187 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:27.799770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96dd50da0f364191bab24b088c1ff540', 'request_id': 'req-204f3ebc-d318-4f45-9060-1332fd183a94'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.806490 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96dd50da0f364191bab24b088c1ff540', 'request_id': 'req-204f3ebc-d318-4f45-9060-1332fd183a94'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.812632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96dd50da0f364191bab24b088c1ff540', 'request_id': 'req-204f3ebc-d318-4f45-9060-1332fd183a94'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.819133 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:27.830926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] The token cache is being invalidate because project 96dd50da0f364191bab24b088c1ff540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:27.831464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.832105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.833676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 993/1981] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:27 2022] DELETE /identity/v3/projects/96dd50da0f364191bab24b088c1ff540 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:27.838540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eae692-771d-44e9-be7a-fbd7fe33d9ad service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:27.848259 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eae692-771d-44e9-be7a-fbd7fe33d9ad service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:27.908974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b413e54-51c5-4c94-8367-30350174d066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:27.909863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b413e54-51c5-4c94-8367-30350174d066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:27.910153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b413e54-51c5-4c94-8367-30350174d066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:27.910434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b413e54-51c5-4c94-8367-30350174d066 admin admin] PATH_INFO: `/v3/users/da81e9ad14f74cd193bb53d832a3b833` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:27.911636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b413e54-51c5-4c94-8367-30350174d066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da81e9ad14f74cd193bb53d832a3b833)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:27.913764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b413e54-51c5-4c94-8367-30350174d066 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:27.961657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5b413e54-51c5-4c94-8367-30350174d066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da81e9ad14f74cd193bb53d832a3b833'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.962325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5b413e54-51c5-4c94-8367-30350174d066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da81e9ad14f74cd193bb53d832a3b833'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.962915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5b413e54-51c5-4c94-8367-30350174d066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da81e9ad14f74cd193bb53d832a3b833'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.974737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5b413e54-51c5-4c94-8367-30350174d066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da81e9ad14f74cd193bb53d832a3b833'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.982348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5b413e54-51c5-4c94-8367-30350174d066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da81e9ad14f74cd193bb53d832a3b833'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:27.999092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 989/1982] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:27 2022] DELETE /identity/v3/users/da81e9ad14f74cd193bb53d832a3b833 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:28.357821 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:28.359286 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:28.377748 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f3ebc-d318-4f45-9060-1332fd183a94 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:28.435739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03409350-0c01-41ee-a4f5-fa8490a8e81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:28.436608 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03409350-0c01-41ee-a4f5-fa8490a8e81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:28.436925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03409350-0c01-41ee-a4f5-fa8490a8e81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:28.437207 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03409350-0c01-41ee-a4f5-fa8490a8e81f admin admin] PATH_INFO: `/v3/projects/174198e8e4be4394b7a4bf1a67783319` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:28.438452 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03409350-0c01-41ee-a4f5-fa8490a8e81f admin admin] RBAC: Authorizing `identity:delete_project(project_id=174198e8e4be4394b7a4bf1a67783319)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:28.440357 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03409350-0c01-41ee-a4f5-fa8490a8e81f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:28.486457 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-03409350-0c01-41ee-a4f5-fa8490a8e81f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '174198e8e4be4394b7a4bf1a67783319', 'request_id': 'req-03409350-0c01-41ee-a4f5-fa8490a8e81f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:28.494445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-03409350-0c01-41ee-a4f5-fa8490a8e81f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '174198e8e4be4394b7a4bf1a67783319', 'request_id': 'req-03409350-0c01-41ee-a4f5-fa8490a8e81f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:28.501098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-03409350-0c01-41ee-a4f5-fa8490a8e81f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '174198e8e4be4394b7a4bf1a67783319', 'request_id': 'req-03409350-0c01-41ee-a4f5-fa8490a8e81f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:28.512552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-03409350-0c01-41ee-a4f5-fa8490a8e81f admin admin] The token cache is being invalidate because project 174198e8e4be4394b7a4bf1a67783319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:28.512770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-03409350-0c01-41ee-a4f5-fa8490a8e81f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:28.513461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-03409350-0c01-41ee-a4f5-fa8490a8e81f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:28.515031 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 994/1983] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:28 2022] DELETE /identity/v3/projects/174198e8e4be4394b7a4bf1a67783319 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:28.519972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb98b8e-2e33-44a4-a123-fde5aa5b407a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:28.520267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb98b8e-2e33-44a4-a123-fde5aa5b407a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:28.520549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb98b8e-2e33-44a4-a123-fde5aa5b407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:28.539965 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:28.590965 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0fb98b8e-2e33-44a4-a123-fde5aa5b407a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:28.592166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0fb98b8e-2e33-44a4-a123-fde5aa5b407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:28.650486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 990/1984] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:28.659321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701de5e-99e8-4696-b24e-04c473a81864 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:28.659613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701de5e-99e8-4696-b24e-04c473a81864 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:28.660047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701de5e-99e8-4696-b24e-04c473a81864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:28.678472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1701de5e-99e8-4696-b24e-04c473a81864 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:28.679682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1701de5e-99e8-4696-b24e-04c473a81864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:28.688111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 995/1985] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:28.692270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb98b8e-2e33-44a4-a123-fde5aa5b407a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:28.702466 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb98b8e-2e33-44a4-a123-fde5aa5b407a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:28.707040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead57377-c573-4912-b706-f6e4fe11c62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:28.707696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead57377-c573-4912-b706-f6e4fe11c62d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:28.707985 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead57377-c573-4912-b706-f6e4fe11c62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:28.708262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead57377-c573-4912-b706-f6e4fe11c62d admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:28.709036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead57377-c573-4912-b706-f6e4fe11c62d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:28.709352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead57377-c573-4912-b706-f6e4fe11c62d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:28.711802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead57377-c573-4912-b706-f6e4fe11c62d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:28.723273 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 991/1986] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:28.727408 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701de5e-99e8-4696-b24e-04c473a81864 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:28.736439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701de5e-99e8-4696-b24e-04c473a81864 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:28.741091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91834390-6d6e-4843-bb36-994f82d27367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:28.742240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91834390-6d6e-4843-bb36-994f82d27367 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:28.742698 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91834390-6d6e-4843-bb36-994f82d27367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:28.742978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91834390-6d6e-4843-bb36-994f82d27367 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:28.743663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91834390-6d6e-4843-bb36-994f82d27367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:28.745687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91834390-6d6e-4843-bb36-994f82d27367 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:28.771503 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 996/1987] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:28 2022] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:28.775582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead57377-c573-4912-b706-f6e4fe11c62d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:28.785594 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead57377-c573-4912-b706-f6e4fe11c62d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:28.843433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af2967-46f9-4bcb-93c7-bfee31e4ff6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:28.844109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af2967-46f9-4bcb-93c7-bfee31e4ff6a admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:28.844424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af2967-46f9-4bcb-93c7-bfee31e4ff6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:28.844705 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af2967-46f9-4bcb-93c7-bfee31e4ff6a admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:28.845465 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af2967-46f9-4bcb-93c7-bfee31e4ff6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:28.847391 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af2967-46f9-4bcb-93c7-bfee31e4ff6a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:28.867508 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 992/1988] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:28 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:28.871765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91834390-6d6e-4843-bb36-994f82d27367 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:28.883791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91834390-6d6e-4843-bb36-994f82d27367 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:28.893200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169e154-2687-4c32-817b-1482f9c5c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:28.893885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169e154-2687-4c32-817b-1482f9c5c0ac admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:28.894167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169e154-2687-4c32-817b-1482f9c5c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:28.894441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169e154-2687-4c32-817b-1482f9c5c0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:28.895175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169e154-2687-4c32-817b-1482f9c5c0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:28.896795 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169e154-2687-4c32-817b-1482f9c5c0ac admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:28.907874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 997/1989] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:28.911841 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af2967-46f9-4bcb-93c7-bfee31e4ff6a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:28.922064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af2967-46f9-4bcb-93c7-bfee31e4ff6a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:28.926753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b543fa-9b6f-4dab-939d-ee3ceca85de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:28.927411 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b543fa-9b6f-4dab-939d-ee3ceca85de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:28.927696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b543fa-9b6f-4dab-939d-ee3ceca85de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:28.927972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b543fa-9b6f-4dab-939d-ee3ceca85de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:28.928756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b543fa-9b6f-4dab-939d-ee3ceca85de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:28.931088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b543fa-9b6f-4dab-939d-ee3ceca85de3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:28.940881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 993/1990] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:28.945336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169e154-2687-4c32-817b-1482f9c5c0ac admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:28.955190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169e154-2687-4c32-817b-1482f9c5c0ac admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:28.959863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d7099-7129-42f8-a010-3ca0b2440e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:28.960767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d7099-7129-42f8-a010-3ca0b2440e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:28.961056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d7099-7129-42f8-a010-3ca0b2440e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:28.961338 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d7099-7129-42f8-a010-3ca0b2440e69 admin admin] PATH_INFO: `/v3/projects/c91c78976827454d862e4288905057b0/users/f6518f1a784d41de84d8d145b4fe7052/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:28.975624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d7099-7129-42f8-a010-3ca0b2440e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91c78976827454d862e4288905057b0, user_id=f6518f1a784d41de84d8d145b4fe7052, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:28.978301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d7099-7129-42f8-a010-3ca0b2440e69 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:28.991117 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 998/1991] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:28 2022] PUT /identity/v3/projects/c91c78976827454d862e4288905057b0/users/f6518f1a784d41de84d8d145b4fe7052/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:29.001710 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4185c3-b4dd-4a26-9c5d-fb4317e30b36 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:29.002207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4185c3-b4dd-4a26-9c5d-fb4317e30b36 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:29.002314 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4185c3-b4dd-4a26-9c5d-fb4317e30b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:29.029219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9f4185c3-b4dd-4a26-9c5d-fb4317e30b36 None None] MFA Rules not processed for user `f6518f1a784d41de84d8d145b4fe7052`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:29.030419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9f4185c3-b4dd-4a26-9c5d-fb4317e30b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:29.072816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:29.097956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 994/1992] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:29.104324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d7099-7129-42f8-a010-3ca0b2440e69 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:29.127149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:29.186633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d7099-7129-42f8-a010-3ca0b2440e69 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:29.191441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1203f-8cc4-46be-9479-53f76a2addea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:29.192103 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1203f-8cc4-46be-9479-53f76a2addea admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:29.192389 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1203f-8cc4-46be-9479-53f76a2addea admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:29.192669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1203f-8cc4-46be-9479-53f76a2addea admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:29.193427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1203f-8cc4-46be-9479-53f76a2addea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:29.195505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1203f-8cc4-46be-9479-53f76a2addea admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:29.221425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 999/1993] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:29 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:34:29.225446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4185c3-b4dd-4a26-9c5d-fb4317e30b36 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:29.236806 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4185c3-b4dd-4a26-9c5d-fb4317e30b36 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:29.293217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980c4e8-9efd-41d3-8fd2-848bfe6332d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:29.293926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980c4e8-9efd-41d3-8fd2-848bfe6332d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:29.294214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980c4e8-9efd-41d3-8fd2-848bfe6332d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:29.294498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980c4e8-9efd-41d3-8fd2-848bfe6332d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:29.295211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980c4e8-9efd-41d3-8fd2-848bfe6332d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:29.297166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980c4e8-9efd-41d3-8fd2-848bfe6332d9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:29.317946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 995/1994] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:29 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:29.321957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1203f-8cc4-46be-9479-53f76a2addea admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:29.332143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1203f-8cc4-46be-9479-53f76a2addea admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:29.336790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb16f02-0c6b-4b57-a016-8903366f9fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:29.337445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb16f02-0c6b-4b57-a016-8903366f9fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:29.337730 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb16f02-0c6b-4b57-a016-8903366f9fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:29.338009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb16f02-0c6b-4b57-a016-8903366f9fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:29.338735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb16f02-0c6b-4b57-a016-8903366f9fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:29.340329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb16f02-0c6b-4b57-a016-8903366f9fcc admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:29.351426 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1000/1995] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:29.355253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980c4e8-9efd-41d3-8fd2-848bfe6332d9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:29.365159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980c4e8-9efd-41d3-8fd2-848bfe6332d9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:29.370881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864234f8-64e6-4238-8825-1e3a1022c0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:29.371909 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864234f8-64e6-4238-8825-1e3a1022c0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:29.372219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864234f8-64e6-4238-8825-1e3a1022c0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:29.372495 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864234f8-64e6-4238-8825-1e3a1022c0bf admin admin] PATH_INFO: `/v3/projects/d6fb8911b78f48d1abfcaa6d10134bdb/users/bec0a808c35645659b66a71759d84b2a/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:29.388402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864234f8-64e6-4238-8825-1e3a1022c0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fb8911b78f48d1abfcaa6d10134bdb, user_id=bec0a808c35645659b66a71759d84b2a, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:29.391131 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864234f8-64e6-4238-8825-1e3a1022c0bf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:29.405308 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 996/1996] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:29 2022] PUT /identity/v3/projects/d6fb8911b78f48d1abfcaa6d10134bdb/users/bec0a808c35645659b66a71759d84b2a/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:29.409344 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb16f02-0c6b-4b57-a016-8903366f9fcc admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:29.419331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb16f02-0c6b-4b57-a016-8903366f9fcc admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:29.477369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6aa6e3-0f54-4e89-8baa-089b6b91b616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:29.478054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6aa6e3-0f54-4e89-8baa-089b6b91b616 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:29.478339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6aa6e3-0f54-4e89-8baa-089b6b91b616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:29.478616 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6aa6e3-0f54-4e89-8baa-089b6b91b616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:29.479356 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6aa6e3-0f54-4e89-8baa-089b6b91b616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:29.480982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6aa6e3-0f54-4e89-8baa-089b6b91b616 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:29.491004 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1001/1997] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:29.496249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864234f8-64e6-4238-8825-1e3a1022c0bf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:29.506494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864234f8-64e6-4238-8825-1e3a1022c0bf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:29.512415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbf2d1-af91-4346-894f-4c0ce6a0140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:29.513341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbf2d1-af91-4346-894f-4c0ce6a0140e admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:29.513626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbf2d1-af91-4346-894f-4c0ce6a0140e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:29.513897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbf2d1-af91-4346-894f-4c0ce6a0140e admin admin] PATH_INFO: `/v3/projects/d6fb8911b78f48d1abfcaa6d10134bdb/users/bec0a808c35645659b66a71759d84b2a/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:29.515839 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbf2d1-af91-4346-894f-4c0ce6a0140e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fb8911b78f48d1abfcaa6d10134bdb, user_id=bec0a808c35645659b66a71759d84b2a, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:29.518519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbf2d1-af91-4346-894f-4c0ce6a0140e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:29.529839 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 997/1998] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:29 2022] PUT /identity/v3/projects/d6fb8911b78f48d1abfcaa6d10134bdb/users/bec0a808c35645659b66a71759d84b2a/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:29.539892 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94797-9a39-4fd1-a9f6-9aa8169d0b48 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:29.540191 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94797-9a39-4fd1-a9f6-9aa8169d0b48 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:29.540473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94797-9a39-4fd1-a9f6-9aa8169d0b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:29.566882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7ec94797-9a39-4fd1-a9f6-9aa8169d0b48 None None] MFA Rules not processed for user `bec0a808c35645659b66a71759d84b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:29.568137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7ec94797-9a39-4fd1-a9f6-9aa8169d0b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:29.642709 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1002/1999] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:29.653343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbf2d1-af91-4346-894f-4c0ce6a0140e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:29.655555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b0fbf2d1-af91-4346-894f-4c0ce6a0140e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:29.715148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbf2d1-af91-4346-894f-4c0ce6a0140e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:29.718928 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d002869-92c5-47e1-96d4-f8b583784ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:29.719575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d002869-92c5-47e1-96d4-f8b583784ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:29.719864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d002869-92c5-47e1-96d4-f8b583784ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:29.720144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d002869-92c5-47e1-96d4-f8b583784ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:29.729343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d002869-92c5-47e1-96d4-f8b583784ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:29.730789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d002869-92c5-47e1-96d4-f8b583784ca0 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:29.740150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 998/2000] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:29.787807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94797-9a39-4fd1-a9f6-9aa8169d0b48 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:29.789275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7ec94797-9a39-4fd1-a9f6-9aa8169d0b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:29.801128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94797-9a39-4fd1-a9f6-9aa8169d0b48 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:29.805244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48c93d-5220-4ba3-95df-72e234ca48ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:29.805887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c93d-5220-4ba3-95df-72e234ca48ee service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:29.806172 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c93d-5220-4ba3-95df-72e234ca48ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:29.806448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c93d-5220-4ba3-95df-72e234ca48ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:29.815751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:29.865323 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48c93d-5220-4ba3-95df-72e234ca48ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:29.867397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48c93d-5220-4ba3-95df-72e234ca48ee service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:29.877634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1003/2001] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:34.395608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d002869-92c5-47e1-96d4-f8b583784ca0 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:34.397296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4d002869-92c5-47e1-96d4-f8b583784ca0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:34.447846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:34.472833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d002869-92c5-47e1-96d4-f8b583784ca0 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:34.477912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:34.478788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:34.479068 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:34.479343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] PATH_INFO: `/v3/users/53c8174896dc4b3d96ea21d080528887` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:34.480519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c8174896dc4b3d96ea21d080528887)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:34.482467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:34.540888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c8174896dc4b3d96ea21d080528887'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:34.541535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c8174896dc4b3d96ea21d080528887'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:34.542136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c8174896dc4b3d96ea21d080528887'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:34.555230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c8174896dc4b3d96ea21d080528887'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:34.562450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c8174896dc4b3d96ea21d080528887'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:34.577706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 999/2002] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:34 2022] DELETE /identity/v3/users/53c8174896dc4b3d96ea21d080528887 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:34.581726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec7e92-6c14-4dd6-9a2d-509fa59d3ef7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:34.582209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec7e92-6c14-4dd6-9a2d-509fa59d3ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:34.582413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec7e92-6c14-4dd6-9a2d-509fa59d3ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:34.600400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b7ec7e92-6c14-4dd6-9a2d-509fa59d3ef7 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:34.602123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b7ec7e92-6c14-4dd6-9a2d-509fa59d3ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:34.669359 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1004/2003] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:34.679024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:34.680604 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:34.737360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1cb4aa-b6fa-43d6-a815-c0e43a3a0245 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:34.741818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceeed43-b36c-490d-b9f0-fcccc9a5322f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:34.742618 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeed43-b36c-490d-b9f0-fcccc9a5322f service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:34.742903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeed43-b36c-490d-b9f0-fcccc9a5322f service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:34.743204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceeed43-b36c-490d-b9f0-fcccc9a5322f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:34.752487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceeed43-b36c-490d-b9f0-fcccc9a5322f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:34.753959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceeed43-b36c-490d-b9f0-fcccc9a5322f service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:34.763819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1000/2004] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:35.207214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec7e92-6c14-4dd6-9a2d-509fa59d3ef7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:35.209632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b7ec7e92-6c14-4dd6-9a2d-509fa59d3ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:35.224494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec7e92-6c14-4dd6-9a2d-509fa59d3ef7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:35.232673 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:35.236073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:35.236437 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:35.236806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] PATH_INFO: `/v3/projects/d81b11d026e64475881db3153d01b76f` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:35.238289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81b11d026e64475881db3153d01b76f)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:35.240226 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:35.316657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81b11d026e64475881db3153d01b76f', 'request_id': 'req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.325890 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81b11d026e64475881db3153d01b76f', 'request_id': 'req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.333796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81b11d026e64475881db3153d01b76f', 'request_id': 'req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.344599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] The token cache is being invalidate because project d81b11d026e64475881db3153d01b76f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:35.344949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.345617 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.347408 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1005/2005] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:35 2022] DELETE /identity/v3/projects/d81b11d026e64475881db3153d01b76f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:35.352051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceeed43-b36c-490d-b9f0-fcccc9a5322f service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:35.361548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceeed43-b36c-490d-b9f0-fcccc9a5322f service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:35.427005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d470677-d236-4e8b-8248-289901ba0712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:35.428559 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470677-d236-4e8b-8248-289901ba0712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:35.429534 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470677-d236-4e8b-8248-289901ba0712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:35.429896 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470677-d236-4e8b-8248-289901ba0712 admin admin] PATH_INFO: `/v3/users/0cc61703d88a4a139f6aab250ac4f3a1` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:35.431878 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d470677-d236-4e8b-8248-289901ba0712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc61703d88a4a139f6aab250ac4f3a1)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:35.434568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d470677-d236-4e8b-8248-289901ba0712 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:35.436888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:35.505267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3d470677-d236-4e8b-8248-289901ba0712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc61703d88a4a139f6aab250ac4f3a1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.508681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3d470677-d236-4e8b-8248-289901ba0712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc61703d88a4a139f6aab250ac4f3a1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.509745 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3d470677-d236-4e8b-8248-289901ba0712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc61703d88a4a139f6aab250ac4f3a1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.527688 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3d470677-d236-4e8b-8248-289901ba0712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc61703d88a4a139f6aab250ac4f3a1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.536247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3d470677-d236-4e8b-8248-289901ba0712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc61703d88a4a139f6aab250ac4f3a1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.550260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1001/2006] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:35 2022] DELETE /identity/v3/users/0cc61703d88a4a139f6aab250ac4f3a1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:35.626374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:35.628895 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:35.644489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc91f7c-05ea-4e21-bf1f-b99fa44557e1 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:35.680946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:35.717538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:35.718496 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:35.718778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:35.719060 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] PATH_INFO: `/v3/users/f6518f1a784d41de84d8d145b4fe7052` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:35.720534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6518f1a784d41de84d8d145b4fe7052)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:35.722813 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:35.785996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6518f1a784d41de84d8d145b4fe7052'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.787095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6518f1a784d41de84d8d145b4fe7052'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.789139 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6518f1a784d41de84d8d145b4fe7052'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.805431 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6518f1a784d41de84d8d145b4fe7052'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.813778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6518f1a784d41de84d8d145b4fe7052'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:35.853856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1006/2007] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:35 2022] DELETE /identity/v3/users/f6518f1a784d41de84d8d145b4fe7052 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:35.858807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0b0b1-48c6-42b2-8cb3-496d44a36766 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:35.859093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0b0b1-48c6-42b2-8cb3-496d44a36766 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:35.859383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0b0b1-48c6-42b2-8cb3-496d44a36766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:35.870873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:35.872877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:35.891222 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8be0b0b1-48c6-42b2-8cb3-496d44a36766 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:35.893269 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8be0b0b1-48c6-42b2-8cb3-496d44a36766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:35.963767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1002/2008] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:35.965597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c153f-12b6-4a3b-86e3-9e16f44e6424 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:35.970320 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:35.971188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:35.971470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:35.971825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] PATH_INFO: `/v3/projects/c920b5de6227412ba40409f583502162` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:35.973049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c920b5de6227412ba40409f583502162)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:35.974857 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0b0b1-48c6-42b2-8cb3-496d44a36766 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:35.975122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:35.976812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8be0b0b1-48c6-42b2-8cb3-496d44a36766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:36.026283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c920b5de6227412ba40409f583502162', 'request_id': 'req-47dada19-5472-4513-b63d-bec2dabd3136'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.034040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c920b5de6227412ba40409f583502162', 'request_id': 'req-47dada19-5472-4513-b63d-bec2dabd3136'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.035189 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:36.038678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0b0b1-48c6-42b2-8cb3-496d44a36766 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:36.043657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c920b5de6227412ba40409f583502162', 'request_id': 'req-47dada19-5472-4513-b63d-bec2dabd3136'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.055225 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] The token cache is being invalidate because project c920b5de6227412ba40409f583502162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:36.055515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.056179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.057793 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1007/2009] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:35 2022] DELETE /identity/v3/projects/c920b5de6227412ba40409f583502162 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:36.061596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:36.062950 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:36.074282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:36.094351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9c699-f50e-42a4-aafc-c0b8de7aab2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:36.095196 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9c699-f50e-42a4-aafc-c0b8de7aab2c service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:36.095482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9c699-f50e-42a4-aafc-c0b8de7aab2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:36.095762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9c699-f50e-42a4-aafc-c0b8de7aab2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:36.097587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-eff9c699-f50e-42a4-aafc-c0b8de7aab2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:36.140032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dada19-5472-4513-b63d-bec2dabd3136 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:36.148211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:36.151378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:36.151820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:36.152198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] PATH_INFO: `/v3/users/103fb204ac4046498fa90fa9b4c00b9e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:36.154374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=103fb204ac4046498fa90fa9b4c00b9e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:36.156811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:36.172822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9c699-f50e-42a4-aafc-c0b8de7aab2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:36.174653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9c699-f50e-42a4-aafc-c0b8de7aab2c service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:36.188017 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1003/2010] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:34:36.215479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103fb204ac4046498fa90fa9b4c00b9e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.216307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103fb204ac4046498fa90fa9b4c00b9e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.216898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103fb204ac4046498fa90fa9b4c00b9e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.231098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103fb204ac4046498fa90fa9b4c00b9e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.239959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103fb204ac4046498fa90fa9b4c00b9e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.269707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1008/2011] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:36 2022] DELETE /identity/v3/users/103fb204ac4046498fa90fa9b4c00b9e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:34:36.488759 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9c699-f50e-42a4-aafc-c0b8de7aab2c service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:36.490224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-eff9c699-f50e-42a4-aafc-c0b8de7aab2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:36.508754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9c699-f50e-42a4-aafc-c0b8de7aab2c service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:36.585440 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:36.586523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:36.586808 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:36.587174 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] PATH_INFO: `/v3/projects/c91c78976827454d862e4288905057b0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:36.588440 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91c78976827454d862e4288905057b0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:36.590474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:36.649858 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91c78976827454d862e4288905057b0', 'request_id': 'req-65befdac-a3ba-4745-85af-213cf9124a08'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.661345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91c78976827454d862e4288905057b0', 'request_id': 'req-65befdac-a3ba-4745-85af-213cf9124a08'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.673511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91c78976827454d862e4288905057b0', 'request_id': 'req-65befdac-a3ba-4745-85af-213cf9124a08'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.686827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] The token cache is being invalidate because project c91c78976827454d862e4288905057b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:36.687000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.687785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.689676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1004/2012] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:36 2022] DELETE /identity/v3/projects/c91c78976827454d862e4288905057b0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:36.693955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:36.695699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:36.712653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724b742-eb86-4bdb-b340-e4d8955b7f1b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:36.790251 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:36.791156 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:36.791444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:36.791755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] PATH_INFO: `/v3/users/bec0a808c35645659b66a71759d84b2a` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:36.793137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec0a808c35645659b66a71759d84b2a)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:36.795019 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:36.804191 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:36.805088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:36.806780 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:36.821051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65befdac-a3ba-4745-85af-213cf9124a08 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:36.826333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c34bf3-3e1a-413c-8d1a-ab97dd340128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:36.827485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c34bf3-3e1a-413c-8d1a-ab97dd340128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:36.827929 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c34bf3-3e1a-413c-8d1a-ab97dd340128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:36.828419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c34bf3-3e1a-413c-8d1a-ab97dd340128 admin admin] PATH_INFO: `/v3/projects/f21fa2ed7a7341e39e4cd381d358edda` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:36.831055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c34bf3-3e1a-413c-8d1a-ab97dd340128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f21fa2ed7a7341e39e4cd381d358edda)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:36.834048 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c34bf3-3e1a-413c-8d1a-ab97dd340128 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:36.848282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:36.861263 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec0a808c35645659b66a71759d84b2a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.861933 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec0a808c35645659b66a71759d84b2a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.862545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec0a808c35645659b66a71759d84b2a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.877153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec0a808c35645659b66a71759d84b2a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.899830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec0a808c35645659b66a71759d84b2a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.900020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-80c34bf3-3e1a-413c-8d1a-ab97dd340128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f21fa2ed7a7341e39e4cd381d358edda', 'request_id': 'req-80c34bf3-3e1a-413c-8d1a-ab97dd340128'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.908969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-80c34bf3-3e1a-413c-8d1a-ab97dd340128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f21fa2ed7a7341e39e4cd381d358edda', 'request_id': 'req-80c34bf3-3e1a-413c-8d1a-ab97dd340128'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.916872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-80c34bf3-3e1a-413c-8d1a-ab97dd340128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f21fa2ed7a7341e39e4cd381d358edda', 'request_id': 'req-80c34bf3-3e1a-413c-8d1a-ab97dd340128'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.920804 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1009/2013] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:36 2022] DELETE /identity/v3/users/bec0a808c35645659b66a71759d84b2a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:36.920804 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:36.921058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:36.947726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-80c34bf3-3e1a-413c-8d1a-ab97dd340128 admin admin] The token cache is being invalidate because project f21fa2ed7a7341e39e4cd381d358edda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:36.948108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-80c34bf3-3e1a-413c-8d1a-ab97dd340128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.950205 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-80c34bf3-3e1a-413c-8d1a-ab97dd340128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:36.953438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1005/2014] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:36 2022] DELETE /identity/v3/projects/f21fa2ed7a7341e39e4cd381d358edda => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:36.959003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d83249-ac71-4143-9698-74b6546f56ca None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:36.959296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d83249-ac71-4143-9698-74b6546f56ca None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:36.959585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d83249-ac71-4143-9698-74b6546f56ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.004155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-03d83249-ac71-4143-9698-74b6546f56ca None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:37.005431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-03d83249-ac71-4143-9698-74b6546f56ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.024201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2ed0b-b200-4a4e-835e-9096d5248179 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.029409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ea9ff-3aa8-46bc-8524-66e981c95580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.030308 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ea9ff-3aa8-46bc-8524-66e981c95580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.030596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ea9ff-3aa8-46bc-8524-66e981c95580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.030877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ea9ff-3aa8-46bc-8524-66e981c95580 admin admin] PATH_INFO: `/v3/users/27dac74ce39b46bfbf440885fe1fd9d3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.032121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ea9ff-3aa8-46bc-8524-66e981c95580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27dac74ce39b46bfbf440885fe1fd9d3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.034133 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ea9ff-3aa8-46bc-8524-66e981c95580 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.090514 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1006/2015] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:37.092028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac31fc-fa3e-4407-87cf-bfe71596cbde None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.092332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac31fc-fa3e-4407-87cf-bfe71596cbde None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.092674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac31fc-fa3e-4407-87cf-bfe71596cbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.108605 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-bc3ea9ff-3aa8-46bc-8524-66e981c95580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27dac74ce39b46bfbf440885fe1fd9d3'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:37.109810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-bc3ea9ff-3aa8-46bc-8524-66e981c95580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27dac74ce39b46bfbf440885fe1fd9d3'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:37.110607 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-bc3ea9ff-3aa8-46bc-8524-66e981c95580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27dac74ce39b46bfbf440885fe1fd9d3'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:37.122209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-00ac31fc-fa3e-4407-87cf-bfe71596cbde None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:37.123441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-00ac31fc-fa3e-4407-87cf-bfe71596cbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.133732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-bc3ea9ff-3aa8-46bc-8524-66e981c95580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27dac74ce39b46bfbf440885fe1fd9d3'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:37.134558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1007/2016] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:37.138682 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac31fc-fa3e-4407-87cf-bfe71596cbde None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.143298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-bc3ea9ff-3aa8-46bc-8524-66e981c95580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27dac74ce39b46bfbf440885fe1fd9d3'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:37.149139 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac31fc-fa3e-4407-87cf-bfe71596cbde None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.155110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5083ee-ef9d-4942-8c29-9f4c6cf5a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.155723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5083ee-ef9d-4942-8c29-9f4c6cf5a461 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.156005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5083ee-ef9d-4942-8c29-9f4c6cf5a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.156331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5083ee-ef9d-4942-8c29-9f4c6cf5a461 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.157124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5083ee-ef9d-4942-8c29-9f4c6cf5a461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:37.157436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5083ee-ef9d-4942-8c29-9f4c6cf5a461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.158531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1010/2017] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:36 2022] DELETE /identity/v3/users/27dac74ce39b46bfbf440885fe1fd9d3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:37.159093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5083ee-ef9d-4942-8c29-9f4c6cf5a461 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.162817 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15af58-c099-49b2-87ba-58952428f658 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.162992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15af58-c099-49b2-87ba-58952428f658 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.163296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15af58-c099-49b2-87ba-58952428f658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.169850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:37.179792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1008/2018] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:37.182133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5083ee-ef9d-4942-8c29-9f4c6cf5a461 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.184075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5a15af58-c099-49b2-87ba-58952428f658 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:37.186314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5a15af58-c099-49b2-87ba-58952428f658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.196772 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5083ee-ef9d-4942-8c29-9f4c6cf5a461 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.263391 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1011/2019] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:37.263391 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15af58-c099-49b2-87ba-58952428f658 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.264552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5a15af58-c099-49b2-87ba-58952428f658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.270008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ad305-6347-4e5d-9ec4-1cdfc344537a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.271047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ad305-6347-4e5d-9ec4-1cdfc344537a admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.271338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ad305-6347-4e5d-9ec4-1cdfc344537a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.271616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ad305-6347-4e5d-9ec4-1cdfc344537a admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.273149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ad305-6347-4e5d-9ec4-1cdfc344537a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.275756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ad305-6347-4e5d-9ec4-1cdfc344537a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.283247 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15af58-c099-49b2-87ba-58952428f658 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.289737 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.291000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.291320 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.291921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] PATH_INFO: `/v3/projects/d6fb8911b78f48d1abfcaa6d10134bdb` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.292923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fb8911b78f48d1abfcaa6d10134bdb)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.294868 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.307953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1009/2020] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:37.308678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ad305-6347-4e5d-9ec4-1cdfc344537a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.310281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-673ad305-6347-4e5d-9ec4-1cdfc344537a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.316462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:37.347709 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fb8911b78f48d1abfcaa6d10134bdb', 'request_id': 'req-e7bdbc94-b278-4423-ba5b-34467b85011e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:37.357034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fb8911b78f48d1abfcaa6d10134bdb', 'request_id': 'req-e7bdbc94-b278-4423-ba5b-34467b85011e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:37.364073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fb8911b78f48d1abfcaa6d10134bdb', 'request_id': 'req-e7bdbc94-b278-4423-ba5b-34467b85011e'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:37.373461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ad305-6347-4e5d-9ec4-1cdfc344537a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.374584 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] The token cache is being invalidate because project d6fb8911b78f48d1abfcaa6d10134bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:37.374886 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:37.375549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:37.377164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1012/2021] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:37 2022] DELETE /identity/v3/projects/d6fb8911b78f48d1abfcaa6d10134bdb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:37.381206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.381206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.426518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb02f9b-f1c1-4f78-b6b7-01753e574376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.427124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb02f9b-f1c1-4f78-b6b7-01753e574376 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.427417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb02f9b-f1c1-4f78-b6b7-01753e574376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.427698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb02f9b-f1c1-4f78-b6b7-01753e574376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.429981 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2eb02f9b-f1c1-4f78-b6b7-01753e574376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.446455 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdbc94-b278-4423-ba5b-34467b85011e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.451220 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082f8cb-1534-466e-8386-d2994a66ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.451946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082f8cb-1534-466e-8386-d2994a66ed1c admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.452235 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082f8cb-1534-466e-8386-d2994a66ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.452510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082f8cb-1534-466e-8386-d2994a66ed1c admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.453238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082f8cb-1534-466e-8386-d2994a66ed1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.455143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082f8cb-1534-466e-8386-d2994a66ed1c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.475809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1013/2022] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:37.477724 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28de3a-03d7-4979-8854-5a74cd57b6e8 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.478171 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28de3a-03d7-4979-8854-5a74cd57b6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.478917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28de3a-03d7-4979-8854-5a74cd57b6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.497129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb02f9b-f1c1-4f78-b6b7-01753e574376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.497652 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-dc28de3a-03d7-4979-8854-5a74cd57b6e8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:37.498308 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dc28de3a-03d7-4979-8854-5a74cd57b6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.498504 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb02f9b-f1c1-4f78-b6b7-01753e574376 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.506417 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1014/2023] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:37.507943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28de3a-03d7-4979-8854-5a74cd57b6e8 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.510563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1010/2024] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:37.515294 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f9a08-3b1e-4bbe-9a51-9ef737a2a2bc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.515593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f9a08-3b1e-4bbe-9a51-9ef737a2a2bc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.515913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f9a08-3b1e-4bbe-9a51-9ef737a2a2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.518179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28de3a-03d7-4979-8854-5a74cd57b6e8 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.528247 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec94de3-7aaf-43db-a28f-d74fc6eba616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.528949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94de3-7aaf-43db-a28f-d74fc6eba616 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.529242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94de3-7aaf-43db-a28f-d74fc6eba616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.529524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec94de3-7aaf-43db-a28f-d74fc6eba616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.530439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec94de3-7aaf-43db-a28f-d74fc6eba616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.532052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec94de3-7aaf-43db-a28f-d74fc6eba616 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.534831 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:37.536092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ea6f9a08-3b1e-4bbe-9a51-9ef737a2a2bc None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:37.537472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ea6f9a08-3b1e-4bbe-9a51-9ef737a2a2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.549893 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1011/2025] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:37.550067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1015/2026] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:37.550173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f9a08-3b1e-4bbe-9a51-9ef737a2a2bc None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.551341 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec94de3-7aaf-43db-a28f-d74fc6eba616 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.561252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f9a08-3b1e-4bbe-9a51-9ef737a2a2bc None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.561923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec94de3-7aaf-43db-a28f-d74fc6eba616 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.567185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad852eb0-1c47-41e2-b0aa-0d4c44b62373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.568161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad852eb0-1c47-41e2-b0aa-0d4c44b62373 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.568534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185f7be-08df-4201-9d13-65fc333d0f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.568680 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad852eb0-1c47-41e2-b0aa-0d4c44b62373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.568904 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad852eb0-1c47-41e2-b0aa-0d4c44b62373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.569887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185f7be-08df-4201-9d13-65fc333d0f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.570230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185f7be-08df-4201-9d13-65fc333d0f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.570395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad852eb0-1c47-41e2-b0aa-0d4c44b62373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.570528 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185f7be-08df-4201-9d13-65fc333d0f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.571248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185f7be-08df-4201-9d13-65fc333d0f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:37.571560 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185f7be-08df-4201-9d13-65fc333d0f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.571948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad852eb0-1c47-41e2-b0aa-0d4c44b62373 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.573197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185f7be-08df-4201-9d13-65fc333d0f16 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.586296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1012/2027] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:37.587361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1016/2028] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:34:37.590836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad852eb0-1c47-41e2-b0aa-0d4c44b62373 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.591892 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185f7be-08df-4201-9d13-65fc333d0f16 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.602820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185f7be-08df-4201-9d13-65fc333d0f16 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.603387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad852eb0-1c47-41e2-b0aa-0d4c44b62373 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.608502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597abd68-3457-47b4-8a50-f7c2da31c66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.609196 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597abd68-3457-47b4-8a50-f7c2da31c66a admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.609484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597abd68-3457-47b4-8a50-f7c2da31c66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.609816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597abd68-3457-47b4-8a50-f7c2da31c66a admin admin] PATH_INFO: `/v3/projects/7bd9629b9d024ac7a08441c1c7a6c192/users/0d9d7d88d10c475d8958482b5c5bb711/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.620634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fa408-e548-4253-9acf-62896df1efb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.623988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fa408-e548-4253-9acf-62896df1efb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.624767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fa408-e548-4253-9acf-62896df1efb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.625495 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fa408-e548-4253-9acf-62896df1efb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.626977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fa408-e548-4253-9acf-62896df1efb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.629025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fa408-e548-4253-9acf-62896df1efb7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.644266 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597abd68-3457-47b4-8a50-f7c2da31c66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd9629b9d024ac7a08441c1c7a6c192, user_id=0d9d7d88d10c475d8958482b5c5bb711, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.647159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597abd68-3457-47b4-8a50-f7c2da31c66a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.669614 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1013/2029] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:37 2022] PUT /identity/v3/projects/7bd9629b9d024ac7a08441c1c7a6c192/users/0d9d7d88d10c475d8958482b5c5bb711/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:34:37.671843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1017/2030] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/projects => generated 401 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:37.688919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a412e4-af78-49af-8647-528fcae29514 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.689266 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597abd68-3457-47b4-8a50-f7c2da31c66a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.690645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a412e4-af78-49af-8647-528fcae29514 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.692448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a412e4-af78-49af-8647-528fcae29514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.733152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-73a412e4-af78-49af-8647-528fcae29514 None None] MFA Rules not processed for user `0d9d7d88d10c475d8958482b5c5bb711`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:37.734393 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-73a412e4-af78-49af-8647-528fcae29514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.735582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:37.774604 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597abd68-3457-47b4-8a50-f7c2da31c66a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.825907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1018/2031] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:37.841471 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a412e4-af78-49af-8647-528fcae29514 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.843493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-73a412e4-af78-49af-8647-528fcae29514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:37.884875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865e878-72b5-4bd0-a8f1-b3f1a2dbeeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.885571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865e878-72b5-4bd0-a8f1-b3f1a2dbeeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.885854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865e878-72b5-4bd0-a8f1-b3f1a2dbeeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.886131 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865e878-72b5-4bd0-a8f1-b3f1a2dbeeb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.887083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865e878-72b5-4bd0-a8f1-b3f1a2dbeeb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.895605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865e878-72b5-4bd0-a8f1-b3f1a2dbeeb4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.937354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1014/2032] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:37 2022] POST /identity/v3/users => generated 301 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:37.937354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865e878-72b5-4bd0-a8f1-b3f1a2dbeeb4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.944994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865e878-72b5-4bd0-a8f1-b3f1a2dbeeb4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.950266 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6e6ba-e3bf-4ffc-8b4f-bd51d9129b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.950940 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6e6ba-e3bf-4ffc-8b4f-bd51d9129b73 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.951866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6e6ba-e3bf-4ffc-8b4f-bd51d9129b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.951866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6e6ba-e3bf-4ffc-8b4f-bd51d9129b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.952637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6e6ba-e3bf-4ffc-8b4f-bd51d9129b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.954286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6e6ba-e3bf-4ffc-8b4f-bd51d9129b73 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.955753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a412e4-af78-49af-8647-528fcae29514 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.959560 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d37616-32fb-4144-8a05-77e3a93d3d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.960632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d37616-32fb-4144-8a05-77e3a93d3d7c service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.961200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d37616-32fb-4144-8a05-77e3a93d3d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.961497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d37616-32fb-4144-8a05-77e3a93d3d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.968668 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1015/2033] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:37.969826 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6e6ba-e3bf-4ffc-8b4f-bd51d9129b73 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:37.970792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d37616-32fb-4144-8a05-77e3a93d3d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.972337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d37616-32fb-4144-8a05-77e3a93d3d7c service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:37.980041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6e6ba-e3bf-4ffc-8b4f-bd51d9129b73 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:37.982309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1019/2034] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:37.985096 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd625a-1f07-4e15-bd04-b7d815ea559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:37.985838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd625a-1f07-4e15-bd04-b7d815ea559e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:37.986193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd625a-1f07-4e15-bd04-b7d815ea559e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:37.986540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd625a-1f07-4e15-bd04-b7d815ea559e admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:37.987450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd625a-1f07-4e15-bd04-b7d815ea559e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:37.989240 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd625a-1f07-4e15-bd04-b7d815ea559e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.002703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1016/2035] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:38.007651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d37616-32fb-4144-8a05-77e3a93d3d7c service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.020248 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd625a-1f07-4e15-bd04-b7d815ea559e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.020815 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d37616-32fb-4144-8a05-77e3a93d3d7c service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.022032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-77bd625a-1f07-4e15-bd04-b7d815ea559e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.026649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d0fd8-7fb3-4897-8db4-a2b3dfa3ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.027578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d0fd8-7fb3-4897-8db4-a2b3dfa3ad0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.028024 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d0fd8-7fb3-4897-8db4-a2b3dfa3ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.028396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d0fd8-7fb3-4897-8db4-a2b3dfa3ad0b admin admin] PATH_INFO: `/v3/projects/d064ed68c25e472a919e3d5b1d489a54/users/ea7b55dc26694c58852050113033463f/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.041006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd625a-1f07-4e15-bd04-b7d815ea559e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.052958 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578405cc-09c4-4fd2-9aec-5b64cff6c264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.054794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d0fd8-7fb3-4897-8db4-a2b3dfa3ad0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d064ed68c25e472a919e3d5b1d489a54, user_id=ea7b55dc26694c58852050113033463f, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.055563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578405cc-09c4-4fd2-9aec-5b64cff6c264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.056037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578405cc-09c4-4fd2-9aec-5b64cff6c264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.056491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578405cc-09c4-4fd2-9aec-5b64cff6c264 admin admin] PATH_INFO: `/v3/projects/dd2c97ddd23f4856b7ea1432b9c7adb6` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.057538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d0fd8-7fb3-4897-8db4-a2b3dfa3ad0b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.058169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578405cc-09c4-4fd2-9aec-5b64cff6c264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2c97ddd23f4856b7ea1432b9c7adb6)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.060379 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578405cc-09c4-4fd2-9aec-5b64cff6c264 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.073456 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1020/2036] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:38 2022] PUT /identity/v3/projects/d064ed68c25e472a919e3d5b1d489a54/users/ea7b55dc26694c58852050113033463f/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:38.083673 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a69c-d9f2-46dd-a72c-d29d0e14b322 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.083962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a69c-d9f2-46dd-a72c-d29d0e14b322 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.084239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a69c-d9f2-46dd-a72c-d29d0e14b322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.115793 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d257a69c-d9f2-46dd-a72c-d29d0e14b322 None None] MFA Rules not processed for user `ea7b55dc26694c58852050113033463f`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.117713 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d257a69c-d9f2-46dd-a72c-d29d0e14b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.122291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-578405cc-09c4-4fd2-9aec-5b64cff6c264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2c97ddd23f4856b7ea1432b9c7adb6', 'request_id': 'req-578405cc-09c4-4fd2-9aec-5b64cff6c264'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:38.133922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-578405cc-09c4-4fd2-9aec-5b64cff6c264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2c97ddd23f4856b7ea1432b9c7adb6', 'request_id': 'req-578405cc-09c4-4fd2-9aec-5b64cff6c264'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:38.143433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-578405cc-09c4-4fd2-9aec-5b64cff6c264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2c97ddd23f4856b7ea1432b9c7adb6', 'request_id': 'req-578405cc-09c4-4fd2-9aec-5b64cff6c264'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:38.145577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:38.160394 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-578405cc-09c4-4fd2-9aec-5b64cff6c264 admin admin] The token cache is being invalidate because project dd2c97ddd23f4856b7ea1432b9c7adb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:38.160978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-578405cc-09c4-4fd2-9aec-5b64cff6c264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:38.162780 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-578405cc-09c4-4fd2-9aec-5b64cff6c264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:38.165879 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1017/2037] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:38 2022] DELETE /identity/v3/projects/dd2c97ddd23f4856b7ea1432b9c7adb6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:38.170852 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d02e6e-e570-4e95-b640-0e90f3f7345a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.171375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d02e6e-e570-4e95-b640-0e90f3f7345a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.171779 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d02e6e-e570-4e95-b640-0e90f3f7345a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.202134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-99d02e6e-e570-4e95-b640-0e90f3f7345a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.203676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-99d02e6e-e570-4e95-b640-0e90f3f7345a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.215477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1021/2038] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:38.219988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257a69c-d9f2-46dd-a72c-d29d0e14b322 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.221459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d257a69c-d9f2-46dd-a72c-d29d0e14b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.240483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:38.310710 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1018/2039] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:38.312564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4edf62-c05c-49c6-9cd9-55afef7ae9e4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.313215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4edf62-c05c-49c6-9cd9-55afef7ae9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.314620 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4edf62-c05c-49c6-9cd9-55afef7ae9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.339388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257a69c-d9f2-46dd-a72c-d29d0e14b322 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.340227 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8a4edf62-c05c-49c6-9cd9-55afef7ae9e4 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.341778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8a4edf62-c05c-49c6-9cd9-55afef7ae9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.344477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139a20c-bca9-4458-854e-46d8d7077bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.345199 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a20c-bca9-4458-854e-46d8d7077bda admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.345487 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a20c-bca9-4458-854e-46d8d7077bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.345766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a20c-bca9-4458-854e-46d8d7077bda admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.346477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139a20c-bca9-4458-854e-46d8d7077bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.348394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139a20c-bca9-4458-854e-46d8d7077bda admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.351122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1019/2040] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:38.356385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4edf62-c05c-49c6-9cd9-55afef7ae9e4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.366049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4edf62-c05c-49c6-9cd9-55afef7ae9e4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.371906 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d439e62-f3d9-4945-874e-ffe056639d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.373007 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d439e62-f3d9-4945-874e-ffe056639d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.373656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d439e62-f3d9-4945-874e-ffe056639d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.373943 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d439e62-f3d9-4945-874e-ffe056639d77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.375214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d439e62-f3d9-4945-874e-ffe056639d77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:38.375214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d439e62-f3d9-4945-874e-ffe056639d77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.376613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d439e62-f3d9-4945-874e-ffe056639d77 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.390515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1022/2041] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/projects => generated 399 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:34:38.392755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1020/2042] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:38.396353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139a20c-bca9-4458-854e-46d8d7077bda admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.397755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d439e62-f3d9-4945-874e-ffe056639d77 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.422128 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d439e62-f3d9-4945-874e-ffe056639d77 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.483458 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139a20c-bca9-4458-854e-46d8d7077bda admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.489157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa758fd-ab8a-401d-b750-2d9bed19597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.489955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa758fd-ab8a-401d-b750-2d9bed19597c admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.490387 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa758fd-ab8a-401d-b750-2d9bed19597c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.490719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa758fd-ab8a-401d-b750-2d9bed19597c admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.492217 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa758fd-ab8a-401d-b750-2d9bed19597c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.494404 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa758fd-ab8a-401d-b750-2d9bed19597c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.502410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bface5b-5db5-4ef3-ad82-08a664395119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.503409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bface5b-5db5-4ef3-ad82-08a664395119 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.503409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bface5b-5db5-4ef3-ad82-08a664395119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.503640 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bface5b-5db5-4ef3-ad82-08a664395119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.504370 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bface5b-5db5-4ef3-ad82-08a664395119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.506773 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bface5b-5db5-4ef3-ad82-08a664395119 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.519220 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1023/2043] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/users => generated 306 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:38.524064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa758fd-ab8a-401d-b750-2d9bed19597c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.535615 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa758fd-ab8a-401d-b750-2d9bed19597c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.543127 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1021/2044] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:38.544075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900c326-d5c8-4419-9993-a4a2cdc52c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.544257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bface5b-5db5-4ef3-ad82-08a664395119 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.544869 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900c326-d5c8-4419-9993-a4a2cdc52c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.545210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900c326-d5c8-4419-9993-a4a2cdc52c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.545484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900c326-d5c8-4419-9993-a4a2cdc52c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.546229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900c326-d5c8-4419-9993-a4a2cdc52c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.547954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900c326-d5c8-4419-9993-a4a2cdc52c4d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.565500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1024/2045] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:38.566416 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900c326-d5c8-4419-9993-a4a2cdc52c4d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.577923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900c326-d5c8-4419-9993-a4a2cdc52c4d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.605521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:38.617492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bface5b-5db5-4ef3-ad82-08a664395119 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.624332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33656329-7a57-4bf5-b7a0-9c385af092ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.625053 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33656329-7a57-4bf5-b7a0-9c385af092ac admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.625344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33656329-7a57-4bf5-b7a0-9c385af092ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.626026 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33656329-7a57-4bf5-b7a0-9c385af092ac admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.626306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33656329-7a57-4bf5-b7a0-9c385af092ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.628396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33656329-7a57-4bf5-b7a0-9c385af092ac admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.651577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf279ea8-c951-4bd2-8475-e1c5b98ea6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.652483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf279ea8-c951-4bd2-8475-e1c5b98ea6b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.652797 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf279ea8-c951-4bd2-8475-e1c5b98ea6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.653078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf279ea8-c951-4bd2-8475-e1c5b98ea6b0 admin admin] PATH_INFO: `/v3/projects/97d4e6d51a0a49a6984eedc06e9063fc/users/663530bbe3f54ba4b0ae961effd49b58/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.656798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1022/2046] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:34:38.658068 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33656329-7a57-4bf5-b7a0-9c385af092ac admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.671590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf279ea8-c951-4bd2-8475-e1c5b98ea6b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d4e6d51a0a49a6984eedc06e9063fc, user_id=663530bbe3f54ba4b0ae961effd49b58, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.672051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33656329-7a57-4bf5-b7a0-9c385af092ac admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.674276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf279ea8-c951-4bd2-8475-e1c5b98ea6b0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.676978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5e8a1-64cf-4cba-b107-db849ce87f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.677657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e8a1-64cf-4cba-b107-db849ce87f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.677940 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e8a1-64cf-4cba-b107-db849ce87f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.678217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5e8a1-64cf-4cba-b107-db849ce87f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.679916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5e8a1-64cf-4cba-b107-db849ce87f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.682391 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5e8a1-64cf-4cba-b107-db849ce87f3f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.689635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1025/2047] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:38 2022] PUT /identity/v3/projects/97d4e6d51a0a49a6984eedc06e9063fc/users/663530bbe3f54ba4b0ae961effd49b58/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:38.693418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf279ea8-c951-4bd2-8475-e1c5b98ea6b0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.698089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1023/2048] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:38.702275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5e8a1-64cf-4cba-b107-db849ce87f3f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.713568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5e8a1-64cf-4cba-b107-db849ce87f3f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.722753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:38.770715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf279ea8-c951-4bd2-8475-e1c5b98ea6b0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.776596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b38ffc-f45b-418a-93de-5694f76bf47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.777291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b38ffc-f45b-418a-93de-5694f76bf47d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.777577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b38ffc-f45b-418a-93de-5694f76bf47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.777845 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b38ffc-f45b-418a-93de-5694f76bf47d admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.778579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b38ffc-f45b-418a-93de-5694f76bf47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.780232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b38ffc-f45b-418a-93de-5694f76bf47d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.782971 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b5fc4-8490-41f9-98c0-f22f5ff1ffc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.783751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b5fc4-8490-41f9-98c0-f22f5ff1ffc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.784126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b5fc4-8490-41f9-98c0-f22f5ff1ffc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.784456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b5fc4-8490-41f9-98c0-f22f5ff1ffc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.785350 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b5fc4-8490-41f9-98c0-f22f5ff1ffc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.787035 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b5fc4-8490-41f9-98c0-f22f5ff1ffc9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.792343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1026/2049] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:38.796436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b38ffc-f45b-418a-93de-5694f76bf47d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.801085 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1024/2050] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:38.805431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b5fc4-8490-41f9-98c0-f22f5ff1ffc9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:38.807770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b38ffc-f45b-418a-93de-5694f76bf47d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.813113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c4e7c-bcfd-4a5c-93e2-5b9f40b33897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.813944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c4e7c-bcfd-4a5c-93e2-5b9f40b33897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.814241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c4e7c-bcfd-4a5c-93e2-5b9f40b33897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.814519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c4e7c-bcfd-4a5c-93e2-5b9f40b33897 admin admin] PATH_INFO: `/v3/projects/97d4e6d51a0a49a6984eedc06e9063fc/users/663530bbe3f54ba4b0ae961effd49b58/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.816398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b5fc4-8490-41f9-98c0-f22f5ff1ffc9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:38.816762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c4e7c-bcfd-4a5c-93e2-5b9f40b33897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d4e6d51a0a49a6984eedc06e9063fc, user_id=663530bbe3f54ba4b0ae961effd49b58, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.821034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c4e7c-bcfd-4a5c-93e2-5b9f40b33897 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.823991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae23eb-4201-4eb4-ac9a-e9457a3b63a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:38.824935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae23eb-4201-4eb4-ac9a-e9457a3b63a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.825240 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae23eb-4201-4eb4-ac9a-e9457a3b63a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.825513 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae23eb-4201-4eb4-ac9a-e9457a3b63a8 admin admin] PATH_INFO: `/v3/projects/e730e555bf144aedb0355c7a68220d65/users/d728eef7edf04a8c82987e75f27203bd/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.840244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1027/2051] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:38 2022] PUT /identity/v3/projects/97d4e6d51a0a49a6984eedc06e9063fc/users/663530bbe3f54ba4b0ae961effd49b58/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:34:38.844154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae23eb-4201-4eb4-ac9a-e9457a3b63a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e730e555bf144aedb0355c7a68220d65, user_id=d728eef7edf04a8c82987e75f27203bd, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:38.847405 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae23eb-4201-4eb4-ac9a-e9457a3b63a8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:38.852096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfdd56-4f83-43d4-bd84-8a4f0d1ac6ce None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.852096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfdd56-4f83-43d4-bd84-8a4f0d1ac6ce None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.852482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfdd56-4f83-43d4-bd84-8a4f0d1ac6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.883215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1025/2052] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:38 2022] PUT /identity/v3/projects/e730e555bf144aedb0355c7a68220d65/users/d728eef7edf04a8c82987e75f27203bd/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:38.892263 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-93cfdd56-4f83-43d4-bd84-8a4f0d1ac6ce None None] MFA Rules not processed for user `663530bbe3f54ba4b0ae961effd49b58`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.893544 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-93cfdd56-4f83-43d4-bd84-8a4f0d1ac6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:38.900464 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acca2dc-117d-4cbf-9854-c4c3d13fb9a3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:38.900951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acca2dc-117d-4cbf-9854-c4c3d13fb9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:38.901382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acca2dc-117d-4cbf-9854-c4c3d13fb9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:38.955449 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2acca2dc-117d-4cbf-9854-c4c3d13fb9a3 None None] MFA Rules not processed for user `d728eef7edf04a8c82987e75f27203bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:38.958814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2acca2dc-117d-4cbf-9854-c4c3d13fb9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:39.007974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1028/2053] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:39.019596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfdd56-4f83-43d4-bd84-8a4f0d1ac6ce None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.021256 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-93cfdd56-4f83-43d4-bd84-8a4f0d1ac6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:39.063381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:39.071044 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1026/2054] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:39.084067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acca2dc-117d-4cbf-9854-c4c3d13fb9a3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.085697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2acca2dc-117d-4cbf-9854-c4c3d13fb9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:39.117795 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfdd56-4f83-43d4-bd84-8a4f0d1ac6ce None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.122460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921e781-98b3-42ff-8834-f4a63f50c1f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.123117 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921e781-98b3-42ff-8834-f4a63f50c1f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.123406 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921e781-98b3-42ff-8834-f4a63f50c1f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.123687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921e781-98b3-42ff-8834-f4a63f50c1f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.135263 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921e781-98b3-42ff-8834-f4a63f50c1f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.137163 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921e781-98b3-42ff-8834-f4a63f50c1f6 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.147319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1029/2055] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:34:39.157912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acca2dc-117d-4cbf-9854-c4c3d13fb9a3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.161650 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666df84-a2c2-47c4-ab72-b6f569e5dad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.162302 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666df84-a2c2-47c4-ab72-b6f569e5dad4 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.162587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666df84-a2c2-47c4-ab72-b6f569e5dad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.163451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666df84-a2c2-47c4-ab72-b6f569e5dad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.174112 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666df84-a2c2-47c4-ab72-b6f569e5dad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.175564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666df84-a2c2-47c4-ab72-b6f569e5dad4 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.186507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1027/2056] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:34:39.228296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921e781-98b3-42ff-8834-f4a63f50c1f6 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:39.237422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921e781-98b3-42ff-8834-f4a63f50c1f6 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:39.242501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a8d33-b966-4f42-a1d3-49261d377a1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:39.243243 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a8d33-b966-4f42-a1d3-49261d377a1c service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:39.243537 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a8d33-b966-4f42-a1d3-49261d377a1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:39.243817 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a8d33-b966-4f42-a1d3-49261d377a1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:39.304524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a8d33-b966-4f42-a1d3-49261d377a1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:39.305947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a8d33-b966-4f42-a1d3-49261d377a1c service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:39.315418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1030/2057] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:42.182815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666df84-a2c2-47c4-ab72-b6f569e5dad4 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:42.184490 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5666df84-a2c2-47c4-ab72-b6f569e5dad4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:42.225303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:42.305687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666df84-a2c2-47c4-ab72-b6f569e5dad4 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:42.313956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:42.315446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.316256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.316549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] PATH_INFO: `/v3/users/0d9d7d88d10c475d8958482b5c5bb711` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.318342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9d7d88d10c475d8958482b5c5bb711)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:42.322215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:42.400483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9d7d88d10c475d8958482b5c5bb711'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:42.401240 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9d7d88d10c475d8958482b5c5bb711'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:42.401916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9d7d88d10c475d8958482b5c5bb711'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:42.426234 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9d7d88d10c475d8958482b5c5bb711'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:42.438887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9d7d88d10c475d8958482b5c5bb711'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:42.456627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1028/2058] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:42 2022] DELETE /identity/v3/users/0d9d7d88d10c475d8958482b5c5bb711 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:42.461931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933ba82-1026-48b3-87a1-c44731c01876 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.462635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933ba82-1026-48b3-87a1-c44731c01876 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.462635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933ba82-1026-48b3-87a1-c44731c01876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.481721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2933ba82-1026-48b3-87a1-c44731c01876 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:42.483028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2933ba82-1026-48b3-87a1-c44731c01876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:42.558837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1031/2059] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:42.570465 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:42.572528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:42.641254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86099433-777d-40da-b24e-e1495992b563 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:42.646253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d18942-c77e-4fb0-8a16-ad04516a4883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:42.646920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d18942-c77e-4fb0-8a16-ad04516a4883 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.647804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d18942-c77e-4fb0-8a16-ad04516a4883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.648089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d18942-c77e-4fb0-8a16-ad04516a4883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.662430 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d18942-c77e-4fb0-8a16-ad04516a4883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:42.664707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d18942-c77e-4fb0-8a16-ad04516a4883 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:42.681504 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1029/2060] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:42.954094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933ba82-1026-48b3-87a1-c44731c01876 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:42.955606 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2933ba82-1026-48b3-87a1-c44731c01876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:42.972633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933ba82-1026-48b3-87a1-c44731c01876 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:42.978055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c10c44-cde5-436b-b67a-3a2e67010fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:42.978922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c10c44-cde5-436b-b67a-3a2e67010fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:42.979201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c10c44-cde5-436b-b67a-3a2e67010fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:42.979470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c10c44-cde5-436b-b67a-3a2e67010fb5 admin admin] PATH_INFO: `/v3/projects/7bd9629b9d024ac7a08441c1c7a6c192` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:42.980690 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c10c44-cde5-436b-b67a-3a2e67010fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd9629b9d024ac7a08441c1c7a6c192)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:42.982649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c10c44-cde5-436b-b67a-3a2e67010fb5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:43.035313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-78c10c44-cde5-436b-b67a-3a2e67010fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd9629b9d024ac7a08441c1c7a6c192', 'request_id': 'req-78c10c44-cde5-436b-b67a-3a2e67010fb5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:43.038014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:43.043726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-78c10c44-cde5-436b-b67a-3a2e67010fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd9629b9d024ac7a08441c1c7a6c192', 'request_id': 'req-78c10c44-cde5-436b-b67a-3a2e67010fb5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:43.051588 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-78c10c44-cde5-436b-b67a-3a2e67010fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd9629b9d024ac7a08441c1c7a6c192', 'request_id': 'req-78c10c44-cde5-436b-b67a-3a2e67010fb5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:43.065427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-78c10c44-cde5-436b-b67a-3a2e67010fb5 admin admin] The token cache is being invalidate because project 7bd9629b9d024ac7a08441c1c7a6c192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:43.065717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-78c10c44-cde5-436b-b67a-3a2e67010fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:43.066360 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-78c10c44-cde5-436b-b67a-3a2e67010fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:43.067909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1032/2061] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:42 2022] DELETE /identity/v3/projects/7bd9629b9d024ac7a08441c1c7a6c192 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:43.073398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cee99-b387-4637-9638-b6866d349760 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.073689 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cee99-b387-4637-9638-b6866d349760 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.073966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cee99-b387-4637-9638-b6866d349760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.091672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-849cee99-b387-4637-9638-b6866d349760 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:43.092889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-849cee99-b387-4637-9638-b6866d349760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:43.125406 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:43.154974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1030/2062] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:43.163708 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ac9c4-d7d3-4079-9954-56053b7335c0 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.163995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ac9c4-d7d3-4079-9954-56053b7335c0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.164304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ac9c4-d7d3-4079-9954-56053b7335c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.183201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-193ac9c4-d7d3-4079-9954-56053b7335c0 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:43.184446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-193ac9c4-d7d3-4079-9954-56053b7335c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:43.192505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1033/2063] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:43.197318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cee99-b387-4637-9638-b6866d349760 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:43.206854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cee99-b387-4637-9638-b6866d349760 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:43.211630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f253f-df8b-48b6-8893-475b0961714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:43.212219 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f253f-df8b-48b6-8893-475b0961714a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.212501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f253f-df8b-48b6-8893-475b0961714a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.212809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f253f-df8b-48b6-8893-475b0961714a admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.213532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f253f-df8b-48b6-8893-475b0961714a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:43.213838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f253f-df8b-48b6-8893-475b0961714a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:43.215425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f253f-df8b-48b6-8893-475b0961714a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:43.226787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1031/2064] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:43.230903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ac9c4-d7d3-4079-9954-56053b7335c0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:43.240392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ac9c4-d7d3-4079-9954-56053b7335c0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:43.246073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ad38b-635c-4b6c-9949-bd83d788df70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:43.246788 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ad38b-635c-4b6c-9949-bd83d788df70 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.247312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ad38b-635c-4b6c-9949-bd83d788df70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.247390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ad38b-635c-4b6c-9949-bd83d788df70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.248060 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ad38b-635c-4b6c-9949-bd83d788df70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:43.250187 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ad38b-635c-4b6c-9949-bd83d788df70 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:43.282959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1034/2065] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:43 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:43.284307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f253f-df8b-48b6-8893-475b0961714a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:43.294919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f253f-df8b-48b6-8893-475b0961714a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:43.356169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b39f4b-6e07-48bf-9fe9-4af7df55928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:43.356870 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b39f4b-6e07-48bf-9fe9-4af7df55928a admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.357151 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b39f4b-6e07-48bf-9fe9-4af7df55928a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.357423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b39f4b-6e07-48bf-9fe9-4af7df55928a admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.358118 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b39f4b-6e07-48bf-9fe9-4af7df55928a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:43.360028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b39f4b-6e07-48bf-9fe9-4af7df55928a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:43.385262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1032/2066] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:43 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:43.386505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ad38b-635c-4b6c-9949-bd83d788df70 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:43.397819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ad38b-635c-4b6c-9949-bd83d788df70 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:43.403453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f41f6-c9dc-416f-a504-e3a1a2f2ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:43.404230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f41f6-c9dc-416f-a504-e3a1a2f2ab5d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.404541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f41f6-c9dc-416f-a504-e3a1a2f2ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.404929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f41f6-c9dc-416f-a504-e3a1a2f2ab5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.405714 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f41f6-c9dc-416f-a504-e3a1a2f2ab5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:43.407462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f41f6-c9dc-416f-a504-e3a1a2f2ab5d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:43.425032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1035/2067] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:43.426161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b39f4b-6e07-48bf-9fe9-4af7df55928a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:43.438687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b39f4b-6e07-48bf-9fe9-4af7df55928a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:43.443583 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5fee9-c23c-4d42-9413-a420b10aa68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:43.444354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5fee9-c23c-4d42-9413-a420b10aa68a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.444824 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5fee9-c23c-4d42-9413-a420b10aa68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.445325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5fee9-c23c-4d42-9413-a420b10aa68a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.446094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5fee9-c23c-4d42-9413-a420b10aa68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:43.447890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5fee9-c23c-4d42-9413-a420b10aa68a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:43.461557 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1033/2068] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:43.465931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f41f6-c9dc-416f-a504-e3a1a2f2ab5d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:43.477789 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f41f6-c9dc-416f-a504-e3a1a2f2ab5d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:43.483264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0fecb-b822-4247-823d-14efaa9c1d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:43.484210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0fecb-b822-4247-823d-14efaa9c1d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.484501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0fecb-b822-4247-823d-14efaa9c1d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.484852 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0fecb-b822-4247-823d-14efaa9c1d87 admin admin] PATH_INFO: `/v3/projects/783419b36f6d446ba0f1ff249bbaea5a/users/9ed76893bbb4445b9d1455254d7120c4/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.503735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0fecb-b822-4247-823d-14efaa9c1d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=783419b36f6d446ba0f1ff249bbaea5a, user_id=9ed76893bbb4445b9d1455254d7120c4, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:43.507018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0fecb-b822-4247-823d-14efaa9c1d87 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:43.536179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1036/2069] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:43 2022] PUT /identity/v3/projects/783419b36f6d446ba0f1ff249bbaea5a/users/9ed76893bbb4445b9d1455254d7120c4/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:43.543580 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffc983-01bc-4f30-ba0f-bdede999800d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.543877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffc983-01bc-4f30-ba0f-bdede999800d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.544152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffc983-01bc-4f30-ba0f-bdede999800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.571571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-caffc983-01bc-4f30-ba0f-bdede999800d None None] MFA Rules not processed for user `9ed76893bbb4445b9d1455254d7120c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:43.572817 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-caffc983-01bc-4f30-ba0f-bdede999800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:43.636963 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1034/2070] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:43.647878 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0fecb-b822-4247-823d-14efaa9c1d87 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:43.649670 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f2f0fecb-b822-4247-823d-14efaa9c1d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:43.734713 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0fecb-b822-4247-823d-14efaa9c1d87 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:43.738522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711672a-47e8-4128-b6b5-a63903807233 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:43.739178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711672a-47e8-4128-b6b5-a63903807233 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:43.739462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711672a-47e8-4128-b6b5-a63903807233 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:43.739768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711672a-47e8-4128-b6b5-a63903807233 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:43.750066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711672a-47e8-4128-b6b5-a63903807233 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:43.751523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711672a-47e8-4128-b6b5-a63903807233 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:43.761422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1037/2071] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:44.771063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffc983-01bc-4f30-ba0f-bdede999800d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:44.773969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-caffc983-01bc-4f30-ba0f-bdede999800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:44.827082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:44.869868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffc983-01bc-4f30-ba0f-bdede999800d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:44.874432 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f47d6-73c8-40f7-bcc3-5ec662f19201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:44.876387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f47d6-73c8-40f7-bcc3-5ec662f19201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:44.876387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f47d6-73c8-40f7-bcc3-5ec662f19201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:44.876387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f47d6-73c8-40f7-bcc3-5ec662f19201 admin admin] PATH_INFO: `/v3/users/ea7b55dc26694c58852050113033463f` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:44.877125 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f47d6-73c8-40f7-bcc3-5ec662f19201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7b55dc26694c58852050113033463f)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:44.879136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f47d6-73c8-40f7-bcc3-5ec662f19201 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:44.974108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d44f47d6-73c8-40f7-bcc3-5ec662f19201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7b55dc26694c58852050113033463f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:44.974853 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d44f47d6-73c8-40f7-bcc3-5ec662f19201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7b55dc26694c58852050113033463f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:44.976340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d44f47d6-73c8-40f7-bcc3-5ec662f19201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7b55dc26694c58852050113033463f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:44.991176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d44f47d6-73c8-40f7-bcc3-5ec662f19201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7b55dc26694c58852050113033463f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:44.999034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d44f47d6-73c8-40f7-bcc3-5ec662f19201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7b55dc26694c58852050113033463f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:45.016345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1035/2072] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:44 2022] DELETE /identity/v3/users/ea7b55dc26694c58852050113033463f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:45.021425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afff6d5-b1ca-4144-b777-60e409c428e5 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:45.022096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afff6d5-b1ca-4144-b777-60e409c428e5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:45.022403 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afff6d5-b1ca-4144-b777-60e409c428e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:45.042837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3afff6d5-b1ca-4144-b777-60e409c428e5 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:45.043830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3afff6d5-b1ca-4144-b777-60e409c428e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:45.105526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:45.122028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555dd7e-313e-448c-96b8-5248c664c88b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:45.122316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555dd7e-313e-448c-96b8-5248c664c88b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:45.122595 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555dd7e-313e-448c-96b8-5248c664c88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:45.123936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1038/2073] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:45.129733 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afff6d5-b1ca-4144-b777-60e409c428e5 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:45.131196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3afff6d5-b1ca-4144-b777-60e409c428e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:45.149094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4555dd7e-313e-448c-96b8-5248c664c88b None None] MFA Rules not processed for user `9ed76893bbb4445b9d1455254d7120c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:45.150313 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4555dd7e-313e-448c-96b8-5248c664c88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:45.219792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afff6d5-b1ca-4144-b777-60e409c428e5 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:45.224396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3abc5-2221-4020-a8b4-4aa835a85ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:45.225623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3abc5-2221-4020-a8b4-4aa835a85ddc service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:45.225911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3abc5-2221-4020-a8b4-4aa835a85ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:45.226773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3abc5-2221-4020-a8b4-4aa835a85ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:45.228864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1036/2074] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:45.237368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3abc5-2221-4020-a8b4-4aa835a85ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:45.239167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3abc5-2221-4020-a8b4-4aa835a85ddc service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:45.258837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1039/2075] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:45.735860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbafc6-3106-43e7-8b59-079f3901a7b5 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:45.736586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbafc6-3106-43e7-8b59-079f3901a7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:45.737114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbafc6-3106-43e7-8b59-079f3901a7b5 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:45.739871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1037/2076] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:34:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:34:45.750542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d9de-74a0-4bf9-aae9-31332e898a3f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:45.750966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d9de-74a0-4bf9-aae9-31332e898a3f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:45.751384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d9de-74a0-4bf9-aae9-31332e898a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:45.879010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbafc6-3106-43e7-8b59-079f3901a7b5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:45.884164 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-72cbafc6-3106-43e7-8b59-079f3901a7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:45.908265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6830d9de-74a0-4bf9-aae9-31332e898a3f None None] MFA Rules not processed for user `b39eb81eb6a64556a4079115d27f1624`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:45.910177 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6830d9de-74a0-4bf9-aae9-31332e898a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:45.913933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbafc6-3106-43e7-8b59-079f3901a7b5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:45.922191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d8908-f0b9-4c3c-ae54-04027006ded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:45.923480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d8908-f0b9-4c3c-ae54-04027006ded2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:45.924414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d8908-f0b9-4c3c-ae54-04027006ded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:45.925043 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d8908-f0b9-4c3c-ae54-04027006ded2 admin admin] PATH_INFO: `/v3/users/900271d533084386b3d7a3072c355e4c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:45.927021 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d8908-f0b9-4c3c-ae54-04027006ded2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900271d533084386b3d7a3072c355e4c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:45.930324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d8908-f0b9-4c3c-ae54-04027006ded2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:46.036524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4b2d8908-f0b9-4c3c-ae54-04027006ded2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900271d533084386b3d7a3072c355e4c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.038662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4b2d8908-f0b9-4c3c-ae54-04027006ded2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900271d533084386b3d7a3072c355e4c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.040876 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4b2d8908-f0b9-4c3c-ae54-04027006ded2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900271d533084386b3d7a3072c355e4c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.048140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:46.061957 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4b2d8908-f0b9-4c3c-ae54-04027006ded2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900271d533084386b3d7a3072c355e4c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.069212 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1040/2077] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:34:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:46.070713 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d9de-74a0-4bf9-aae9-31332e898a3f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:46.071024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4b2d8908-f0b9-4c3c-ae54-04027006ded2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900271d533084386b3d7a3072c355e4c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.077792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6830d9de-74a0-4bf9-aae9-31332e898a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:46.088123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1038/2078] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:45 2022] DELETE /identity/v3/users/900271d533084386b3d7a3072c355e4c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:46.090615 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99574906-53a5-43af-a0c9-fd3143c80d3b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:46.091348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99574906-53a5-43af-a0c9-fd3143c80d3b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:46.091822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99574906-53a5-43af-a0c9-fd3143c80d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:46.101847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d9de-74a0-4bf9-aae9-31332e898a3f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:46.117743 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-99574906-53a5-43af-a0c9-fd3143c80d3b None None] MFA Rules not processed for user `c30a4258c6024a7c9ef1fbd694fa9bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:46.119375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-99574906-53a5-43af-a0c9-fd3143c80d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:46.173727 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:46.184544 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:46.185513 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:46.185803 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:46.186133 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] PATH_INFO: `/v3/projects/d064ed68c25e472a919e3d5b1d489a54` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:46.187443 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d064ed68c25e472a919e3d5b1d489a54)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:46.189792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:46.210361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1039/2079] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:46.214825 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99574906-53a5-43af-a0c9-fd3143c80d3b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:46.217435 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-99574906-53a5-43af-a0c9-fd3143c80d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:46.270281 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd064ed68c25e472a919e3d5b1d489a54', 'request_id': 'req-694d9111-fd64-4ec9-9f0b-c5f55088abd7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.293899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd064ed68c25e472a919e3d5b1d489a54', 'request_id': 'req-694d9111-fd64-4ec9-9f0b-c5f55088abd7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.304349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd064ed68c25e472a919e3d5b1d489a54', 'request_id': 'req-694d9111-fd64-4ec9-9f0b-c5f55088abd7'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.333284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] The token cache is being invalidate because project d064ed68c25e472a919e3d5b1d489a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:46.334710 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.336246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.339447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1041/2080] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:46 2022] DELETE /identity/v3/projects/d064ed68c25e472a919e3d5b1d489a54 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:46.343690 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:46.346364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:46.364612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99574906-53a5-43af-a0c9-fd3143c80d3b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:46.433545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d9111-fd64-4ec9-9f0b-c5f55088abd7 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:46.448183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e7975-9a8c-4fd7-80df-323fc4871c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:46.448621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e7975-9a8c-4fd7-80df-323fc4871c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:46.448935 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e7975-9a8c-4fd7-80df-323fc4871c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:46.449211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e7975-9a8c-4fd7-80df-323fc4871c9d admin admin] PATH_INFO: `/v3/users/663530bbe3f54ba4b0ae961effd49b58` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:46.450699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e7975-9a8c-4fd7-80df-323fc4871c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=663530bbe3f54ba4b0ae961effd49b58)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:46.453780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e7975-9a8c-4fd7-80df-323fc4871c9d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:46.477566 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02eab5b-1ddb-48bd-b288-a77503897d04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:46.478351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02eab5b-1ddb-48bd-b288-a77503897d04 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:46.478826 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02eab5b-1ddb-48bd-b288-a77503897d04 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:46.479231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02eab5b-1ddb-48bd-b288-a77503897d04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:46.481567 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d02eab5b-1ddb-48bd-b288-a77503897d04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:46.494409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02eab5b-1ddb-48bd-b288-a77503897d04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:46.496597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02eab5b-1ddb-48bd-b288-a77503897d04 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:46.511524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1040/2081] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:46.527447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cc3e7975-9a8c-4fd7-80df-323fc4871c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663530bbe3f54ba4b0ae961effd49b58'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.528364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cc3e7975-9a8c-4fd7-80df-323fc4871c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663530bbe3f54ba4b0ae961effd49b58'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.529500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cc3e7975-9a8c-4fd7-80df-323fc4871c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663530bbe3f54ba4b0ae961effd49b58'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.546418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cc3e7975-9a8c-4fd7-80df-323fc4871c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663530bbe3f54ba4b0ae961effd49b58'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.555799 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cc3e7975-9a8c-4fd7-80df-323fc4871c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663530bbe3f54ba4b0ae961effd49b58'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.574893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1042/2082] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:46 2022] DELETE /identity/v3/users/663530bbe3f54ba4b0ae961effd49b58 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:46.618962 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02eab5b-1ddb-48bd-b288-a77503897d04 service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:46.620632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d02eab5b-1ddb-48bd-b288-a77503897d04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:46.643081 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02eab5b-1ddb-48bd-b288-a77503897d04 service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:46.648327 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:46.747464 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:46.748618 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:46.749064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:46.749446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] PATH_INFO: `/v3/projects/e7143cd05e47434a9e4babd66167f5ea` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:46.751052 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7143cd05e47434a9e4babd66167f5ea)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:46.753500 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:46.821684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7143cd05e47434a9e4babd66167f5ea', 'request_id': 'req-54c84d5d-6282-430d-8bf4-257dc49157ad'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.831382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7143cd05e47434a9e4babd66167f5ea', 'request_id': 'req-54c84d5d-6282-430d-8bf4-257dc49157ad'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.839429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7143cd05e47434a9e4babd66167f5ea', 'request_id': 'req-54c84d5d-6282-430d-8bf4-257dc49157ad'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.852335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] The token cache is being invalidate because project e7143cd05e47434a9e4babd66167f5ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:46.852620 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.853521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:46.855299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1041/2083] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:46 2022] DELETE /identity/v3/projects/e7143cd05e47434a9e4babd66167f5ea => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:46.860028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c300c0-aa57-4cbe-b510-3436a0adf7e0 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:46.860297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c300c0-aa57-4cbe-b510-3436a0adf7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:46.860575 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c300c0-aa57-4cbe-b510-3436a0adf7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:46.874535 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:46.889042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e0c300c0-aa57-4cbe-b510-3436a0adf7e0 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:46.890301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e0c300c0-aa57-4cbe-b510-3436a0adf7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:46.933766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:46.935993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:46.992879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1043/2084] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:46.998987 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285a223-b9f9-4c83-9130-154ee9bde34e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:46.999475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285a223-b9f9-4c83-9130-154ee9bde34e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:46.999974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285a223-b9f9-4c83-9130-154ee9bde34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.032127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a285a223-b9f9-4c83-9130-154ee9bde34e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:47.034164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a285a223-b9f9-4c83-9130-154ee9bde34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:47.093325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1044/2085] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:47.096998 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285a223-b9f9-4c83-9130-154ee9bde34e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.102781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c84d5d-6282-430d-8bf4-257dc49157ad admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.110664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285a223-b9f9-4c83-9130-154ee9bde34e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.112193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a456689-4b29-4fb4-ad5b-195cf4083fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.124176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5d38c-1bb8-4689-9508-3e11cc344c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.125020 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5d38c-1bb8-4689-9508-3e11cc344c04 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.125407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5d38c-1bb8-4689-9508-3e11cc344c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.125810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5d38c-1bb8-4689-9508-3e11cc344c04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.126682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5d38c-1bb8-4689-9508-3e11cc344c04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:47.126906 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a456689-4b29-4fb4-ad5b-195cf4083fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.127207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a456689-4b29-4fb4-ad5b-195cf4083fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.127332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5d38c-1bb8-4689-9508-3e11cc344c04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.127520 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a456689-4b29-4fb4-ad5b-195cf4083fd3 admin admin] PATH_INFO: `/v3/projects/97d4e6d51a0a49a6984eedc06e9063fc` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.129366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5d38c-1bb8-4689-9508-3e11cc344c04 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.136442 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a456689-4b29-4fb4-ad5b-195cf4083fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d4e6d51a0a49a6984eedc06e9063fc)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.139524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a456689-4b29-4fb4-ad5b-195cf4083fd3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.145054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1045/2086] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:34:47.151176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5d38c-1bb8-4689-9508-3e11cc344c04 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.184388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5d38c-1bb8-4689-9508-3e11cc344c04 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.199721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230b0ea-7723-43af-a8a9-f66d5887b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.201382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b0ea-7723-43af-a8a9-f66d5887b747 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.201925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b0ea-7723-43af-a8a9-f66d5887b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.203015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b0ea-7723-43af-a8a9-f66d5887b747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.207780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230b0ea-7723-43af-a8a9-f66d5887b747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.210794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230b0ea-7723-43af-a8a9-f66d5887b747 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.222041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:47.239291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8a456689-4b29-4fb4-ad5b-195cf4083fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d4e6d51a0a49a6984eedc06e9063fc', 'request_id': 'req-8a456689-4b29-4fb4-ad5b-195cf4083fd3'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.258456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8a456689-4b29-4fb4-ad5b-195cf4083fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d4e6d51a0a49a6984eedc06e9063fc', 'request_id': 'req-8a456689-4b29-4fb4-ad5b-195cf4083fd3'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.274220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8a456689-4b29-4fb4-ad5b-195cf4083fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d4e6d51a0a49a6984eedc06e9063fc', 'request_id': 'req-8a456689-4b29-4fb4-ad5b-195cf4083fd3'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.274406 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1046/2087] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:47 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:47.279424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230b0ea-7723-43af-a8a9-f66d5887b747 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.301819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8a456689-4b29-4fb4-ad5b-195cf4083fd3 admin admin] The token cache is being invalidate because project 97d4e6d51a0a49a6984eedc06e9063fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:47.302195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8a456689-4b29-4fb4-ad5b-195cf4083fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.302880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8a456689-4b29-4fb4-ad5b-195cf4083fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:47.310608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1042/2088] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:46 2022] DELETE /identity/v3/projects/97d4e6d51a0a49a6984eedc06e9063fc => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:47.313058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592edc61-b477-4d10-a63a-8da2c05019b2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.313353 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592edc61-b477-4d10-a63a-8da2c05019b2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.313678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592edc61-b477-4d10-a63a-8da2c05019b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.337453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-592edc61-b477-4d10-a63a-8da2c05019b2 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:47.338684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-592edc61-b477-4d10-a63a-8da2c05019b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:47.401924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230b0ea-7723-43af-a8a9-f66d5887b747 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.408814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab6e19-17e5-4011-9ecf-7b2788ee5f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.409730 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab6e19-17e5-4011-9ecf-7b2788ee5f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.410094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab6e19-17e5-4011-9ecf-7b2788ee5f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.410376 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab6e19-17e5-4011-9ecf-7b2788ee5f3a admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.411102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab6e19-17e5-4011-9ecf-7b2788ee5f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.414367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab6e19-17e5-4011-9ecf-7b2788ee5f3a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.434054 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1043/2089] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:47.442484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c87c42-c16f-4230-a243-3b6a50034ef6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.442895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c87c42-c16f-4230-a243-3b6a50034ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.443555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c87c42-c16f-4230-a243-3b6a50034ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.444939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1047/2090] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:47 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:47.448497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab6e19-17e5-4011-9ecf-7b2788ee5f3a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.451434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-72ab6e19-17e5-4011-9ecf-7b2788ee5f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:47.470148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-85c87c42-c16f-4230-a243-3b6a50034ef6 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:47.471628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-85c87c42-c16f-4230-a243-3b6a50034ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:47.475948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab6e19-17e5-4011-9ecf-7b2788ee5f3a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.486898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4031d-30b9-41f5-9e63-ec4e7de623d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.487483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1044/2091] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:47.487660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4031d-30b9-41f5-9e63-ec4e7de623d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.487967 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4031d-30b9-41f5-9e63-ec4e7de623d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.488234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4031d-30b9-41f5-9e63-ec4e7de623d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.489185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4031d-30b9-41f5-9e63-ec4e7de623d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.489649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c87c42-c16f-4230-a243-3b6a50034ef6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.491229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4031d-30b9-41f5-9e63-ec4e7de623d9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.504545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c87c42-c16f-4230-a243-3b6a50034ef6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.513251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955d5b3-2746-481b-8330-2c9a983c7667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.513935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955d5b3-2746-481b-8330-2c9a983c7667 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.514326 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955d5b3-2746-481b-8330-2c9a983c7667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.515340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955d5b3-2746-481b-8330-2c9a983c7667 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.517026 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955d5b3-2746-481b-8330-2c9a983c7667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:47.517486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955d5b3-2746-481b-8330-2c9a983c7667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.519826 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955d5b3-2746-481b-8330-2c9a983c7667 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.525767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1048/2092] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:47.526969 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4031d-30b9-41f5-9e63-ec4e7de623d9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.548192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1045/2093] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:47.549493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955d5b3-2746-481b-8330-2c9a983c7667 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.552423 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4031d-30b9-41f5-9e63-ec4e7de623d9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.573509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955d5b3-2746-481b-8330-2c9a983c7667 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.575362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869aa5e7-4cb9-497b-a5fd-57ba65163e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.575941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aa5e7-4cb9-497b-a5fd-57ba65163e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.576258 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aa5e7-4cb9-497b-a5fd-57ba65163e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.576542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869aa5e7-4cb9-497b-a5fd-57ba65163e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.577336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869aa5e7-4cb9-497b-a5fd-57ba65163e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.578937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869aa5e7-4cb9-497b-a5fd-57ba65163e6c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.600235 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1049/2094] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:47.601522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5eda30-a442-4743-9e1d-ae31405ff993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.602332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869aa5e7-4cb9-497b-a5fd-57ba65163e6c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.602955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5eda30-a442-4743-9e1d-ae31405ff993 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.603253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5eda30-a442-4743-9e1d-ae31405ff993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.603537 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5eda30-a442-4743-9e1d-ae31405ff993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.605564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5eda30-a442-4743-9e1d-ae31405ff993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.608633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5eda30-a442-4743-9e1d-ae31405ff993 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.616492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869aa5e7-4cb9-497b-a5fd-57ba65163e6c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.623097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bd775-3e6a-459f-b5c7-f1277af402ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.624144 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bd775-3e6a-459f-b5c7-f1277af402ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.624503 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bd775-3e6a-459f-b5c7-f1277af402ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.625042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bd775-3e6a-459f-b5c7-f1277af402ac admin admin] PATH_INFO: `/v3/projects/079362a77e344c61af67f7b256545329/users/1156b006d6e1426a84a521d397491135/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.649746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bd775-3e6a-459f-b5c7-f1277af402ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=079362a77e344c61af67f7b256545329, user_id=1156b006d6e1426a84a521d397491135, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.653579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bd775-3e6a-459f-b5c7-f1277af402ac admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.690034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1046/2095] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:47 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:47.690866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1050/2096] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:47 2022] PUT /identity/v3/projects/079362a77e344c61af67f7b256545329/users/1156b006d6e1426a84a521d397491135/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:47.692948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5eda30-a442-4743-9e1d-ae31405ff993 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.695818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b83bfe-894d-477a-90a6-f2141bdba27e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.696119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b83bfe-894d-477a-90a6-f2141bdba27e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.696409 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b83bfe-894d-477a-90a6-f2141bdba27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.721172 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-54b83bfe-894d-477a-90a6-f2141bdba27e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:47.722957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-54b83bfe-894d-477a-90a6-f2141bdba27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:47.729090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:47.798052 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5eda30-a442-4743-9e1d-ae31405ff993 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.803189 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895cf04-866d-410b-9a02-fbf27a89b72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.803868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895cf04-866d-410b-9a02-fbf27a89b72b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.804150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895cf04-866d-410b-9a02-fbf27a89b72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.804641 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895cf04-866d-410b-9a02-fbf27a89b72b admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.804772 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1051/2097] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:47.805149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895cf04-866d-410b-9a02-fbf27a89b72b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.807086 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895cf04-866d-410b-9a02-fbf27a89b72b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.820541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b83bfe-894d-477a-90a6-f2141bdba27e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.823480 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-54b83bfe-894d-477a-90a6-f2141bdba27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:47.844755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1047/2098] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:47 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:47.847618 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895cf04-866d-410b-9a02-fbf27a89b72b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.859115 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895cf04-866d-410b-9a02-fbf27a89b72b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.864018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a49dd-2169-43e0-b13d-681493c26428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.865053 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a49dd-2169-43e0-b13d-681493c26428 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.865053 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a49dd-2169-43e0-b13d-681493c26428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.865351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a49dd-2169-43e0-b13d-681493c26428 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.866124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a49dd-2169-43e0-b13d-681493c26428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.868759 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a49dd-2169-43e0-b13d-681493c26428 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.892599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1048/2099] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:34:47.896199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a49dd-2169-43e0-b13d-681493c26428 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.906345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:47.912146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a49dd-2169-43e0-b13d-681493c26428 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.920531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be32b3-965a-4319-b56c-57a876e4b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.921376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be32b3-965a-4319-b56c-57a876e4b331 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.921774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be32b3-965a-4319-b56c-57a876e4b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.922155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be32b3-965a-4319-b56c-57a876e4b331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.923137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be32b3-965a-4319-b56c-57a876e4b331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.925148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be32b3-965a-4319-b56c-57a876e4b331 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.936209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b83bfe-894d-477a-90a6-f2141bdba27e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.938995 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1049/2100] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:47.942795 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be32b3-965a-4319-b56c-57a876e4b331 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:47.956529 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49842a2f-aba8-4bb1-9594-6bafe4c71d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.957528 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49842a2f-aba8-4bb1-9594-6bafe4c71d36 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.958929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49842a2f-aba8-4bb1-9594-6bafe4c71d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.959138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be32b3-965a-4319-b56c-57a876e4b331 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:47.960761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49842a2f-aba8-4bb1-9594-6bafe4c71d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.964423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9873f7-71f5-434d-85e2-8253d7d02a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:47.965456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9873f7-71f5-434d-85e2-8253d7d02a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:47.965809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9873f7-71f5-434d-85e2-8253d7d02a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:47.966804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9873f7-71f5-434d-85e2-8253d7d02a57 admin admin] PATH_INFO: `/v3/projects/d83c3a3e84f9442db7be4d8edf97dace/users/98a82fcaad864b199ef582619e071f85/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:47.976974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49842a2f-aba8-4bb1-9594-6bafe4c71d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.978516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49842a2f-aba8-4bb1-9594-6bafe4c71d36 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.983473 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9873f7-71f5-434d-85e2-8253d7d02a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83c3a3e84f9442db7be4d8edf97dace, user_id=98a82fcaad864b199ef582619e071f85, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:47.986346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9873f7-71f5-434d-85e2-8253d7d02a57 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:47.990666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1052/2101] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:48.003678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1050/2102] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:47 2022] PUT /identity/v3/projects/d83c3a3e84f9442db7be4d8edf97dace/users/98a82fcaad864b199ef582619e071f85/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:48.016601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84364753-b19e-482f-ae5a-d6a5436baadd None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:48.017637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84364753-b19e-482f-ae5a-d6a5436baadd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:48.017637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84364753-b19e-482f-ae5a-d6a5436baadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:48.081577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-84364753-b19e-482f-ae5a-d6a5436baadd None None] MFA Rules not processed for user `98a82fcaad864b199ef582619e071f85`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:48.082873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-84364753-b19e-482f-ae5a-d6a5436baadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:48.167338 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1053/2103] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:48.172110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9873f7-71f5-434d-85e2-8253d7d02a57 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:48.288884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9873f7-71f5-434d-85e2-8253d7d02a57 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:48.294470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e987da-b8f1-4631-b286-2747c0105fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:48.295221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e987da-b8f1-4631-b286-2747c0105fde admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:48.295746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e987da-b8f1-4631-b286-2747c0105fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:48.296035 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e987da-b8f1-4631-b286-2747c0105fde admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:48.296954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e987da-b8f1-4631-b286-2747c0105fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:48.299009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e987da-b8f1-4631-b286-2747c0105fde admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:48.333796 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1051/2104] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:48 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:48.335499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84364753-b19e-482f-ae5a-d6a5436baadd None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:48.347715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84364753-b19e-482f-ae5a-d6a5436baadd None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:48.393849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:48.416272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65901a28-db4e-4412-ba4a-012a41439ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:48.417364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901a28-db4e-4412-ba4a-012a41439ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:48.417803 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901a28-db4e-4412-ba4a-012a41439ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:48.418261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901a28-db4e-4412-ba4a-012a41439ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:48.419147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65901a28-db4e-4412-ba4a-012a41439ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:48.421313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65901a28-db4e-4412-ba4a-012a41439ca5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:48.447597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1054/2105] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:48 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:34:48.451304 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e987da-b8f1-4631-b286-2747c0105fde admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:48.474478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e987da-b8f1-4631-b286-2747c0105fde admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:48.499322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3032d-a1f2-4800-afee-d0646bbb3ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:48.500134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3032d-a1f2-4800-afee-d0646bbb3ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:48.500515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3032d-a1f2-4800-afee-d0646bbb3ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:48.501034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3032d-a1f2-4800-afee-d0646bbb3ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:48.501977 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3032d-a1f2-4800-afee-d0646bbb3ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:48.507523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3032d-a1f2-4800-afee-d0646bbb3ffe admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:48.524918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1052/2106] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:48.529071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65901a28-db4e-4412-ba4a-012a41439ca5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:48.540972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65901a28-db4e-4412-ba4a-012a41439ca5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:48.548087 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf3805-c54a-4139-8610-6070dea6e934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:48.549078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf3805-c54a-4139-8610-6070dea6e934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:48.549377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf3805-c54a-4139-8610-6070dea6e934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:48.549732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf3805-c54a-4139-8610-6070dea6e934 admin admin] PATH_INFO: `/v3/projects/e8e30835dea34ad1a3c5e5adf201cdba/users/08f2243e87e14462a632a14d6e268b76/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:48.569293 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf3805-c54a-4139-8610-6070dea6e934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e30835dea34ad1a3c5e5adf201cdba, user_id=08f2243e87e14462a632a14d6e268b76, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:48.572181 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf3805-c54a-4139-8610-6070dea6e934 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:48.596361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1055/2107] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:48 2022] PUT /identity/v3/projects/e8e30835dea34ad1a3c5e5adf201cdba/users/08f2243e87e14462a632a14d6e268b76/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:34:48.598117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3032d-a1f2-4800-afee-d0646bbb3ffe admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:48.611966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3032d-a1f2-4800-afee-d0646bbb3ffe admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:48.702054 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5d0c0-8147-4d22-bb29-04a2a51a3f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:48.702976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d0c0-8147-4d22-bb29-04a2a51a3f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:48.703525 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d0c0-8147-4d22-bb29-04a2a51a3f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:48.703930 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d0c0-8147-4d22-bb29-04a2a51a3f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:48.704832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5d0c0-8147-4d22-bb29-04a2a51a3f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:48.707335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5d0c0-8147-4d22-bb29-04a2a51a3f2c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:48.737364 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1053/2108] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:48.741855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf3805-c54a-4139-8610-6070dea6e934 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:48.761057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf3805-c54a-4139-8610-6070dea6e934 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:48.771266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f0458-97fe-4232-9f91-6e5d3465fd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:48.772424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f0458-97fe-4232-9f91-6e5d3465fd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:48.773194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f0458-97fe-4232-9f91-6e5d3465fd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:48.773876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f0458-97fe-4232-9f91-6e5d3465fd0e admin admin] PATH_INFO: `/v3/projects/e8e30835dea34ad1a3c5e5adf201cdba/users/08f2243e87e14462a632a14d6e268b76/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:48.776248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f0458-97fe-4232-9f91-6e5d3465fd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e30835dea34ad1a3c5e5adf201cdba, user_id=08f2243e87e14462a632a14d6e268b76, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:48.780112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f0458-97fe-4232-9f91-6e5d3465fd0e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:48.797120 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1056/2109] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:48 2022] PUT /identity/v3/projects/e8e30835dea34ad1a3c5e5adf201cdba/users/08f2243e87e14462a632a14d6e268b76/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:48.806140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1df0e1-a9a0-4a3d-9ccc-c136528b26ad None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:48.806439 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1df0e1-a9a0-4a3d-9ccc-c136528b26ad None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:48.806726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1df0e1-a9a0-4a3d-9ccc-c136528b26ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:48.840873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9a1df0e1-a9a0-4a3d-9ccc-c136528b26ad None None] MFA Rules not processed for user `08f2243e87e14462a632a14d6e268b76`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:48.842291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9a1df0e1-a9a0-4a3d-9ccc-c136528b26ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:48.875861 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:48.931067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1054/2110] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:48.941807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f0458-97fe-4232-9f91-6e5d3465fd0e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:48.943787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f62f0458-97fe-4232-9f91-6e5d3465fd0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:49.006452 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f0458-97fe-4232-9f91-6e5d3465fd0e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:49.010249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8af055-bbab-4019-a724-41665c3509f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:49.010902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8af055-bbab-4019-a724-41665c3509f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:49.011188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8af055-bbab-4019-a724-41665c3509f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:49.011467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8af055-bbab-4019-a724-41665c3509f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:49.021590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8af055-bbab-4019-a724-41665c3509f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:49.023910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8af055-bbab-4019-a724-41665c3509f8 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:49.037354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1057/2111] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:49.173093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1df0e1-a9a0-4a3d-9ccc-c136528b26ad None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:49.254908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1df0e1-a9a0-4a3d-9ccc-c136528b26ad None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:49.260742 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:49.261904 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:49.262190 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:49.262467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] PATH_INFO: `/v3/users/98a82fcaad864b199ef582619e071f85` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:49.263686 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a82fcaad864b199ef582619e071f85)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:49.265647 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:49.315839 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a82fcaad864b199ef582619e071f85'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:49.316768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a82fcaad864b199ef582619e071f85'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:49.317411 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a82fcaad864b199ef582619e071f85'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:49.331494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a82fcaad864b199ef582619e071f85'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:49.339418 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a82fcaad864b199ef582619e071f85'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:49.354065 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1055/2112] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:49 2022] DELETE /identity/v3/users/98a82fcaad864b199ef582619e071f85 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:49.358534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616c057-c523-488d-a3bd-560fca53d309 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:49.359038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616c057-c523-488d-a3bd-560fca53d309 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:49.359130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616c057-c523-488d-a3bd-560fca53d309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:49.378333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7616c057-c523-488d-a3bd-560fca53d309 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:49.379576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7616c057-c523-488d-a3bd-560fca53d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:49.445686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1058/2113] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:34:49.456110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:49.457717 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:49.509794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:49.523721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e47436-9569-4626-8a64-002cd9b91321 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:49.527923 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd89a9-0b09-4fb5-8f05-0cc5549128d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:49.528590 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd89a9-0b09-4fb5-8f05-0cc5549128d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:49.528918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd89a9-0b09-4fb5-8f05-0cc5549128d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:49.529201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd89a9-0b09-4fb5-8f05-0cc5549128d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:49.539679 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd89a9-0b09-4fb5-8f05-0cc5549128d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:49.541232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd89a9-0b09-4fb5-8f05-0cc5549128d1 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:49.551700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1056/2114] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:49.984538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616c057-c523-488d-a3bd-560fca53d309 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:49.986511 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7616c057-c523-488d-a3bd-560fca53d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:50.009936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616c057-c523-488d-a3bd-560fca53d309 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:50.019573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:50.020790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:50.021086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:50.021368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] PATH_INFO: `/v3/projects/d83c3a3e84f9442db7be4d8edf97dace` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:50.023543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83c3a3e84f9442db7be4d8edf97dace)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:50.025998 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:50.083017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:50.109800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83c3a3e84f9442db7be4d8edf97dace', 'request_id': 'req-73db9387-d2bc-4dbb-a999-84abc119eec9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.124786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83c3a3e84f9442db7be4d8edf97dace', 'request_id': 'req-73db9387-d2bc-4dbb-a999-84abc119eec9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.136998 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83c3a3e84f9442db7be4d8edf97dace', 'request_id': 'req-73db9387-d2bc-4dbb-a999-84abc119eec9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.155677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] The token cache is being invalidate because project d83c3a3e84f9442db7be4d8edf97dace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:50.156844 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.157981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.165297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1059/2115] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:49 2022] DELETE /identity/v3/projects/d83c3a3e84f9442db7be4d8edf97dace => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:50.165894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd89a9-0b09-4fb5-8f05-0cc5549128d1 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:50.184322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd89a9-0b09-4fb5-8f05-0cc5549128d1 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:50.300359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693d6bd-5449-476a-ab78-aae23af0ac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:50.301636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693d6bd-5449-476a-ab78-aae23af0ac24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:50.302055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693d6bd-5449-476a-ab78-aae23af0ac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:50.302402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693d6bd-5449-476a-ab78-aae23af0ac24 admin admin] PATH_INFO: `/v3/users/08f2243e87e14462a632a14d6e268b76` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:50.303987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693d6bd-5449-476a-ab78-aae23af0ac24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08f2243e87e14462a632a14d6e268b76)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:50.306243 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693d6bd-5449-476a-ab78-aae23af0ac24 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:50.426964 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4693d6bd-5449-476a-ab78-aae23af0ac24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08f2243e87e14462a632a14d6e268b76'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.428149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4693d6bd-5449-476a-ab78-aae23af0ac24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08f2243e87e14462a632a14d6e268b76'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.429459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4693d6bd-5449-476a-ab78-aae23af0ac24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08f2243e87e14462a632a14d6e268b76'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.451837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4693d6bd-5449-476a-ab78-aae23af0ac24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08f2243e87e14462a632a14d6e268b76'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.465506 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4693d6bd-5449-476a-ab78-aae23af0ac24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08f2243e87e14462a632a14d6e268b76'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:50.494088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1057/2116] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:34:50 2022] DELETE /identity/v3/users/08f2243e87e14462a632a14d6e268b76 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:51.211662 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:51.213838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:51.234193 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db9387-d2bc-4dbb-a999-84abc119eec9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:51.428376 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:51.431357 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:51.431659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:51.431945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c admin admin] PATH_INFO: `/v3/projects/e8e30835dea34ad1a3c5e5adf201cdba` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:51.433380 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e30835dea34ad1a3c5e5adf201cdba)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:51.435463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:51.525261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e30835dea34ad1a3c5e5adf201cdba', 'request_id': 'req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:51.535089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e30835dea34ad1a3c5e5adf201cdba', 'request_id': 'req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:51.546201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e30835dea34ad1a3c5e5adf201cdba', 'request_id': 'req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:51.557958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c admin admin] The token cache is being invalidate because project e8e30835dea34ad1a3c5e5adf201cdba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:34:51.558257 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:51.559074 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2b4ed417-b6d3-4f11-802c-8f7d22daed6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:34:51.560963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1060/2117] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:34:51 2022] DELETE /identity/v3/projects/e8e30835dea34ad1a3c5e5adf201cdba => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:34:51.565847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28850864-5d80-4b00-88ad-28b3b7f98437 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:51.566655 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28850864-5d80-4b00-88ad-28b3b7f98437 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:51.567131 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28850864-5d80-4b00-88ad-28b3b7f98437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:51.590341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-28850864-5d80-4b00-88ad-28b3b7f98437 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:51.591582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-28850864-5d80-4b00-88ad-28b3b7f98437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:51.689151 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1058/2118] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:51.697817 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384767-c9e6-48ec-b232-dfab19177839 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:51.698114 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384767-c9e6-48ec-b232-dfab19177839 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:51.698398 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f384767-c9e6-48ec-b232-dfab19177839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:51.719955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8f384767-c9e6-48ec-b232-dfab19177839 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:51.721598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8f384767-c9e6-48ec-b232-dfab19177839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:51.730614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1061/2119] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:51.735123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28850864-5d80-4b00-88ad-28b3b7f98437 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:51.745542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28850864-5d80-4b00-88ad-28b3b7f98437 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:51.750630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333468b-7437-4b3a-a1e8-32e4aa939442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:51.751298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333468b-7437-4b3a-a1e8-32e4aa939442 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:51.751586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333468b-7437-4b3a-a1e8-32e4aa939442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:51.751961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333468b-7437-4b3a-a1e8-32e4aa939442 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:51.752662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333468b-7437-4b3a-a1e8-32e4aa939442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:34:51.753018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333468b-7437-4b3a-a1e8-32e4aa939442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:51.754638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333468b-7437-4b3a-a1e8-32e4aa939442 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:51.757480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:51.775987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1059/2120] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:34:51.776927 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f384767-c9e6-48ec-b232-dfab19177839 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:51.794821 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f384767-c9e6-48ec-b232-dfab19177839 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:51.801094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd9ef1-d9db-41c5-93d3-b4bc5e59ebf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:51.802460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9ef1-d9db-41c5-93d3-b4bc5e59ebf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:51.804405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9ef1-d9db-41c5-93d3-b4bc5e59ebf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:51.804405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd9ef1-d9db-41c5-93d3-b4bc5e59ebf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:51.805205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd9ef1-d9db-41c5-93d3-b4bc5e59ebf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:51.807246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd9ef1-d9db-41c5-93d3-b4bc5e59ebf9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:51.840579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1062/2121] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:34:51 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:51.845163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333468b-7437-4b3a-a1e8-32e4aa939442 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:51.869071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333468b-7437-4b3a-a1e8-32e4aa939442 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:51.970078 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10010567-d4f7-408c-9fc9-a03a4f994711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:51.970925 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10010567-d4f7-408c-9fc9-a03a4f994711 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:51.971217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10010567-d4f7-408c-9fc9-a03a4f994711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:51.971657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10010567-d4f7-408c-9fc9-a03a4f994711 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:51.972401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10010567-d4f7-408c-9fc9-a03a4f994711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:51.975609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10010567-d4f7-408c-9fc9-a03a4f994711 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:52.007248 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1060/2122] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:34:51 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:34:52.008551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd9ef1-d9db-41c5-93d3-b4bc5e59ebf9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:52.029432 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd9ef1-d9db-41c5-93d3-b4bc5e59ebf9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:52.036419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88153c-bc5e-4de4-a50c-5e7fa341641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:52.038199 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88153c-bc5e-4de4-a50c-5e7fa341641c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:52.038547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88153c-bc5e-4de4-a50c-5e7fa341641c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:52.038823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88153c-bc5e-4de4-a50c-5e7fa341641c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:52.039609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88153c-bc5e-4de4-a50c-5e7fa341641c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:52.041353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88153c-bc5e-4de4-a50c-5e7fa341641c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:52.068054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1063/2123] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:52.069587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10010567-d4f7-408c-9fc9-a03a4f994711 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:52.082121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10010567-d4f7-408c-9fc9-a03a4f994711 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:52.094356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90339ce4-5b09-4d54-b7fd-f5fe63923de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:52.094969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90339ce4-5b09-4d54-b7fd-f5fe63923de2 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:52.095255 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90339ce4-5b09-4d54-b7fd-f5fe63923de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:52.095534 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90339ce4-5b09-4d54-b7fd-f5fe63923de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:52.096448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90339ce4-5b09-4d54-b7fd-f5fe63923de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:52.098149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90339ce4-5b09-4d54-b7fd-f5fe63923de2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:52.115207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1061/2124] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:34:52.116910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88153c-bc5e-4de4-a50c-5e7fa341641c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:52.130256 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88153c-bc5e-4de4-a50c-5e7fa341641c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:52.137390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6235c-e8f3-4537-b73f-487c3ac47911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:52.138461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6235c-e8f3-4537-b73f-487c3ac47911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:52.139269 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6235c-e8f3-4537-b73f-487c3ac47911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:52.139660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6235c-e8f3-4537-b73f-487c3ac47911 admin admin] PATH_INFO: `/v3/projects/acb513d0eaef4923892754c6a5fb3c97/users/5bd3d7b9711144769ab0551abf4f440b/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:52.152087 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:52.171602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6235c-e8f3-4537-b73f-487c3ac47911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acb513d0eaef4923892754c6a5fb3c97, user_id=5bd3d7b9711144769ab0551abf4f440b, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:52.176091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6235c-e8f3-4537-b73f-487c3ac47911 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:52.194414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1064/2125] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:34:52 2022] PUT /identity/v3/projects/acb513d0eaef4923892754c6a5fb3c97/users/5bd3d7b9711144769ab0551abf4f440b/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:34:52.204805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3586d-ef77-472f-b742-029926fcbc7f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:52.205046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3586d-ef77-472f-b742-029926fcbc7f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:52.205336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3586d-ef77-472f-b742-029926fcbc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:52.242229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-81a3586d-ef77-472f-b742-029926fcbc7f None None] MFA Rules not processed for user `5bd3d7b9711144769ab0551abf4f440b`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:52.243544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-81a3586d-ef77-472f-b742-029926fcbc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:52.397949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1062/2126] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:52.408135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6235c-e8f3-4537-b73f-487c3ac47911 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:52.410531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-65e6235c-e8f3-4537-b73f-487c3ac47911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:52.496251 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6235c-e8f3-4537-b73f-487c3ac47911 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:52.501168 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e18711-1975-42b1-b8b0-2ccab52e2b31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e854100c04be43c78bce1f95ff85bfc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:52.501991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e18711-1975-42b1-b8b0-2ccab52e2b31 service glance] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:52.502412 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e18711-1975-42b1-b8b0-2ccab52e2b31 service glance] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:52.502835 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e18711-1975-42b1-b8b0-2ccab52e2b31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:52.516121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e18711-1975-42b1-b8b0-2ccab52e2b31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:52.518624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e18711-1975-42b1-b8b0-2ccab52e2b31 service glance] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:52.533414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1065/2127] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:54.421196 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f98ca4-c8c7-49fa-8ffb-09f4a687012b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:54.421694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f98ca4-c8c7-49fa-8ffb-09f4a687012b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:54.421949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f98ca4-c8c7-49fa-8ffb-09f4a687012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:54.479264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-82f98ca4-c8c7-49fa-8ffb-09f4a687012b None None] MFA Rules not processed for user `1156b006d6e1426a84a521d397491135`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:54.480557 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-82f98ca4-c8c7-49fa-8ffb-09f4a687012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:54.566270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:34:54.598387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1063/2128] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:34:54.605655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e18711-1975-42b1-b8b0-2ccab52e2b31 service glance] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:34:54.607109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-87e18711-1975-42b1-b8b0-2ccab52e2b31 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:54.783745 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e18711-1975-42b1-b8b0-2ccab52e2b31 service glance] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:34:54.790769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1afe1-09d8-4ea0-afa2-90b62d42d1fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:34:54.791448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1afe1-09d8-4ea0-afa2-90b62d42d1fd service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:54.791804 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1afe1-09d8-4ea0-afa2-90b62d42d1fd service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:54.792183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1afe1-09d8-4ea0-afa2-90b62d42d1fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:54.802516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1afe1-09d8-4ea0-afa2-90b62d42d1fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:34:54.804193 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1afe1-09d8-4ea0-afa2-90b62d42d1fd service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:34:54.814381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1066/2129] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:34:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:34:56.357179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388ffce-519b-48c3-bbdf-2e70e0eab3ec None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:34:56.357803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388ffce-519b-48c3-bbdf-2e70e0eab3ec None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:34:56.361205 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388ffce-519b-48c3-bbdf-2e70e0eab3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:34:56.392267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9388ffce-519b-48c3-bbdf-2e70e0eab3ec None None] MFA Rules not processed for user `1156b006d6e1426a84a521d397491135`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:34:56.395692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9388ffce-519b-48c3-bbdf-2e70e0eab3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:34:56.407845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1064/2130] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:34:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:04.809592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:06.383815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:25.708755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e3037-163e-4430-b3b2-86564d753c69 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:25.709294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e3037-163e-4430-b3b2-86564d753c69 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:25.709482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e3037-163e-4430-b3b2-86564d753c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:25.791278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7a8e3037-163e-4430-b3b2-86564d753c69 None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:25.792772 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7a8e3037-163e-4430-b3b2-86564d753c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:25.930327 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1067/2131] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:35:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:25.977220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388ffce-519b-48c3-bbdf-2e70e0eab3ec None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:25.980139 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9388ffce-519b-48c3-bbdf-2e70e0eab3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:26.107624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388ffce-519b-48c3-bbdf-2e70e0eab3ec None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:26.112908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f293c77-2397-49cd-8dea-0db221645557 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:26.114019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f293c77-2397-49cd-8dea-0db221645557 service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:26.114402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f293c77-2397-49cd-8dea-0db221645557 service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:26.114814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f293c77-2397-49cd-8dea-0db221645557 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:26.124931 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f293c77-2397-49cd-8dea-0db221645557 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:26.126992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f293c77-2397-49cd-8dea-0db221645557 service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:26.145867 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1065/2132] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:35:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 12:35:26.765034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649bb3c-5517-4a01-a0c3-f3c3106a6f04 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:26.765502 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649bb3c-5517-4a01-a0c3-f3c3106a6f04 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:26.765591 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649bb3c-5517-4a01-a0c3-f3c3106a6f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:26.783522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7649bb3c-5517-4a01-a0c3-f3c3106a6f04 None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:26.784829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7649bb3c-5517-4a01-a0c3-f3c3106a6f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:26.792969 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1068/2133] 10.222.0.39 () {58 vars in 967 bytes} [Thu May 26 12:35:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:26.805479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f293c77-2397-49cd-8dea-0db221645557 service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:26.816202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f293c77-2397-49cd-8dea-0db221645557 service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:26.822058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffed1a-3240-4b14-8905-1acb13b16498 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:26.822732 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffed1a-3240-4b14-8905-1acb13b16498 service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:26.823015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffed1a-3240-4b14-8905-1acb13b16498 service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:26.823320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffed1a-3240-4b14-8905-1acb13b16498 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:26.831601 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffed1a-3240-4b14-8905-1acb13b16498 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:26.833382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffed1a-3240-4b14-8905-1acb13b16498 service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:26.842056 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1066/2134] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:35:27.053462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24431604-df96-4d88-b419-3ad4a2b60c67 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:27.053741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24431604-df96-4d88-b419-3ad4a2b60c67 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:27.054027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24431604-df96-4d88-b419-3ad4a2b60c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:27.072945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-24431604-df96-4d88-b419-3ad4a2b60c67 None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:27.074151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-24431604-df96-4d88-b419-3ad4a2b60c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:27.081435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1069/2135] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:35:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:27.093542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffed1a-3240-4b14-8905-1acb13b16498 service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:27.105170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffed1a-3240-4b14-8905-1acb13b16498 service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:27.110343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073fcbc-5839-4b2c-a58f-bcfa23b47802 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:27.111012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073fcbc-5839-4b2c-a58f-bcfa23b47802 service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:27.111291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073fcbc-5839-4b2c-a58f-bcfa23b47802 service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:27.111565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073fcbc-5839-4b2c-a58f-bcfa23b47802 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:27.120979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073fcbc-5839-4b2c-a58f-bcfa23b47802 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:27.122552 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073fcbc-5839-4b2c-a58f-bcfa23b47802 service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:27.131040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1067/2136] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:35:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 12:35:27.482989 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801227b-3347-4c1f-983d-52e8af129bd2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:27.483510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801227b-3347-4c1f-983d-52e8af129bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:27.483789 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801227b-3347-4c1f-983d-52e8af129bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:27.502628 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3801227b-3347-4c1f-983d-52e8af129bd2 None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:27.503827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3801227b-3347-4c1f-983d-52e8af129bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:27.513681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1070/2137] 10.222.0.39 () {58 vars in 967 bytes} [Thu May 26 12:35:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:27.526480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073fcbc-5839-4b2c-a58f-bcfa23b47802 service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:27.536788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073fcbc-5839-4b2c-a58f-bcfa23b47802 service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:27.543101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459b467-28fc-439a-a12e-bfbcd85f5dbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:27.543749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459b467-28fc-439a-a12e-bfbcd85f5dbd service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:27.544038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459b467-28fc-439a-a12e-bfbcd85f5dbd service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:27.544317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459b467-28fc-439a-a12e-bfbcd85f5dbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:27.552569 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459b467-28fc-439a-a12e-bfbcd85f5dbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:27.554237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459b467-28fc-439a-a12e-bfbcd85f5dbd service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:27.562670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1068/2138] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:35:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:35:29.075325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801227b-3347-4c1f-983d-52e8af129bd2 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:29.077097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3801227b-3347-4c1f-983d-52e8af129bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:29.170045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801227b-3347-4c1f-983d-52e8af129bd2 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:29.175319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82cc0b-c2f7-419e-9671-f8063851b53a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:29.175978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82cc0b-c2f7-419e-9671-f8063851b53a service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:29.176264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82cc0b-c2f7-419e-9671-f8063851b53a service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:29.176542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82cc0b-c2f7-419e-9671-f8063851b53a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:29.178378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5b82cc0b-c2f7-419e-9671-f8063851b53a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:29.190408 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82cc0b-c2f7-419e-9671-f8063851b53a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:29.191980 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82cc0b-c2f7-419e-9671-f8063851b53a service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:29.201762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1071/2139] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:35:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:29.625600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459b467-28fc-439a-a12e-bfbcd85f5dbd service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:29.626999 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e459b467-28fc-439a-a12e-bfbcd85f5dbd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:29.696145 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459b467-28fc-439a-a12e-bfbcd85f5dbd service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:29.700630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:29.701535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:29.701815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:29.702093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] PATH_INFO: `/v3/users/9ed76893bbb4445b9d1455254d7120c4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:29.703265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed76893bbb4445b9d1455254d7120c4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:29.705215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:29.739377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:29.752530 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed76893bbb4445b9d1455254d7120c4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.753204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed76893bbb4445b9d1455254d7120c4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.753810 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed76893bbb4445b9d1455254d7120c4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.767099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed76893bbb4445b9d1455254d7120c4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.775736 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed76893bbb4445b9d1455254d7120c4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:29.800041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1069/2140] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:35:29 2022] DELETE /identity/v3/users/9ed76893bbb4445b9d1455254d7120c4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:29.801985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1fa7-cf4a-49b9-95e8-8eedc0bdafd2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:29.802341 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1fa7-cf4a-49b9-95e8-8eedc0bdafd2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:29.802693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b1fa7-cf4a-49b9-95e8-8eedc0bdafd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:29.823713 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-872b1fa7-cf4a-49b9-95e8-8eedc0bdafd2 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:29.825294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-872b1fa7-cf4a-49b9-95e8-8eedc0bdafd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:29.868481 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:29.900414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1072/2141] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:29.907677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:29.909417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:29.988748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e2ca1-cb9c-40b9-9cc9-593d7f476591 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:29.993191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664618cb-df23-41fe-9be3-4d8354d17930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:29.993850 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664618cb-df23-41fe-9be3-4d8354d17930 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:29.994129 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664618cb-df23-41fe-9be3-4d8354d17930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:29.994406 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664618cb-df23-41fe-9be3-4d8354d17930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:30.005630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664618cb-df23-41fe-9be3-4d8354d17930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:30.008287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664618cb-df23-41fe-9be3-4d8354d17930 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:30.022463 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1070/2142] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:30.258005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b1fa7-cf4a-49b9-95e8-8eedc0bdafd2 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:30.260913 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-872b1fa7-cf4a-49b9-95e8-8eedc0bdafd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:30.280833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b1fa7-cf4a-49b9-95e8-8eedc0bdafd2 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:30.293172 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:30.294177 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:30.294531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:30.294820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2 admin admin] PATH_INFO: `/v3/projects/783419b36f6d446ba0f1ff249bbaea5a` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:30.296249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=783419b36f6d446ba0f1ff249bbaea5a)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:30.299115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:30.372448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783419b36f6d446ba0f1ff249bbaea5a', 'request_id': 'req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:30.385394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783419b36f6d446ba0f1ff249bbaea5a', 'request_id': 'req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:30.401424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783419b36f6d446ba0f1ff249bbaea5a', 'request_id': 'req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:30.425069 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2 admin admin] The token cache is being invalidate because project 783419b36f6d446ba0f1ff249bbaea5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:30.425364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:30.426090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ebf72fd5-6011-4ca9-859c-5050a20fe8e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:30.427831 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1073/2143] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:35:30 2022] DELETE /identity/v3/projects/783419b36f6d446ba0f1ff249bbaea5a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:39.194978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664618cb-df23-41fe-9be3-4d8354d17930 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:39.196387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-664618cb-df23-41fe-9be3-4d8354d17930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:39.208869 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664618cb-df23-41fe-9be3-4d8354d17930 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:39.266563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599da60f-80eb-4509-bfad-acd71c22ab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:39.267434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599da60f-80eb-4509-bfad-acd71c22ab73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:39.267718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599da60f-80eb-4509-bfad-acd71c22ab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:39.267996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599da60f-80eb-4509-bfad-acd71c22ab73 admin admin] PATH_INFO: `/v3/users/5bd3d7b9711144769ab0551abf4f440b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:39.269201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599da60f-80eb-4509-bfad-acd71c22ab73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd3d7b9711144769ab0551abf4f440b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:39.271137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599da60f-80eb-4509-bfad-acd71c22ab73 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:39.326639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-599da60f-80eb-4509-bfad-acd71c22ab73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd3d7b9711144769ab0551abf4f440b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:39.327337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-599da60f-80eb-4509-bfad-acd71c22ab73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd3d7b9711144769ab0551abf4f440b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:39.328025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-599da60f-80eb-4509-bfad-acd71c22ab73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd3d7b9711144769ab0551abf4f440b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:39.333536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:39.344880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-599da60f-80eb-4509-bfad-acd71c22ab73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd3d7b9711144769ab0551abf4f440b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:39.354320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-599da60f-80eb-4509-bfad-acd71c22ab73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd3d7b9711144769ab0551abf4f440b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:39.354724 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf84ae-ec14-442c-8253-a92facc63361 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:39.355353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf84ae-ec14-442c-8253-a92facc63361 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:39.355353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf84ae-ec14-442c-8253-a92facc63361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:39.368667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1071/2144] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:35:39 2022] DELETE /identity/v3/users/5bd3d7b9711144769ab0551abf4f440b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:39.373074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738623e-9c5b-487f-a89a-78b6c3c1fc8a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:39.373355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738623e-9c5b-487f-a89a-78b6c3c1fc8a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:39.373638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a738623e-9c5b-487f-a89a-78b6c3c1fc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:39.374087 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-dedf84ae-ec14-442c-8253-a92facc63361 None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:39.375306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dedf84ae-ec14-442c-8253-a92facc63361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:39.391677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a738623e-9c5b-487f-a89a-78b6c3c1fc8a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:39.392924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a738623e-9c5b-487f-a89a-78b6c3c1fc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:39.435394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1074/2145] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:39.447397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf84ae-ec14-442c-8253-a92facc63361 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:39.448753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dedf84ae-ec14-442c-8253-a92facc63361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:39.454190 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1072/2146] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:39.464041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738623e-9c5b-487f-a89a-78b6c3c1fc8a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:39.465427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a738623e-9c5b-487f-a89a-78b6c3c1fc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:39.521283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a738623e-9c5b-487f-a89a-78b6c3c1fc8a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:39.523131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf84ae-ec14-442c-8253-a92facc63361 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:39.525698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c806e-d837-474b-b3fc-a5f87afbb522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:39.526470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c806e-d837-474b-b3fc-a5f87afbb522 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:39.526758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c806e-d837-474b-b3fc-a5f87afbb522 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:39.527040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c806e-d837-474b-b3fc-a5f87afbb522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:39.528451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d8179-fa26-4554-9064-52cbdf646ef7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:39.529137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d8179-fa26-4554-9064-52cbdf646ef7 service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:39.529424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d8179-fa26-4554-9064-52cbdf646ef7 service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:39.529700 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d8179-fa26-4554-9064-52cbdf646ef7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:39.536370 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c806e-d837-474b-b3fc-a5f87afbb522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:39.538585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d8179-fa26-4554-9064-52cbdf646ef7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:39.538703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c806e-d837-474b-b3fc-a5f87afbb522 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:39.540176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d8179-fa26-4554-9064-52cbdf646ef7 service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:39.544764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:39.548734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1073/2147] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:35:39.552966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1075/2148] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:35:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 12:35:40.034674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c806e-d837-474b-b3fc-a5f87afbb522 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:40.036658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-514c806e-d837-474b-b3fc-a5f87afbb522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:40.064816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c806e-d837-474b-b3fc-a5f87afbb522 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:40.070970 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba776d43-41dc-4082-9244-1f353b369db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:40.071986 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776d43-41dc-4082-9244-1f353b369db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:40.072334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776d43-41dc-4082-9244-1f353b369db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:40.072638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776d43-41dc-4082-9244-1f353b369db8 admin admin] PATH_INFO: `/v3/projects/acb513d0eaef4923892754c6a5fb3c97` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:40.077867 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba776d43-41dc-4082-9244-1f353b369db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acb513d0eaef4923892754c6a5fb3c97)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:40.080417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba776d43-41dc-4082-9244-1f353b369db8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:40.160540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ba776d43-41dc-4082-9244-1f353b369db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acb513d0eaef4923892754c6a5fb3c97', 'request_id': 'req-ba776d43-41dc-4082-9244-1f353b369db8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.173954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ba776d43-41dc-4082-9244-1f353b369db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acb513d0eaef4923892754c6a5fb3c97', 'request_id': 'req-ba776d43-41dc-4082-9244-1f353b369db8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.182312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ba776d43-41dc-4082-9244-1f353b369db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acb513d0eaef4923892754c6a5fb3c97', 'request_id': 'req-ba776d43-41dc-4082-9244-1f353b369db8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.190621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:40.197601 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ba776d43-41dc-4082-9244-1f353b369db8 admin admin] The token cache is being invalidate because project acb513d0eaef4923892754c6a5fb3c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:40.198282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ba776d43-41dc-4082-9244-1f353b369db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.198688 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ba776d43-41dc-4082-9244-1f353b369db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:40.200573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1074/2149] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:35:40 2022] DELETE /identity/v3/projects/acb513d0eaef4923892754c6a5fb3c97 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:40.206865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622be93-40c7-4614-91e6-17a212c3eb64 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:40.206865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622be93-40c7-4614-91e6-17a212c3eb64 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:40.206865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622be93-40c7-4614-91e6-17a212c3eb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:40.230014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9622be93-40c7-4614-91e6-17a212c3eb64 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:40.231575 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9622be93-40c7-4614-91e6-17a212c3eb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:40.313176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1076/2150] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:40.322349 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500e9f6-6d36-456c-8dce-b54303c6d9b2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:40.322790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500e9f6-6d36-456c-8dce-b54303c6d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:40.323299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500e9f6-6d36-456c-8dce-b54303c6d9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:40.345118 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7500e9f6-6d36-456c-8dce-b54303c6d9b2 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:40.346531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7500e9f6-6d36-456c-8dce-b54303c6d9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:40.355463 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1075/2151] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:40.359910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622be93-40c7-4614-91e6-17a212c3eb64 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:40.370770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622be93-40c7-4614-91e6-17a212c3eb64 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:40.376449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880e41-cfec-4827-a6c5-2f0221a7a990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:40.377347 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880e41-cfec-4827-a6c5-2f0221a7a990 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:40.377652 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880e41-cfec-4827-a6c5-2f0221a7a990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:40.378036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880e41-cfec-4827-a6c5-2f0221a7a990 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:40.378874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88880e41-cfec-4827-a6c5-2f0221a7a990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:40.379271 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88880e41-cfec-4827-a6c5-2f0221a7a990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:40.381153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88880e41-cfec-4827-a6c5-2f0221a7a990 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:40.395232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1077/2152] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:40.399692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500e9f6-6d36-456c-8dce-b54303c6d9b2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:40.410202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500e9f6-6d36-456c-8dce-b54303c6d9b2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:40.417356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddb0db-a935-4e93-ba25-e04353e665da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:40.418153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddb0db-a935-4e93-ba25-e04353e665da admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:40.418546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddb0db-a935-4e93-ba25-e04353e665da admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:40.418969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddb0db-a935-4e93-ba25-e04353e665da admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:40.419775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddb0db-a935-4e93-ba25-e04353e665da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:40.421874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddb0db-a935-4e93-ba25-e04353e665da admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:40.454434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1076/2153] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:35:40 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:40.459714 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880e41-cfec-4827-a6c5-2f0221a7a990 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:40.472561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880e41-cfec-4827-a6c5-2f0221a7a990 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:40.540866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b3fb7-1273-4e03-9c37-9dab31a95312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:40.541450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b3fb7-1273-4e03-9c37-9dab31a95312 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:40.541776 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b3fb7-1273-4e03-9c37-9dab31a95312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:40.542095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b3fb7-1273-4e03-9c37-9dab31a95312 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:40.542999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b3fb7-1273-4e03-9c37-9dab31a95312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:40.545067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b3fb7-1273-4e03-9c37-9dab31a95312 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:40.573589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1078/2154] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:35:40 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:40.574851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddb0db-a935-4e93-ba25-e04353e665da admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:40.586207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddb0db-a935-4e93-ba25-e04353e665da admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:40.593091 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4ad6c-68cb-48ce-a4a8-b9fcd9928f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:40.593806 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4ad6c-68cb-48ce-a4a8-b9fcd9928f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:40.594060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4ad6c-68cb-48ce-a4a8-b9fcd9928f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:40.594341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4ad6c-68cb-48ce-a4a8-b9fcd9928f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:40.595135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4ad6c-68cb-48ce-a4a8-b9fcd9928f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:40.596723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4ad6c-68cb-48ce-a4a8-b9fcd9928f63 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:40.612748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1077/2155] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:40.615096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b3fb7-1273-4e03-9c37-9dab31a95312 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:40.626659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b3fb7-1273-4e03-9c37-9dab31a95312 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:40.632239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf186c-6aaf-44d6-bc01-398ab0ac9b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:40.633143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf186c-6aaf-44d6-bc01-398ab0ac9b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:40.633598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf186c-6aaf-44d6-bc01-398ab0ac9b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:40.633883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf186c-6aaf-44d6-bc01-398ab0ac9b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:40.634633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf186c-6aaf-44d6-bc01-398ab0ac9b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:40.636554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf186c-6aaf-44d6-bc01-398ab0ac9b2b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:40.649870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1079/2156] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:40.654743 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4ad6c-68cb-48ce-a4a8-b9fcd9928f63 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:40.666986 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4ad6c-68cb-48ce-a4a8-b9fcd9928f63 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:40.674128 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f6cb4-2f69-42cf-b325-17bb3bf2e0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:40.675216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f6cb4-2f69-42cf-b325-17bb3bf2e0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:40.675665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f6cb4-2f69-42cf-b325-17bb3bf2e0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:40.675953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f6cb4-2f69-42cf-b325-17bb3bf2e0e9 admin admin] PATH_INFO: `/v3/projects/16dac7e85f1d42989cba2467328d5fed/users/a497b4bfcae04c45b733fab99b65b1fb/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:40.696293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f6cb4-2f69-42cf-b325-17bb3bf2e0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16dac7e85f1d42989cba2467328d5fed, user_id=a497b4bfcae04c45b733fab99b65b1fb, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:40.699487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f6cb4-2f69-42cf-b325-17bb3bf2e0e9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:40.714416 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1078/2157] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:35:40 2022] PUT /identity/v3/projects/16dac7e85f1d42989cba2467328d5fed/users/a497b4bfcae04c45b733fab99b65b1fb/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:40.728604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470dbc7-10a4-4782-b4bf-ab5bbbba2819 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:40.729284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470dbc7-10a4-4782-b4bf-ab5bbbba2819 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:40.729750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470dbc7-10a4-4782-b4bf-ab5bbbba2819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:40.762826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7470dbc7-10a4-4782-b4bf-ab5bbbba2819 None None] MFA Rules not processed for user `a497b4bfcae04c45b733fab99b65b1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:40.764261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7470dbc7-10a4-4782-b4bf-ab5bbbba2819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:40.907342 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:40.919383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1080/2158] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:40.932071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f6cb4-2f69-42cf-b325-17bb3bf2e0e9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:40.934008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-480f6cb4-2f69-42cf-b325-17bb3bf2e0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:41.019299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f6cb4-2f69-42cf-b325-17bb3bf2e0e9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:41.026802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab1020-8277-4417-a086-245e11990054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:41.027651 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab1020-8277-4417-a086-245e11990054 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:41.028028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab1020-8277-4417-a086-245e11990054 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:41.028355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab1020-8277-4417-a086-245e11990054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:41.040310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab1020-8277-4417-a086-245e11990054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:41.043811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab1020-8277-4417-a086-245e11990054 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:41.058086 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1079/2159] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:35:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:50.915964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:51.051704 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:52.278881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470dbc7-10a4-4782-b4bf-ab5bbbba2819 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:52.405767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470dbc7-10a4-4782-b4bf-ab5bbbba2819 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:52.427124 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:52.428114 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:52.428410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:52.436504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] PATH_INFO: `/v3/users/a497b4bfcae04c45b733fab99b65b1fb` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:52.438238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a497b4bfcae04c45b733fab99b65b1fb)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:52.444414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:52.519172 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a497b4bfcae04c45b733fab99b65b1fb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.519839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a497b4bfcae04c45b733fab99b65b1fb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.520481 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a497b4bfcae04c45b733fab99b65b1fb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.537635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a497b4bfcae04c45b733fab99b65b1fb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.550878 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a497b4bfcae04c45b733fab99b65b1fb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:52.578104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1081/2160] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:35:52 2022] DELETE /identity/v3/users/a497b4bfcae04c45b733fab99b65b1fb => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:52.582736 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ada4c-9e75-4dbc-b755-df2fa3548ce8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:52.583509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ada4c-9e75-4dbc-b755-df2fa3548ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:52.584100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ada4c-9e75-4dbc-b755-df2fa3548ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:52.613867 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ee1ada4c-9e75-4dbc-b755-df2fa3548ce8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:52.615205 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ee1ada4c-9e75-4dbc-b755-df2fa3548ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:52.701467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1080/2161] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:52.711768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:52.714209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:52.817736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f7dfb-57cf-4d1b-b603-49aa5b91e06a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:52.824907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827c13c-c7f9-4c9a-996d-aeb22b7d228a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:52.825578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827c13c-c7f9-4c9a-996d-aeb22b7d228a service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:52.825932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827c13c-c7f9-4c9a-996d-aeb22b7d228a service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:52.826325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827c13c-c7f9-4c9a-996d-aeb22b7d228a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:52.842577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827c13c-c7f9-4c9a-996d-aeb22b7d228a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:52.845085 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827c13c-c7f9-4c9a-996d-aeb22b7d228a service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:52.855615 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1082/2162] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:53.181045 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ada4c-9e75-4dbc-b755-df2fa3548ce8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:53.182766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ee1ada4c-9e75-4dbc-b755-df2fa3548ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:53.219563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ada4c-9e75-4dbc-b755-df2fa3548ce8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:53.228981 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96491f02-19ca-4187-ac56-2d30fadf3337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:53.230228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96491f02-19ca-4187-ac56-2d30fadf3337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:53.230875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96491f02-19ca-4187-ac56-2d30fadf3337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:53.232402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96491f02-19ca-4187-ac56-2d30fadf3337 admin admin] PATH_INFO: `/v3/projects/16dac7e85f1d42989cba2467328d5fed` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:53.234827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96491f02-19ca-4187-ac56-2d30fadf3337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16dac7e85f1d42989cba2467328d5fed)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:53.237355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96491f02-19ca-4187-ac56-2d30fadf3337 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:53.298542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-96491f02-19ca-4187-ac56-2d30fadf3337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16dac7e85f1d42989cba2467328d5fed', 'request_id': 'req-96491f02-19ca-4187-ac56-2d30fadf3337'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.308001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-96491f02-19ca-4187-ac56-2d30fadf3337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16dac7e85f1d42989cba2467328d5fed', 'request_id': 'req-96491f02-19ca-4187-ac56-2d30fadf3337'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.317451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-96491f02-19ca-4187-ac56-2d30fadf3337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16dac7e85f1d42989cba2467328d5fed', 'request_id': 'req-96491f02-19ca-4187-ac56-2d30fadf3337'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.330014 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-96491f02-19ca-4187-ac56-2d30fadf3337 admin admin] The token cache is being invalidate because project 16dac7e85f1d42989cba2467328d5fed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:53.330567 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-96491f02-19ca-4187-ac56-2d30fadf3337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.331231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-96491f02-19ca-4187-ac56-2d30fadf3337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.336894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1081/2163] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:35:53 2022] DELETE /identity/v3/projects/16dac7e85f1d42989cba2467328d5fed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:35:53.621444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827c13c-c7f9-4c9a-996d-aeb22b7d228a service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:53.621444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f827c13c-c7f9-4c9a-996d-aeb22b7d228a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:53.636659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827c13c-c7f9-4c9a-996d-aeb22b7d228a service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:53.693374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:53.749023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:53.750396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:53.750870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:53.751153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] PATH_INFO: `/v3/users/d728eef7edf04a8c82987e75f27203bd` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:53.752639 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d728eef7edf04a8c82987e75f27203bd)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:53.755030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:53.821413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd728eef7edf04a8c82987e75f27203bd'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.822093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd728eef7edf04a8c82987e75f27203bd'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.822696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd728eef7edf04a8c82987e75f27203bd'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.837128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd728eef7edf04a8c82987e75f27203bd'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.844961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd728eef7edf04a8c82987e75f27203bd'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:53.861635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1083/2164] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:35:53 2022] DELETE /identity/v3/users/d728eef7edf04a8c82987e75f27203bd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:53.867307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4b713-60ee-400b-ad99-9c1e0190a8ba None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:53.868950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4b713-60ee-400b-ad99-9c1e0190a8ba None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:53.869519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4b713-60ee-400b-ad99-9c1e0190a8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:53.898985 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a6c4b713-60ee-400b-ad99-9c1e0190a8ba None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:53.900794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a6c4b713-60ee-400b-ad99-9c1e0190a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:53.987838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1082/2165] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:53.998807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.000283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:54.077853 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729f6d2-4538-467d-832e-2f229ea33658 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.082285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71411a50-a4b3-4cd5-b10a-9093de29b1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.082959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71411a50-a4b3-4cd5-b10a-9093de29b1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.083828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71411a50-a4b3-4cd5-b10a-9093de29b1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.083828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71411a50-a4b3-4cd5-b10a-9093de29b1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.095124 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71411a50-a4b3-4cd5-b10a-9093de29b1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.098539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71411a50-a4b3-4cd5-b10a-9093de29b1a1 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.110832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1084/2166] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:54.448582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4b713-60ee-400b-ad99-9c1e0190a8ba None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.450079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a6c4b713-60ee-400b-ad99-9c1e0190a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:54.462265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4b713-60ee-400b-ad99-9c1e0190a8ba None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.466934 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c1e1b-edc2-44ab-9855-067e5a133450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.467804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c1e1b-edc2-44ab-9855-067e5a133450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.468093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c1e1b-edc2-44ab-9855-067e5a133450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.468377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c1e1b-edc2-44ab-9855-067e5a133450 admin admin] PATH_INFO: `/v3/projects/e730e555bf144aedb0355c7a68220d65` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.469624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c1e1b-edc2-44ab-9855-067e5a133450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e730e555bf144aedb0355c7a68220d65)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.471553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c1e1b-edc2-44ab-9855-067e5a133450 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.493636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:54.520467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6c5c1e1b-edc2-44ab-9855-067e5a133450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e730e555bf144aedb0355c7a68220d65', 'request_id': 'req-6c5c1e1b-edc2-44ab-9855-067e5a133450'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:54.527872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6c5c1e1b-edc2-44ab-9855-067e5a133450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e730e555bf144aedb0355c7a68220d65', 'request_id': 'req-6c5c1e1b-edc2-44ab-9855-067e5a133450'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:54.534662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6c5c1e1b-edc2-44ab-9855-067e5a133450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e730e555bf144aedb0355c7a68220d65', 'request_id': 'req-6c5c1e1b-edc2-44ab-9855-067e5a133450'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:54.545588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6c5c1e1b-edc2-44ab-9855-067e5a133450 admin admin] The token cache is being invalidate because project e730e555bf144aedb0355c7a68220d65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:54.545875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6c5c1e1b-edc2-44ab-9855-067e5a133450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:54.546517 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6c5c1e1b-edc2-44ab-9855-067e5a133450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:54.548051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1083/2167] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:35:54 2022] DELETE /identity/v3/projects/e730e555bf144aedb0355c7a68220d65 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:54.552879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a740fd-0718-4bfe-bc73-9ee6dd83f313 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.553168 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a740fd-0718-4bfe-bc73-9ee6dd83f313 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.553445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a740fd-0718-4bfe-bc73-9ee6dd83f313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.571212 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a3a740fd-0718-4bfe-bc73-9ee6dd83f313 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:54.572413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a3a740fd-0718-4bfe-bc73-9ee6dd83f313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:54.612148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:54.642897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1085/2168] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:54.644565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891571a5-4271-4b37-83ec-88d0dbe71f8e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.644993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891571a5-4271-4b37-83ec-88d0dbe71f8e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.645185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891571a5-4271-4b37-83ec-88d0dbe71f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.667798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-891571a5-4271-4b37-83ec-88d0dbe71f8e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:54.669573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-891571a5-4271-4b37-83ec-88d0dbe71f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:54.680752 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1084/2169] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:54.686201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a740fd-0718-4bfe-bc73-9ee6dd83f313 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.701285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a740fd-0718-4bfe-bc73-9ee6dd83f313 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.708434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870871c0-34f0-43c4-aa0c-4c518ab2672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.709459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870871c0-34f0-43c4-aa0c-4c518ab2672b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.709925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870871c0-34f0-43c4-aa0c-4c518ab2672b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.710338 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870871c0-34f0-43c4-aa0c-4c518ab2672b admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.711474 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870871c0-34f0-43c4-aa0c-4c518ab2672b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:54.711948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870871c0-34f0-43c4-aa0c-4c518ab2672b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.714687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870871c0-34f0-43c4-aa0c-4c518ab2672b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.735588 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1086/2170] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:35:54.736864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891571a5-4271-4b37-83ec-88d0dbe71f8e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.750772 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891571a5-4271-4b37-83ec-88d0dbe71f8e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.757567 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21e97b-5d6a-451d-8be0-fd5437197d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.758361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21e97b-5d6a-451d-8be0-fd5437197d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.758716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21e97b-5d6a-451d-8be0-fd5437197d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.758998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21e97b-5d6a-451d-8be0-fd5437197d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.759712 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21e97b-5d6a-451d-8be0-fd5437197d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.761935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21e97b-5d6a-451d-8be0-fd5437197d02 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.796646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1085/2171] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:35:54 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:54.798130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870871c0-34f0-43c4-aa0c-4c518ab2672b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.809705 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870871c0-34f0-43c4-aa0c-4c518ab2672b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.873745 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b917cd-1719-4de3-9ead-0d0329fad08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.874469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b917cd-1719-4de3-9ead-0d0329fad08e admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.874799 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b917cd-1719-4de3-9ead-0d0329fad08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.875093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b917cd-1719-4de3-9ead-0d0329fad08e admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.875822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b917cd-1719-4de3-9ead-0d0329fad08e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.880849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b917cd-1719-4de3-9ead-0d0329fad08e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.905429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1087/2172] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:35:54 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:35:54.907122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21e97b-5d6a-451d-8be0-fd5437197d02 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.918947 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21e97b-5d6a-451d-8be0-fd5437197d02 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.924402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553ed12-480d-4b52-a153-c44951dd68d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.925192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553ed12-480d-4b52-a153-c44951dd68d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.925528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553ed12-480d-4b52-a153-c44951dd68d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.925762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553ed12-480d-4b52-a153-c44951dd68d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.926555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553ed12-480d-4b52-a153-c44951dd68d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.928242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553ed12-480d-4b52-a153-c44951dd68d0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.943109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1086/2173] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:35:54.944152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b917cd-1719-4de3-9ead-0d0329fad08e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.954926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b917cd-1719-4de3-9ead-0d0329fad08e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.960663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0806545-82d7-4586-8a49-0d40924206b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.961402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0806545-82d7-4586-8a49-0d40924206b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.961687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0806545-82d7-4586-8a49-0d40924206b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.961965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0806545-82d7-4586-8a49-0d40924206b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:54.962697 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0806545-82d7-4586-8a49-0d40924206b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:54.964298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0806545-82d7-4586-8a49-0d40924206b2 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:54.976749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1088/2174] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:54.980580 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553ed12-480d-4b52-a153-c44951dd68d0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:54.991479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553ed12-480d-4b52-a153-c44951dd68d0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:54.996755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3b4fc-8826-4806-b101-f61f8ec39201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:54.997683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3b4fc-8826-4806-b101-f61f8ec39201 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:54.997978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3b4fc-8826-4806-b101-f61f8ec39201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:54.998277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3b4fc-8826-4806-b101-f61f8ec39201 admin admin] PATH_INFO: `/v3/projects/2f9e4ca2738145aab62f646b94ce1d23/users/d30b258722f542618f6665b7e6d6ab1f/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:55.015344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3b4fc-8826-4806-b101-f61f8ec39201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9e4ca2738145aab62f646b94ce1d23, user_id=d30b258722f542618f6665b7e6d6ab1f, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:55.018125 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3b4fc-8826-4806-b101-f61f8ec39201 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:55.039203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1087/2175] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:35:54 2022] PUT /identity/v3/projects/2f9e4ca2738145aab62f646b94ce1d23/users/d30b258722f542618f6665b7e6d6ab1f/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:55.054827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2119e1-1097-47ad-b90e-0f584a0507ce None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:55.055343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2119e1-1097-47ad-b90e-0f584a0507ce None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:55.055741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2119e1-1097-47ad-b90e-0f584a0507ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:55.084649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8f2119e1-1097-47ad-b90e-0f584a0507ce None None] MFA Rules not processed for user `d30b258722f542618f6665b7e6d6ab1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:55.086599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8f2119e1-1097-47ad-b90e-0f584a0507ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:55.161042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1089/2176] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:55.174767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3b4fc-8826-4806-b101-f61f8ec39201 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:55.177191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2ad3b4fc-8826-4806-b101-f61f8ec39201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:55.266970 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3b4fc-8826-4806-b101-f61f8ec39201 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:55.271120 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d0281-4f4f-497a-9616-84206f3c4e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:55.272299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d0281-4f4f-497a-9616-84206f3c4e27 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:55.272913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d0281-4f4f-497a-9616-84206f3c4e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:55.273474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d0281-4f4f-497a-9616-84206f3c4e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:55.283815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d0281-4f4f-497a-9616-84206f3c4e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:55.285373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d0281-4f4f-497a-9616-84206f3c4e27 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:55.296390 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1088/2177] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:35:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:55.325482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2119e1-1097-47ad-b90e-0f584a0507ce None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:55.371936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:55.397453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2119e1-1097-47ad-b90e-0f584a0507ce None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:55.402955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:55.403917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:55.404281 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:55.404621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] PATH_INFO: `/v3/users/d30b258722f542618f6665b7e6d6ab1f` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:55.405943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d30b258722f542618f6665b7e6d6ab1f)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:55.407953 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:55.467922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd30b258722f542618f6665b7e6d6ab1f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:55.468695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd30b258722f542618f6665b7e6d6ab1f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:55.469449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd30b258722f542618f6665b7e6d6ab1f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:55.483423 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd30b258722f542618f6665b7e6d6ab1f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:55.490653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd30b258722f542618f6665b7e6d6ab1f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:55.505947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1090/2178] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:35:55 2022] DELETE /identity/v3/users/d30b258722f542618f6665b7e6d6ab1f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:55.510421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c2729-e386-4924-ac9f-3f238fbe4e65 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:55.510719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c2729-e386-4924-ac9f-3f238fbe4e65 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:55.511255 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c2729-e386-4924-ac9f-3f238fbe4e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:55.532813 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b67c2729-e386-4924-ac9f-3f238fbe4e65 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:55.534563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b67c2729-e386-4924-ac9f-3f238fbe4e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:55.584806 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:55.606934 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1089/2179] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:55.617893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:55.619427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:55.686055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db64bb-a3c6-4f63-8bdd-1b53320be31e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:55.695034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8309b1-bdee-4026-8c90-d33ef98e7558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:55.695748 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8309b1-bdee-4026-8c90-d33ef98e7558 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:55.696033 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8309b1-bdee-4026-8c90-d33ef98e7558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:55.696312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8309b1-bdee-4026-8c90-d33ef98e7558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:55.706360 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8309b1-bdee-4026-8c90-d33ef98e7558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:55.707857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8309b1-bdee-4026-8c90-d33ef98e7558 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:55.719483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1091/2180] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:56.070173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c2729-e386-4924-ac9f-3f238fbe4e65 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:56.072311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b67c2729-e386-4924-ac9f-3f238fbe4e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:56.085602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c2729-e386-4924-ac9f-3f238fbe4e65 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:56.091348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93965649-8535-404d-b2a4-09dc414ca8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:56.092232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93965649-8535-404d-b2a4-09dc414ca8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.092515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93965649-8535-404d-b2a4-09dc414ca8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.092829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93965649-8535-404d-b2a4-09dc414ca8ab admin admin] PATH_INFO: `/v3/projects/2f9e4ca2738145aab62f646b94ce1d23` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.094209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93965649-8535-404d-b2a4-09dc414ca8ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9e4ca2738145aab62f646b94ce1d23)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:56.096279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93965649-8535-404d-b2a4-09dc414ca8ab admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:56.174058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-93965649-8535-404d-b2a4-09dc414ca8ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9e4ca2738145aab62f646b94ce1d23', 'request_id': 'req-93965649-8535-404d-b2a4-09dc414ca8ab'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:56.184623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-93965649-8535-404d-b2a4-09dc414ca8ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9e4ca2738145aab62f646b94ce1d23', 'request_id': 'req-93965649-8535-404d-b2a4-09dc414ca8ab'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:56.193003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-93965649-8535-404d-b2a4-09dc414ca8ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9e4ca2738145aab62f646b94ce1d23', 'request_id': 'req-93965649-8535-404d-b2a4-09dc414ca8ab'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:56.207333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-93965649-8535-404d-b2a4-09dc414ca8ab admin admin] The token cache is being invalidate because project 2f9e4ca2738145aab62f646b94ce1d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:35:56.207616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-93965649-8535-404d-b2a4-09dc414ca8ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:56.208597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-93965649-8535-404d-b2a4-09dc414ca8ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:35:56.211263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1090/2181] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:35:56 2022] DELETE /identity/v3/projects/2f9e4ca2738145aab62f646b94ce1d23 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:56.216515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad83a50-3fc5-4523-aa77-0857bb7b6ed2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.216904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad83a50-3fc5-4523-aa77-0857bb7b6ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.217200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad83a50-3fc5-4523-aa77-0857bb7b6ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.246838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fad83a50-3fc5-4523-aa77-0857bb7b6ed2 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:56.248532 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fad83a50-3fc5-4523-aa77-0857bb7b6ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:56.324771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1092/2182] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:56.327678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dad24-47be-4ec6-9a5c-cb4c42994df3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.328101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dad24-47be-4ec6-9a5c-cb4c42994df3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.328382 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dad24-47be-4ec6-9a5c-cb4c42994df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.356942 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d01dad24-47be-4ec6-9a5c-cb4c42994df3 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:56.360032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d01dad24-47be-4ec6-9a5c-cb4c42994df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:56.376801 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1091/2183] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:35:56.378477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad83a50-3fc5-4523-aa77-0857bb7b6ed2 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:56.384052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:35:56.392614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad83a50-3fc5-4523-aa77-0857bb7b6ed2 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:56.399023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb6f7e-7642-4f74-bb24-9391ae378992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:56.399562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb6f7e-7642-4f74-bb24-9391ae378992 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.399916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb6f7e-7642-4f74-bb24-9391ae378992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.400131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb6f7e-7642-4f74-bb24-9391ae378992 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.400927 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb6f7e-7642-4f74-bb24-9391ae378992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:35:56.401238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb6f7e-7642-4f74-bb24-9391ae378992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:56.402905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb6f7e-7642-4f74-bb24-9391ae378992 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:56.418243 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1093/2184] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:35:56.422630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dad24-47be-4ec6-9a5c-cb4c42994df3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:56.438528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dad24-47be-4ec6-9a5c-cb4c42994df3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:56.443792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d8aba-9681-4eee-be63-4e27c36e4353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:56.444972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d8aba-9681-4eee-be63-4e27c36e4353 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.445308 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d8aba-9681-4eee-be63-4e27c36e4353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.446827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d8aba-9681-4eee-be63-4e27c36e4353 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.446827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d8aba-9681-4eee-be63-4e27c36e4353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:56.448476 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d8aba-9681-4eee-be63-4e27c36e4353 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:56.495489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1092/2185] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:35:56 2022] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:56.499571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb6f7e-7642-4f74-bb24-9391ae378992 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:56.513558 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb6f7e-7642-4f74-bb24-9391ae378992 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:56.587733 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c6ae2-28fd-46b1-a476-4171c69f3a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:56.588555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c6ae2-28fd-46b1-a476-4171c69f3a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.588951 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c6ae2-28fd-46b1-a476-4171c69f3a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.589687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c6ae2-28fd-46b1-a476-4171c69f3a77 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.590895 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c6ae2-28fd-46b1-a476-4171c69f3a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:56.593041 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c6ae2-28fd-46b1-a476-4171c69f3a77 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:56.649425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1094/2186] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:35:56 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:35:56.653899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d8aba-9681-4eee-be63-4e27c36e4353 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:56.667816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d8aba-9681-4eee-be63-4e27c36e4353 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:56.675390 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cbaba-3d39-4b60-8432-ab792b3c74a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:56.676265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cbaba-3d39-4b60-8432-ab792b3c74a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.676591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cbaba-3d39-4b60-8432-ab792b3c74a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.677492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cbaba-3d39-4b60-8432-ab792b3c74a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.677850 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cbaba-3d39-4b60-8432-ab792b3c74a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:56.680163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04cbaba-3d39-4b60-8432-ab792b3c74a8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:56.694953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1093/2187] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:35:56.699731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c6ae2-28fd-46b1-a476-4171c69f3a77 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:56.716147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c6ae2-28fd-46b1-a476-4171c69f3a77 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:56.728342 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf44f67-8f0b-4653-afaa-196031e3093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:56.729529 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf44f67-8f0b-4653-afaa-196031e3093f admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.729529 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf44f67-8f0b-4653-afaa-196031e3093f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.730382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf44f67-8f0b-4653-afaa-196031e3093f admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.730699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf44f67-8f0b-4653-afaa-196031e3093f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:56.732745 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf44f67-8f0b-4653-afaa-196031e3093f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:56.748194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1095/2188] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:35:56.753064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cbaba-3d39-4b60-8432-ab792b3c74a8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:56.769411 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cbaba-3d39-4b60-8432-ab792b3c74a8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:56.775218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518875d-dc91-4083-8956-d4e7942b5eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:56.776574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518875d-dc91-4083-8956-d4e7942b5eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.776898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518875d-dc91-4083-8956-d4e7942b5eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.777180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518875d-dc91-4083-8956-d4e7942b5eb2 admin admin] PATH_INFO: `/v3/projects/8b599d6d0e894faea1bee29db795b727/users/914750180edc4d2c8886a58ad86c4784/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.801656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518875d-dc91-4083-8956-d4e7942b5eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b599d6d0e894faea1bee29db795b727, user_id=914750180edc4d2c8886a58ad86c4784, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:56.805671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518875d-dc91-4083-8956-d4e7942b5eb2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:56.839840 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1094/2189] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:35:56 2022] PUT /identity/v3/projects/8b599d6d0e894faea1bee29db795b727/users/914750180edc4d2c8886a58ad86c4784/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:35:56.851343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049619a-9f58-45ab-a616-8e160ace35b9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:56.851654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049619a-9f58-45ab-a616-8e160ace35b9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:56.851937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049619a-9f58-45ab-a616-8e160ace35b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:56.910507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5049619a-9f58-45ab-a616-8e160ace35b9 None None] MFA Rules not processed for user `914750180edc4d2c8886a58ad86c4784`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:56.911862 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5049619a-9f58-45ab-a616-8e160ace35b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:57.097587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1096/2190] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:35:57.110063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518875d-dc91-4083-8956-d4e7942b5eb2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:35:57.112761 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8518875d-dc91-4083-8956-d4e7942b5eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:57.206160 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518875d-dc91-4083-8956-d4e7942b5eb2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:35:57.211607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5715d8f-6050-4fac-82ff-7b8854327647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:35:57.212204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5715d8f-6050-4fac-82ff-7b8854327647 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:57.213023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5715d8f-6050-4fac-82ff-7b8854327647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:57.214705 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5715d8f-6050-4fac-82ff-7b8854327647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:57.225117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5715d8f-6050-4fac-82ff-7b8854327647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:35:57.227421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5715d8f-6050-4fac-82ff-7b8854327647 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:35:57.240241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1095/2191] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:35:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:35:58.108509 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfd0b7-0429-4de8-90ba-1845669acfc4 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:35:58.109062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfd0b7-0429-4de8-90ba-1845669acfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:35:58.109153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfd0b7-0429-4de8-90ba-1845669acfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:35:58.128252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fcbfd0b7-0429-4de8-90ba-1845669acfc4 None None] MFA Rules not processed for user `c21602eca99d48d8824c0f5c1693d573`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:35:58.129630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fcbfd0b7-0429-4de8-90ba-1845669acfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:35:58.212753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1097/2192] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:35:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:06.969209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aab051-7506-437a-916a-683dc7c15def None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:06.969719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aab051-7506-437a-916a-683dc7c15def None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:06.969828 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aab051-7506-437a-916a-683dc7c15def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:06.988760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-79aab051-7506-437a-916a-683dc7c15def None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:06.989960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-79aab051-7506-437a-916a-683dc7c15def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:06.994698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:07.047874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1096/2193] 10.222.0.39 () {58 vars in 967 bytes} [Thu May 26 12:36:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:07.060609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfd0b7-0429-4de8-90ba-1845669acfc4 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:07.062039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fcbfd0b7-0429-4de8-90ba-1845669acfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:07.067014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:07.132949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfd0b7-0429-4de8-90ba-1845669acfc4 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:07.138410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24185d-4b91-4fe4-8feb-71b8264d5889 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:07.139047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24185d-4b91-4fe4-8feb-71b8264d5889 service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:07.139329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24185d-4b91-4fe4-8feb-71b8264d5889 service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:07.139604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24185d-4b91-4fe4-8feb-71b8264d5889 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:07.147838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24185d-4b91-4fe4-8feb-71b8264d5889 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:07.149445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24185d-4b91-4fe4-8feb-71b8264d5889 service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:07.157277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1098/2194] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:36:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:36:13.316903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aab051-7506-437a-916a-683dc7c15def None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:13.318974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-79aab051-7506-437a-916a-683dc7c15def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:13.390410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aab051-7506-437a-916a-683dc7c15def None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:13.396572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413869f2-0a97-41e7-971f-7bfa3cf87cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:13.397507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413869f2-0a97-41e7-971f-7bfa3cf87cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:13.397786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413869f2-0a97-41e7-971f-7bfa3cf87cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:13.398059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413869f2-0a97-41e7-971f-7bfa3cf87cdb admin admin] PATH_INFO: `/v3/users/c30a4258c6024a7c9ef1fbd694fa9bfd` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:13.399288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413869f2-0a97-41e7-971f-7bfa3cf87cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30a4258c6024a7c9ef1fbd694fa9bfd)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:13.401416 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413869f2-0a97-41e7-971f-7bfa3cf87cdb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:13.457183 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-413869f2-0a97-41e7-971f-7bfa3cf87cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30a4258c6024a7c9ef1fbd694fa9bfd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.457929 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-413869f2-0a97-41e7-971f-7bfa3cf87cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30a4258c6024a7c9ef1fbd694fa9bfd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.458874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-413869f2-0a97-41e7-971f-7bfa3cf87cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30a4258c6024a7c9ef1fbd694fa9bfd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.472611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-413869f2-0a97-41e7-971f-7bfa3cf87cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30a4258c6024a7c9ef1fbd694fa9bfd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.481018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-413869f2-0a97-41e7-971f-7bfa3cf87cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30a4258c6024a7c9ef1fbd694fa9bfd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.496009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1097/2195] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:36:13 2022] DELETE /identity/v3/users/c30a4258c6024a7c9ef1fbd694fa9bfd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:13.681636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24185d-4b91-4fe4-8feb-71b8264d5889 service swift] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:13.693114 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24185d-4b91-4fe4-8feb-71b8264d5889 service swift] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:13.773314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e6ac9-b440-4234-9850-57ad01708467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:13.774210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e6ac9-b440-4234-9850-57ad01708467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:13.774497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e6ac9-b440-4234-9850-57ad01708467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:13.774779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e6ac9-b440-4234-9850-57ad01708467 admin admin] PATH_INFO: `/v3/projects/1262e1a887bf44b0ae7fa8ac522e1250` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:13.776071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e6ac9-b440-4234-9850-57ad01708467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1262e1a887bf44b0ae7fa8ac522e1250)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:13.778074 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e6ac9-b440-4234-9850-57ad01708467 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:13.829491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-430e6ac9-b440-4234-9850-57ad01708467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1262e1a887bf44b0ae7fa8ac522e1250', 'request_id': 'req-430e6ac9-b440-4234-9850-57ad01708467'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.837960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-430e6ac9-b440-4234-9850-57ad01708467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1262e1a887bf44b0ae7fa8ac522e1250', 'request_id': 'req-430e6ac9-b440-4234-9850-57ad01708467'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.845632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-430e6ac9-b440-4234-9850-57ad01708467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1262e1a887bf44b0ae7fa8ac522e1250', 'request_id': 'req-430e6ac9-b440-4234-9850-57ad01708467'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.856539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-430e6ac9-b440-4234-9850-57ad01708467 admin admin] The token cache is being invalidate because project 1262e1a887bf44b0ae7fa8ac522e1250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:36:13.856789 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-430e6ac9-b440-4234-9850-57ad01708467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.857450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-430e6ac9-b440-4234-9850-57ad01708467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:13.859019 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1099/2196] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:36:13 2022] DELETE /identity/v3/projects/1262e1a887bf44b0ae7fa8ac522e1250 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:13.863874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c550e6-b7b7-4f45-a353-d52ee20afcdb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:13.864176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c550e6-b7b7-4f45-a353-d52ee20afcdb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:13.864459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c550e6-b7b7-4f45-a353-d52ee20afcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:13.889868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c2c550e6-b7b7-4f45-a353-d52ee20afcdb None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:13.891107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c2c550e6-b7b7-4f45-a353-d52ee20afcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:13.921549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:13.955214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1098/2197] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:13.963390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7e16c-2c00-4b9f-8fe4-b9face1d20ac None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:13.963683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7e16c-2c00-4b9f-8fe4-b9face1d20ac None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:13.963967 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7e16c-2c00-4b9f-8fe4-b9face1d20ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:13.983706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c4f7e16c-2c00-4b9f-8fe4-b9face1d20ac None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:13.984959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c4f7e16c-2c00-4b9f-8fe4-b9face1d20ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:13.993218 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1100/2198] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:13.997541 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c550e6-b7b7-4f45-a353-d52ee20afcdb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:14.008081 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c550e6-b7b7-4f45-a353-d52ee20afcdb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:14.013182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e5009-cadd-4f94-8e26-a96ff1caab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:14.013843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e5009-cadd-4f94-8e26-a96ff1caab2c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.014128 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e5009-cadd-4f94-8e26-a96ff1caab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.014406 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e5009-cadd-4f94-8e26-a96ff1caab2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.015175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e5009-cadd-4f94-8e26-a96ff1caab2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:36:14.015486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e5009-cadd-4f94-8e26-a96ff1caab2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:14.017149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e5009-cadd-4f94-8e26-a96ff1caab2c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:14.029874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1099/2199] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:36:14.035190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7e16c-2c00-4b9f-8fe4-b9face1d20ac None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:14.045799 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7e16c-2c00-4b9f-8fe4-b9face1d20ac None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:14.050511 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43202d-36e6-47db-b199-9d43d04f6ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:14.051169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43202d-36e6-47db-b199-9d43d04f6ade admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.051455 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43202d-36e6-47db-b199-9d43d04f6ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.051734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43202d-36e6-47db-b199-9d43d04f6ade admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.052430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43202d-36e6-47db-b199-9d43d04f6ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:14.055029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43202d-36e6-47db-b199-9d43d04f6ade admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:14.067974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:14.085595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1101/2200] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:36:14 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:14.086757 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e5009-cadd-4f94-8e26-a96ff1caab2c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:14.097519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e5009-cadd-4f94-8e26-a96ff1caab2c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:14.154997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aa003-2d76-44c1-8f3c-180eee9e0d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:14.155596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aa003-2d76-44c1-8f3c-180eee9e0d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.155887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aa003-2d76-44c1-8f3c-180eee9e0d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.156168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aa003-2d76-44c1-8f3c-180eee9e0d12 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.156893 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937aa003-2d76-44c1-8f3c-180eee9e0d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:14.158835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937aa003-2d76-44c1-8f3c-180eee9e0d12 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:14.180309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1100/2201] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:36:14 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:14.184474 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43202d-36e6-47db-b199-9d43d04f6ade admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:14.194738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43202d-36e6-47db-b199-9d43d04f6ade admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:14.199580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca04808-1fba-45cc-9e88-1e70d856bb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:14.200249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca04808-1fba-45cc-9e88-1e70d856bb21 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.200533 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca04808-1fba-45cc-9e88-1e70d856bb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.200842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca04808-1fba-45cc-9e88-1e70d856bb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.201572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca04808-1fba-45cc-9e88-1e70d856bb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:14.203198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca04808-1fba-45cc-9e88-1e70d856bb21 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:14.213874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1102/2202] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:14.217641 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aa003-2d76-44c1-8f3c-180eee9e0d12 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:14.228244 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aa003-2d76-44c1-8f3c-180eee9e0d12 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:14.232830 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55531f70-c694-4194-becf-876df1783ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:14.233482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55531f70-c694-4194-becf-876df1783ecf admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.233763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55531f70-c694-4194-becf-876df1783ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.234215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55531f70-c694-4194-becf-876df1783ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.234944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55531f70-c694-4194-becf-876df1783ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:14.236533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55531f70-c694-4194-becf-876df1783ecf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:14.247259 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1101/2203] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:36:14.251381 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca04808-1fba-45cc-9e88-1e70d856bb21 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:14.261990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca04808-1fba-45cc-9e88-1e70d856bb21 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:14.266766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b7dc7-8ef7-473d-b3a3-d7a01f23feee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:14.267671 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7dc7-8ef7-473d-b3a3-d7a01f23feee admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.267954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7dc7-8ef7-473d-b3a3-d7a01f23feee admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.268229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7dc7-8ef7-473d-b3a3-d7a01f23feee admin admin] PATH_INFO: `/v3/projects/2aed2ea0caae45a59e7c6c223cf8ae6f/users/b62ab9e1de45476e97163132ec43ff36/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.284515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b7dc7-8ef7-473d-b3a3-d7a01f23feee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aed2ea0caae45a59e7c6c223cf8ae6f, user_id=b62ab9e1de45476e97163132ec43ff36, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:14.287758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b7dc7-8ef7-473d-b3a3-d7a01f23feee admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:14.300663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1103/2204] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:36:14 2022] PUT /identity/v3/projects/2aed2ea0caae45a59e7c6c223cf8ae6f/users/b62ab9e1de45476e97163132ec43ff36/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:14.311331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58255b-6bda-48f4-aa7b-a2bb5c252ea2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.311625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58255b-6bda-48f4-aa7b-a2bb5c252ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.311906 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58255b-6bda-48f4-aa7b-a2bb5c252ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.338361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fc58255b-6bda-48f4-aa7b-a2bb5c252ea2 None None] MFA Rules not processed for user `b62ab9e1de45476e97163132ec43ff36`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:14.339553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fc58255b-6bda-48f4-aa7b-a2bb5c252ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:14.413939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1102/2205] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:36:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:14.425261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b7dc7-8ef7-473d-b3a3-d7a01f23feee admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:14.426948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4b7b7dc7-8ef7-473d-b3a3-d7a01f23feee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:14.503404 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b7dc7-8ef7-473d-b3a3-d7a01f23feee admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:14.507266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5c950-0c17-45e5-8600-af96f4323b28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e854100c04be43c78bce1f95ff85bfc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:14.508062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5c950-0c17-45e5-8600-af96f4323b28 service glance] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.508346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5c950-0c17-45e5-8600-af96f4323b28 service glance] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.508623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5c950-0c17-45e5-8600-af96f4323b28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.517198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5c950-0c17-45e5-8600-af96f4323b28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:14.518613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5c950-0c17-45e5-8600-af96f4323b28 service glance] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:14.528184 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1104/2206] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:36:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:23.988450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58255b-6bda-48f4-aa7b-a2bb5c252ea2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:23.990163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fc58255b-6bda-48f4-aa7b-a2bb5c252ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:24.025540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:24.065165 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58255b-6bda-48f4-aa7b-a2bb5c252ea2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:24.070165 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:24.071117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:24.071403 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:24.071679 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] PATH_INFO: `/v3/users/914750180edc4d2c8886a58ad86c4784` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:24.072963 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=914750180edc4d2c8886a58ad86c4784)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:24.075416 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:24.125801 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914750180edc4d2c8886a58ad86c4784'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:24.126465 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914750180edc4d2c8886a58ad86c4784'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:24.127160 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914750180edc4d2c8886a58ad86c4784'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:24.143327 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914750180edc4d2c8886a58ad86c4784'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:24.151553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914750180edc4d2c8886a58ad86c4784'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:24.163599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1103/2207] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:36:23 2022] DELETE /identity/v3/users/914750180edc4d2c8886a58ad86c4784 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:24.168742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7f055-914a-4982-8885-0039d21c3498 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:24.169229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7f055-914a-4982-8885-0039d21c3498 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:24.169377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7f055-914a-4982-8885-0039d21c3498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:24.187765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7cf7f055-914a-4982-8885-0039d21c3498 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:24.188943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7cf7f055-914a-4982-8885-0039d21c3498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:24.254463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1105/2208] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:24.265473 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:24.267012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:24.327512 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f8def-7d5c-40ac-b479-63e9e5032442 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:24.331207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9f7df-c7fe-4f6a-a389-348947149761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:24.331862 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9f7df-c7fe-4f6a-a389-348947149761 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:24.332149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9f7df-c7fe-4f6a-a389-348947149761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:24.332438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9f7df-c7fe-4f6a-a389-348947149761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:24.341895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9f7df-c7fe-4f6a-a389-348947149761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:24.343339 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9f7df-c7fe-4f6a-a389-348947149761 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:24.352913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1104/2209] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:24.631666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7f055-914a-4982-8885-0039d21c3498 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:24.633866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7cf7f055-914a-4982-8885-0039d21c3498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:24.646000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7f055-914a-4982-8885-0039d21c3498 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:24.652466 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b136f6-37c6-470a-a625-4417f37a5d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:24.653563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b136f6-37c6-470a-a625-4417f37a5d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:24.653912 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b136f6-37c6-470a-a625-4417f37a5d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:24.654282 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b136f6-37c6-470a-a625-4417f37a5d55 admin admin] PATH_INFO: `/v3/projects/8b599d6d0e894faea1bee29db795b727` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:24.655568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b136f6-37c6-470a-a625-4417f37a5d55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b599d6d0e894faea1bee29db795b727)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:24.657976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b136f6-37c6-470a-a625-4417f37a5d55 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:24.700978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:24.711926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d3b136f6-37c6-470a-a625-4417f37a5d55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b599d6d0e894faea1bee29db795b727', 'request_id': 'req-d3b136f6-37c6-470a-a625-4417f37a5d55'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:24.719159 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d3b136f6-37c6-470a-a625-4417f37a5d55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b599d6d0e894faea1bee29db795b727', 'request_id': 'req-d3b136f6-37c6-470a-a625-4417f37a5d55'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:24.725967 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d3b136f6-37c6-470a-a625-4417f37a5d55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b599d6d0e894faea1bee29db795b727', 'request_id': 'req-d3b136f6-37c6-470a-a625-4417f37a5d55'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:24.738573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d3b136f6-37c6-470a-a625-4417f37a5d55 admin admin] The token cache is being invalidate because project 8b599d6d0e894faea1bee29db795b727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:36:24.738866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d3b136f6-37c6-470a-a625-4417f37a5d55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:24.739521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d3b136f6-37c6-470a-a625-4417f37a5d55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:36:24.741115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1106/2210] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:36:24 2022] DELETE /identity/v3/projects/8b599d6d0e894faea1bee29db795b727 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:24.746953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d8a0e-1431-4449-b98d-8d46ce5eff34 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:24.747250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d8a0e-1431-4449-b98d-8d46ce5eff34 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:24.747531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d8a0e-1431-4449-b98d-8d46ce5eff34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:24.765834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-110d8a0e-1431-4449-b98d-8d46ce5eff34 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:24.767033 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-110d8a0e-1431-4449-b98d-8d46ce5eff34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:24.816066 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:24.835082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1105/2211] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:24.843802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215640-7cd7-49d0-b463-54a67a5d13e9 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:24.844094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215640-7cd7-49d0-b463-54a67a5d13e9 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:24.844375 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215640-7cd7-49d0-b463-54a67a5d13e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:24.863396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-aa215640-7cd7-49d0-b463-54a67a5d13e9 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:24.864598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-aa215640-7cd7-49d0-b463-54a67a5d13e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:24.874205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1107/2212] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:24.878457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d8a0e-1431-4449-b98d-8d46ce5eff34 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:24.888671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d8a0e-1431-4449-b98d-8d46ce5eff34 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:24.893619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b4d19-2b26-408e-a603-6501bba8431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:24.894290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b4d19-2b26-408e-a603-6501bba8431c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:24.894575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b4d19-2b26-408e-a603-6501bba8431c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:24.894854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b4d19-2b26-408e-a603-6501bba8431c admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:24.895597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b4d19-2b26-408e-a603-6501bba8431c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:36:24.895913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b4d19-2b26-408e-a603-6501bba8431c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:24.897563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b4d19-2b26-408e-a603-6501bba8431c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:24.909856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1106/2213] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:36:24.914048 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa215640-7cd7-49d0-b463-54a67a5d13e9 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:24.923986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa215640-7cd7-49d0-b463-54a67a5d13e9 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:24.928814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec079d7-83e0-42c7-8c1f-8517aac000aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:24.929480 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec079d7-83e0-42c7-8c1f-8517aac000aa admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:24.930360 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec079d7-83e0-42c7-8c1f-8517aac000aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:24.930632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec079d7-83e0-42c7-8c1f-8517aac000aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:24.931334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec079d7-83e0-42c7-8c1f-8517aac000aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:24.933279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec079d7-83e0-42c7-8c1f-8517aac000aa admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:24.959386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1108/2214] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:36:24 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:24.963854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b4d19-2b26-408e-a603-6501bba8431c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:24.974159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b4d19-2b26-408e-a603-6501bba8431c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:25.032587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65106cf8-23a0-48af-902f-fbd9c861059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:25.033296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106cf8-23a0-48af-902f-fbd9c861059b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:25.033584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106cf8-23a0-48af-902f-fbd9c861059b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:25.033866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106cf8-23a0-48af-902f-fbd9c861059b admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:25.034570 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65106cf8-23a0-48af-902f-fbd9c861059b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:25.036503 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65106cf8-23a0-48af-902f-fbd9c861059b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:25.057362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1107/2215] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:36:24 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:25.061531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec079d7-83e0-42c7-8c1f-8517aac000aa admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:25.072613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec079d7-83e0-42c7-8c1f-8517aac000aa admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:25.077368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b566c0-3947-4a2a-abac-7caf6ff8a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:25.078129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b566c0-3947-4a2a-abac-7caf6ff8a68c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:25.078434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b566c0-3947-4a2a-abac-7caf6ff8a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:25.078721 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b566c0-3947-4a2a-abac-7caf6ff8a68c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:25.079519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b566c0-3947-4a2a-abac-7caf6ff8a68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:25.081156 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b566c0-3947-4a2a-abac-7caf6ff8a68c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:25.091758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1109/2216] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:25.096006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65106cf8-23a0-48af-902f-fbd9c861059b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:25.106565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65106cf8-23a0-48af-902f-fbd9c861059b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:25.111217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea844d9-27c5-4fb3-960a-9d6295ea375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:25.111882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea844d9-27c5-4fb3-960a-9d6295ea375d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:25.112168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea844d9-27c5-4fb3-960a-9d6295ea375d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:25.112443 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea844d9-27c5-4fb3-960a-9d6295ea375d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:25.113215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea844d9-27c5-4fb3-960a-9d6295ea375d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:25.114818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea844d9-27c5-4fb3-960a-9d6295ea375d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:25.125616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1108/2217] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:36:25.129656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b566c0-3947-4a2a-abac-7caf6ff8a68c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:25.141568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b566c0-3947-4a2a-abac-7caf6ff8a68c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:25.146279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0501ec-8a9b-4ffc-a46b-9b66ef0c121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:25.147240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0501ec-8a9b-4ffc-a46b-9b66ef0c121b admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:25.147506 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0501ec-8a9b-4ffc-a46b-9b66ef0c121b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:25.147786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0501ec-8a9b-4ffc-a46b-9b66ef0c121b admin admin] PATH_INFO: `/v3/projects/ce0de5263b784723aca0332e63f6309e/users/a068f31da9dc4b589e649e4ec5cf713f/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:25.162724 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0501ec-8a9b-4ffc-a46b-9b66ef0c121b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0de5263b784723aca0332e63f6309e, user_id=a068f31da9dc4b589e649e4ec5cf713f, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:25.165814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0501ec-8a9b-4ffc-a46b-9b66ef0c121b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:25.181229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1110/2218] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:36:25 2022] PUT /identity/v3/projects/ce0de5263b784723aca0332e63f6309e/users/a068f31da9dc4b589e649e4ec5cf713f/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:25.186254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3383e1-4a76-4c30-8c73-82fec97fa8a3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:25.186565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3383e1-4a76-4c30-8c73-82fec97fa8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:25.186854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3383e1-4a76-4c30-8c73-82fec97fa8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:25.206079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0a3383e1-4a76-4c30-8c73-82fec97fa8a3 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:25.207283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0a3383e1-4a76-4c30-8c73-82fec97fa8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:25.267216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1109/2219] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:25.277649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0501ec-8a9b-4ffc-a46b-9b66ef0c121b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:25.279503 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6b0501ec-8a9b-4ffc-a46b-9b66ef0c121b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:25.338105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0501ec-8a9b-4ffc-a46b-9b66ef0c121b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:25.341854 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9397a-47f2-4026-bec9-721c732b7f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:25.342505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9397a-47f2-4026-bec9-721c732b7f42 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:25.342791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9397a-47f2-4026-bec9-721c732b7f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:25.343080 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9397a-47f2-4026-bec9-721c732b7f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:25.353129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9397a-47f2-4026-bec9-721c732b7f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:25.355013 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9397a-47f2-4026-bec9-721c732b7f42 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:25.365277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1111/2220] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:30.409987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1ced8-052b-45cf-b67f-5f7982ba8d26 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:30.410426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1ced8-052b-45cf-b67f-5f7982ba8d26 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:30.410547 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1ced8-052b-45cf-b67f-5f7982ba8d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:30.445920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-44f1ced8-052b-45cf-b67f-5f7982ba8d26 None None] MFA Rules not processed for user `a068f31da9dc4b589e649e4ec5cf713f`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:30.447931 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-44f1ced8-052b-45cf-b67f-5f7982ba8d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:30.501554 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:30.525909 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1110/2221] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:36:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:30.529912 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9397a-47f2-4026-bec9-721c732b7f42 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:30.543429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9397a-47f2-4026-bec9-721c732b7f42 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:30.548657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667b626-28e3-4be9-99b0-0e94fa8a653a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:30.549345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b626-28e3-4be9-99b0-0e94fa8a653a admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:30.549628 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b626-28e3-4be9-99b0-0e94fa8a653a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:30.549905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667b626-28e3-4be9-99b0-0e94fa8a653a admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:30.550737 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667b626-28e3-4be9-99b0-0e94fa8a653a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:30.552664 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667b626-28e3-4be9-99b0-0e94fa8a653a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:30.588698 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1112/2222] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:36:30 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:30.594060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1ced8-052b-45cf-b67f-5f7982ba8d26 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:30.606630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1ced8-052b-45cf-b67f-5f7982ba8d26 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:30.680106 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066936d8-3879-47b1-a519-bb919f330b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:30.681660 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066936d8-3879-47b1-a519-bb919f330b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:30.682049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066936d8-3879-47b1-a519-bb919f330b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:30.682326 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066936d8-3879-47b1-a519-bb919f330b74 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:30.683021 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066936d8-3879-47b1-a519-bb919f330b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:30.685057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066936d8-3879-47b1-a519-bb919f330b74 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:30.704663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1111/2223] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:36:30 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:36:30.708554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667b626-28e3-4be9-99b0-0e94fa8a653a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:30.718801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667b626-28e3-4be9-99b0-0e94fa8a653a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:30.723432 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791ec88-0bea-4674-8467-60c106980ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:30.724084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791ec88-0bea-4674-8467-60c106980ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:30.724366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791ec88-0bea-4674-8467-60c106980ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:30.724645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791ec88-0bea-4674-8467-60c106980ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:30.725398 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791ec88-0bea-4674-8467-60c106980ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:30.726980 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791ec88-0bea-4674-8467-60c106980ce6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:30.737972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1113/2224] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:30.741881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066936d8-3879-47b1-a519-bb919f330b74 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:30.752587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066936d8-3879-47b1-a519-bb919f330b74 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:30.757147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c72c77-4ed4-45ff-8ac7-d6d8e9df3992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:30.758020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c72c77-4ed4-45ff-8ac7-d6d8e9df3992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:30.758296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c72c77-4ed4-45ff-8ac7-d6d8e9df3992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:30.758634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c72c77-4ed4-45ff-8ac7-d6d8e9df3992 admin admin] PATH_INFO: `/v3/projects/dd7fec8f753c4b86a6dc783a1eb9dbc3/users/cca38195d88b44fa92032dc6401d4cea/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:30.773742 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c72c77-4ed4-45ff-8ac7-d6d8e9df3992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7fec8f753c4b86a6dc783a1eb9dbc3, user_id=cca38195d88b44fa92032dc6401d4cea, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:30.777105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c72c77-4ed4-45ff-8ac7-d6d8e9df3992 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:30.791470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1112/2225] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:36:30 2022] PUT /identity/v3/projects/dd7fec8f753c4b86a6dc783a1eb9dbc3/users/cca38195d88b44fa92032dc6401d4cea/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:30.795390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791ec88-0bea-4674-8467-60c106980ce6 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:30.805319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791ec88-0bea-4674-8467-60c106980ce6 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:30.834867 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:30.871555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b87491-517a-4f6a-b9ae-d27119e62d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:30.872261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b87491-517a-4f6a-b9ae-d27119e62d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:30.872473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b87491-517a-4f6a-b9ae-d27119e62d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:30.872820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b87491-517a-4f6a-b9ae-d27119e62d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:30.873554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b87491-517a-4f6a-b9ae-d27119e62d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:30.875102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b87491-517a-4f6a-b9ae-d27119e62d3c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:30.893268 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1114/2226] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:36:30.898112 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c72c77-4ed4-45ff-8ac7-d6d8e9df3992 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:30.909425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c72c77-4ed4-45ff-8ac7-d6d8e9df3992 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:30.914128 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cc8a4-3634-4259-8e5b-c9deacb20209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:30.915785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cc8a4-3634-4259-8e5b-c9deacb20209 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:30.916217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cc8a4-3634-4259-8e5b-c9deacb20209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:30.916501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cc8a4-3634-4259-8e5b-c9deacb20209 admin admin] PATH_INFO: `/v3/projects/dd7fec8f753c4b86a6dc783a1eb9dbc3/users/cca38195d88b44fa92032dc6401d4cea/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:30.918588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cc8a4-3634-4259-8e5b-c9deacb20209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7fec8f753c4b86a6dc783a1eb9dbc3, user_id=cca38195d88b44fa92032dc6401d4cea, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:30.921309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cc8a4-3634-4259-8e5b-c9deacb20209 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:30.932419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1113/2227] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:36:30 2022] PUT /identity/v3/projects/dd7fec8f753c4b86a6dc783a1eb9dbc3/users/cca38195d88b44fa92032dc6401d4cea/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:36:35.960123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a5201-ac28-4059-b1c9-1af144023030 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:35.960646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a5201-ac28-4059-b1c9-1af144023030 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:35.960774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a5201-ac28-4059-b1c9-1af144023030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:35.988859 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ad2a5201-ac28-4059-b1c9-1af144023030 None None] MFA Rules not processed for user `cca38195d88b44fa92032dc6401d4cea`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:35.990001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ad2a5201-ac28-4059-b1c9-1af144023030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:36.063490 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1115/2228] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:36:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:36.078303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cc8a4-3634-4259-8e5b-c9deacb20209 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:36.080019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7a6cc8a4-3634-4259-8e5b-c9deacb20209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:36.155047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cc8a4-3634-4259-8e5b-c9deacb20209 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:36.160449 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157c9b4-1763-4143-bfc0-7778f951d941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:36.161116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157c9b4-1763-4143-bfc0-7778f951d941 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:36.161400 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157c9b4-1763-4143-bfc0-7778f951d941 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:36.161674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157c9b4-1763-4143-bfc0-7778f951d941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:36.194619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:36.218141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157c9b4-1763-4143-bfc0-7778f951d941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:36.219777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157c9b4-1763-4143-bfc0-7778f951d941 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:36.229679 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1114/2229] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:36:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:37.320339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2fb86-7b84-4b2d-bd3f-0494164499c8 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:37.320919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2fb86-7b84-4b2d-bd3f-0494164499c8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:37.321018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2fb86-7b84-4b2d-bd3f-0494164499c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:37.338587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-38a2fb86-7b84-4b2d-bd3f-0494164499c8 None None] MFA Rules not processed for user `a068f31da9dc4b589e649e4ec5cf713f`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:37.339771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-38a2fb86-7b84-4b2d-bd3f-0494164499c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:37.346496 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1116/2230] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:36:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:46.224997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=11 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:47.333491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=52 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:06.677766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157c9b4-1763-4143-bfc0-7778f951d941 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:06.679444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8157c9b4-1763-4143-bfc0-7778f951d941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:06.744277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157c9b4-1763-4143-bfc0-7778f951d941 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:06.749180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:06.750122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:06.750472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:06.750817 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] PATH_INFO: `/v3/users/b62ab9e1de45476e97163132ec43ff36` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:06.752079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62ab9e1de45476e97163132ec43ff36)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:06.754021 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:06.801727 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62ab9e1de45476e97163132ec43ff36'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:06.802369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62ab9e1de45476e97163132ec43ff36'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:06.802957 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62ab9e1de45476e97163132ec43ff36'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:06.814586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62ab9e1de45476e97163132ec43ff36'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:06.821571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62ab9e1de45476e97163132ec43ff36'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:06.834133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1115/2231] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:37:06 2022] DELETE /identity/v3/users/b62ab9e1de45476e97163132ec43ff36 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:37:06.838569 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741383a0-847e-4fd9-8b2b-52b68ecd3e30 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:06.839057 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741383a0-847e-4fd9-8b2b-52b68ecd3e30 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:06.839158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741383a0-847e-4fd9-8b2b-52b68ecd3e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:06.857792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-741383a0-847e-4fd9-8b2b-52b68ecd3e30 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:06.858988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-741383a0-847e-4fd9-8b2b-52b68ecd3e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:06.924463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1117/2232] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:06.933998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:06.935745 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:06.999689 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61a281-e805-4364-a309-c479a7e94585 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:07.003573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2f8e0-75b5-493d-8612-36c1cd67d19a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:07.004241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2f8e0-75b5-493d-8612-36c1cd67d19a service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:07.004518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2f8e0-75b5-493d-8612-36c1cd67d19a service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:07.004826 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2f8e0-75b5-493d-8612-36c1cd67d19a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:07.014775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2f8e0-75b5-493d-8612-36c1cd67d19a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:07.016228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2f8e0-75b5-493d-8612-36c1cd67d19a service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:07.026750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1116/2233] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:07.306658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741383a0-847e-4fd9-8b2b-52b68ecd3e30 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:07.308116 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-741383a0-847e-4fd9-8b2b-52b68ecd3e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:07.319966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741383a0-847e-4fd9-8b2b-52b68ecd3e30 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:07.324974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83b96d-4708-4aef-ae98-9f6705aceeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:07.327372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83b96d-4708-4aef-ae98-9f6705aceeeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:07.327724 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83b96d-4708-4aef-ae98-9f6705aceeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:07.328221 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83b96d-4708-4aef-ae98-9f6705aceeeb admin admin] PATH_INFO: `/v3/projects/2aed2ea0caae45a59e7c6c223cf8ae6f` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:07.330006 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83b96d-4708-4aef-ae98-9f6705aceeeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aed2ea0caae45a59e7c6c223cf8ae6f)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:07.332327 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83b96d-4708-4aef-ae98-9f6705aceeeb admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:07.380111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6b83b96d-4708-4aef-ae98-9f6705aceeeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aed2ea0caae45a59e7c6c223cf8ae6f', 'request_id': 'req-6b83b96d-4708-4aef-ae98-9f6705aceeeb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:07.388023 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6b83b96d-4708-4aef-ae98-9f6705aceeeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aed2ea0caae45a59e7c6c223cf8ae6f', 'request_id': 'req-6b83b96d-4708-4aef-ae98-9f6705aceeeb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:07.394714 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6b83b96d-4708-4aef-ae98-9f6705aceeeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aed2ea0caae45a59e7c6c223cf8ae6f', 'request_id': 'req-6b83b96d-4708-4aef-ae98-9f6705aceeeb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:07.405951 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6b83b96d-4708-4aef-ae98-9f6705aceeeb admin admin] The token cache is being invalidate because project 2aed2ea0caae45a59e7c6c223cf8ae6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:37:07.406243 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6b83b96d-4708-4aef-ae98-9f6705aceeeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:07.406903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6b83b96d-4708-4aef-ae98-9f6705aceeeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:07.408447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1118/2234] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:37:07 2022] DELETE /identity/v3/projects/2aed2ea0caae45a59e7c6c223cf8ae6f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:37:07.413496 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b87a8-59ab-4cf4-be50-95408db38a08 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:07.413793 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b87a8-59ab-4cf4-be50-95408db38a08 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:07.414151 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b87a8-59ab-4cf4-be50-95408db38a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:07.433392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0e5b87a8-59ab-4cf4-be50-95408db38a08 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:07.435242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0e5b87a8-59ab-4cf4-be50-95408db38a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:07.452430 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:07.495644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1117/2235] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:07.503886 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faaacb-5995-4a00-8d37-3853a1bd99b2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:07.504177 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faaacb-5995-4a00-8d37-3853a1bd99b2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:07.504462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faaacb-5995-4a00-8d37-3853a1bd99b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:07.523437 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-48faaacb-5995-4a00-8d37-3853a1bd99b2 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:07.524638 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-48faaacb-5995-4a00-8d37-3853a1bd99b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:07.532758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1119/2236] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:07.537149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b87a8-59ab-4cf4-be50-95408db38a08 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:07.546892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b87a8-59ab-4cf4-be50-95408db38a08 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:07.551396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e426c25-3776-4573-8856-e5dcb0eb8905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:07.552069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e426c25-3776-4573-8856-e5dcb0eb8905 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:07.552348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e426c25-3776-4573-8856-e5dcb0eb8905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:07.552619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e426c25-3776-4573-8856-e5dcb0eb8905 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:07.553373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e426c25-3776-4573-8856-e5dcb0eb8905 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:37:07.553681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e426c25-3776-4573-8856-e5dcb0eb8905 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:07.555267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e426c25-3776-4573-8856-e5dcb0eb8905 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:07.567132 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1118/2237] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:37:07.571401 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faaacb-5995-4a00-8d37-3853a1bd99b2 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:07.581283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faaacb-5995-4a00-8d37-3853a1bd99b2 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:07.585947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739e3e7-18a1-483d-be18-951635ae1a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:07.586588 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739e3e7-18a1-483d-be18-951635ae1a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:07.586877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739e3e7-18a1-483d-be18-951635ae1a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:07.587156 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739e3e7-18a1-483d-be18-951635ae1a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:07.587874 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739e3e7-18a1-483d-be18-951635ae1a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:07.589816 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739e3e7-18a1-483d-be18-951635ae1a55 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:07.614519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1120/2238] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:37:07 2022] POST /identity/v3/projects => generated 397 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:37:07.618628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e426c25-3776-4573-8856-e5dcb0eb8905 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:07.629118 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e426c25-3776-4573-8856-e5dcb0eb8905 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:07.686568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe88e2-c7ad-42f5-b844-ef8ad1aa7ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:07.687181 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe88e2-c7ad-42f5-b844-ef8ad1aa7ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:07.687458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe88e2-c7ad-42f5-b844-ef8ad1aa7ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:07.687727 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe88e2-c7ad-42f5-b844-ef8ad1aa7ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:07.688424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe88e2-c7ad-42f5-b844-ef8ad1aa7ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:07.690380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe88e2-c7ad-42f5-b844-ef8ad1aa7ad9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:07.709701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1119/2239] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:37:07 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:37:07.713926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739e3e7-18a1-483d-be18-951635ae1a55 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:07.724999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739e3e7-18a1-483d-be18-951635ae1a55 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:07.731366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c5ecc-1de2-439c-8398-492bae8f1218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:07.732658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5ecc-1de2-439c-8398-492bae8f1218 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:07.732976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5ecc-1de2-439c-8398-492bae8f1218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:07.733254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c5ecc-1de2-439c-8398-492bae8f1218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:07.733978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c5ecc-1de2-439c-8398-492bae8f1218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:07.735572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c5ecc-1de2-439c-8398-492bae8f1218 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:07.745826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1121/2240] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:37:07.751036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe88e2-c7ad-42f5-b844-ef8ad1aa7ad9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:07.764200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe88e2-c7ad-42f5-b844-ef8ad1aa7ad9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:07.769842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8f5fb-5921-4012-8bd6-3c7e5b1295b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:07.770509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8f5fb-5921-4012-8bd6-3c7e5b1295b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:07.770795 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8f5fb-5921-4012-8bd6-3c7e5b1295b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:07.771073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8f5fb-5921-4012-8bd6-3c7e5b1295b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:07.771802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8f5fb-5921-4012-8bd6-3c7e5b1295b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:07.773441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8f5fb-5921-4012-8bd6-3c7e5b1295b6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:07.784117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1120/2241] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:37:07.788298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c5ecc-1de2-439c-8398-492bae8f1218 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:07.800433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c5ecc-1de2-439c-8398-492bae8f1218 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:07.805578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519e5c5-15eb-4253-a611-ebce2425343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:07.806674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519e5c5-15eb-4253-a611-ebce2425343e admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:07.807110 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519e5c5-15eb-4253-a611-ebce2425343e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:07.807478 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519e5c5-15eb-4253-a611-ebce2425343e admin admin] PATH_INFO: `/v3/projects/7a1372a7d21f4e0c9ecc8b34478a1fd3/users/d4c59262756947e3bc13836ad08a3390/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:07.824164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519e5c5-15eb-4253-a611-ebce2425343e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a1372a7d21f4e0c9ecc8b34478a1fd3, user_id=d4c59262756947e3bc13836ad08a3390, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:07.827333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519e5c5-15eb-4253-a611-ebce2425343e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:07.843825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1122/2242] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:37:07 2022] PUT /identity/v3/projects/7a1372a7d21f4e0c9ecc8b34478a1fd3/users/d4c59262756947e3bc13836ad08a3390/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:37:07.854011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1cb10-319c-414f-8a04-f7be8639dd27 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:07.854301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1cb10-319c-414f-8a04-f7be8639dd27 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:07.854577 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1cb10-319c-414f-8a04-f7be8639dd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:07.881552 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-78e1cb10-319c-414f-8a04-f7be8639dd27 None None] MFA Rules not processed for user `d4c59262756947e3bc13836ad08a3390`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:07.882776 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-78e1cb10-319c-414f-8a04-f7be8639dd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:07.947324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1121/2243] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:37:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:07.959417 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519e5c5-15eb-4253-a611-ebce2425343e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:07.961118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1519e5c5-15eb-4253-a611-ebce2425343e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:07.983469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:08.019987 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519e5c5-15eb-4253-a611-ebce2425343e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:08.023845 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aac33e-70cd-4022-ad42-7e62fbb042b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:08.024489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aac33e-70cd-4022-ad42-7e62fbb042b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:08.024805 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aac33e-70cd-4022-ad42-7e62fbb042b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:08.025090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aac33e-70cd-4022-ad42-7e62fbb042b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:08.033470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aac33e-70cd-4022-ad42-7e62fbb042b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:08.034906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aac33e-70cd-4022-ad42-7e62fbb042b3 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:08.046566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1123/2244] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:37:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:13.482250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc09b0-5219-4cc1-9262-4467463976ee None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:13.482741 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc09b0-5219-4cc1-9262-4467463976ee None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:13.482838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc09b0-5219-4cc1-9262-4467463976ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:13.500256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-bddc09b0-5219-4cc1-9262-4467463976ee None None] MFA Rules not processed for user `7b14606965a74c71881595c71bdd2d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:13.501494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bddc09b0-5219-4cc1-9262-4467463976ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:13.513601 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:13.565267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1122/2245] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:37:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:18.040464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=17 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:19.263352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aac33e-70cd-4022-ad42-7e62fbb042b3 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:19.341423 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aac33e-70cd-4022-ad42-7e62fbb042b3 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:19.346096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:19.346991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:19.347279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:19.347560 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] PATH_INFO: `/v3/users/d4c59262756947e3bc13836ad08a3390` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:19.348813 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c59262756947e3bc13836ad08a3390)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:19.350769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:19.404035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c59262756947e3bc13836ad08a3390'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:19.404796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c59262756947e3bc13836ad08a3390'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:19.405334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c59262756947e3bc13836ad08a3390'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:19.419448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c59262756947e3bc13836ad08a3390'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:19.427890 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c59262756947e3bc13836ad08a3390'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:19.444102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1124/2246] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:37:19 2022] DELETE /identity/v3/users/d4c59262756947e3bc13836ad08a3390 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:37:19.450488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f1031-d346-4512-a7c5-6dd0517b790f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:19.451008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f1031-d346-4512-a7c5-6dd0517b790f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:19.451094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f1031-d346-4512-a7c5-6dd0517b790f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:19.470335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-cb0f1031-d346-4512-a7c5-6dd0517b790f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:19.471563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cb0f1031-d346-4512-a7c5-6dd0517b790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:19.532775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1123/2247] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:19.544468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:19.545958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:19.608472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7127e95-5cf2-46c3-bd99-15e2d9e9e1b7 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:19.612235 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ebd98-9c74-4a17-9e93-b6da3abe026a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:19.612920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ebd98-9c74-4a17-9e93-b6da3abe026a service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:19.613210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ebd98-9c74-4a17-9e93-b6da3abe026a service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:19.613497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ebd98-9c74-4a17-9e93-b6da3abe026a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:19.623086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ebd98-9c74-4a17-9e93-b6da3abe026a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:19.624984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ebd98-9c74-4a17-9e93-b6da3abe026a service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:19.634287 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1125/2248] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:20.112580 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f1031-d346-4512-a7c5-6dd0517b790f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:20.114055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cb0f1031-d346-4512-a7c5-6dd0517b790f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:20.126694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f1031-d346-4512-a7c5-6dd0517b790f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:20.132611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:20.133782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:20.135433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:20.135433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] PATH_INFO: `/v3/projects/7a1372a7d21f4e0c9ecc8b34478a1fd3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:20.136892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a1372a7d21f4e0c9ecc8b34478a1fd3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:20.139039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:20.211154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a1372a7d21f4e0c9ecc8b34478a1fd3', 'request_id': 'req-2f4789f0-39ba-42d7-ad8e-5098ad455318'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:20.221163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a1372a7d21f4e0c9ecc8b34478a1fd3', 'request_id': 'req-2f4789f0-39ba-42d7-ad8e-5098ad455318'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:20.228818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a1372a7d21f4e0c9ecc8b34478a1fd3', 'request_id': 'req-2f4789f0-39ba-42d7-ad8e-5098ad455318'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:20.240581 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] The token cache is being invalidate because project 7a1372a7d21f4e0c9ecc8b34478a1fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:37:20.241027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:20.241722 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:37:20.244863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1124/2249] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:37:20 2022] DELETE /identity/v3/projects/7a1372a7d21f4e0c9ecc8b34478a1fd3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:37:25.949375 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ebd98-9c74-4a17-9e93-b6da3abe026a service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:25.951484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-735ebd98-9c74-4a17-9e93-b6da3abe026a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:25.963178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ebd98-9c74-4a17-9e93-b6da3abe026a service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:25.982801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:26.017153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8eabd6-9484-4f50-b603-b027925a9c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:26.018321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8eabd6-9484-4f50-b603-b027925a9c42 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:26.018608 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8eabd6-9484-4f50-b603-b027925a9c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:26.018881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8eabd6-9484-4f50-b603-b027925a9c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:26.020654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ea8eabd6-9484-4f50-b603-b027925a9c42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:26.098920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8eabd6-9484-4f50-b603-b027925a9c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:26.100362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8eabd6-9484-4f50-b603-b027925a9c42 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:26.112387 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1126/2250] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:37:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:37:26.255687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:26.257438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:26.270412 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4789f0-39ba-42d7-ad8e-5098ad455318 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:26.274100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466cc2e-5a75-434a-a5d6-5f465798eb47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:26.274756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cc2e-5a75-434a-a5d6-5f465798eb47 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:26.275041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cc2e-5a75-434a-a5d6-5f465798eb47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:26.275318 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466cc2e-5a75-434a-a5d6-5f465798eb47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:26.277150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1466cc2e-5a75-434a-a5d6-5f465798eb47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:26.292283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466cc2e-5a75-434a-a5d6-5f465798eb47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:26.294352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466cc2e-5a75-434a-a5d6-5f465798eb47 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:26.311831 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1125/2251] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:37:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:37:33.408516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345606c-ad5c-42fc-a9b7-9583bb1e32db None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:33.409074 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345606c-ad5c-42fc-a9b7-9583bb1e32db None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:33.409169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345606c-ad5c-42fc-a9b7-9583bb1e32db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:33.431237 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6345606c-ad5c-42fc-a9b7-9583bb1e32db None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:33.432465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6345606c-ad5c-42fc-a9b7-9583bb1e32db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:33.505572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1127/2252] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:37:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:33.551903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466cc2e-5a75-434a-a5d6-5f465798eb47 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:33.553374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1466cc2e-5a75-434a-a5d6-5f465798eb47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:33.592905 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:33.644546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466cc2e-5a75-434a-a5d6-5f465798eb47 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:33.651614 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98ba8e-638c-4d89-aed9-3bf36b0305c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:33.652313 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98ba8e-638c-4d89-aed9-3bf36b0305c0 service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:33.652596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98ba8e-638c-4d89-aed9-3bf36b0305c0 service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:33.653516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98ba8e-638c-4d89-aed9-3bf36b0305c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:33.664142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98ba8e-638c-4d89-aed9-3bf36b0305c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:33.666152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98ba8e-638c-4d89-aed9-3bf36b0305c0 service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:33.676206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1126/2253] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:37:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:37:43.498873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=69 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:43.672063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=17 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:44.531300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345606c-ad5c-42fc-a9b7-9583bb1e32db None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:44.542941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345606c-ad5c-42fc-a9b7-9583bb1e32db None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:44.551465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a6679-33ba-4c0a-abe7-703c721f5fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:44.552765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a6679-33ba-4c0a-abe7-703c721f5fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:44.552765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a6679-33ba-4c0a-abe7-703c721f5fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:44.552765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a6679-33ba-4c0a-abe7-703c721f5fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:44.556837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dd2a6679-33ba-4c0a-abe7-703c721f5fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:44.581353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a6679-33ba-4c0a-abe7-703c721f5fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:44.582789 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a6679-33ba-4c0a-abe7-703c721f5fb2 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:44.592575 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1128/2254] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:37:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:45.922680 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98ba8e-638c-4d89-aed9-3bf36b0305c0 service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:45.924143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4a98ba8e-638c-4d89-aed9-3bf36b0305c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:45.939868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98ba8e-638c-4d89-aed9-3bf36b0305c0 service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:45.945278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6c8e6-ea01-41e7-89cb-9c3fa14476a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:45.945914 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6c8e6-ea01-41e7-89cb-9c3fa14476a6 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:45.946194 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6c8e6-ea01-41e7-89cb-9c3fa14476a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:45.946469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6c8e6-ea01-41e7-89cb-9c3fa14476a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:45.948178 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a7e6c8e6-ea01-41e7-89cb-9c3fa14476a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:46.006549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6c8e6-ea01-41e7-89cb-9c3fa14476a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:46.008067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6c8e6-ea01-41e7-89cb-9c3fa14476a6 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:46.018027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1127/2255] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:37:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:48.427288 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a6679-33ba-4c0a-abe7-703c721f5fb2 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:48.429028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-dd2a6679-33ba-4c0a-abe7-703c721f5fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:48.440285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a6679-33ba-4c0a-abe7-703c721f5fb2 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:48.444533 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cd320-a87b-46b9-8004-446875e9836e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:48.445248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cd320-a87b-46b9-8004-446875e9836e service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:48.445550 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cd320-a87b-46b9-8004-446875e9836e service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:48.445848 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cd320-a87b-46b9-8004-446875e9836e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:48.447738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-aa1cd320-a87b-46b9-8004-446875e9836e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:48.527290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cd320-a87b-46b9-8004-446875e9836e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:48.528904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cd320-a87b-46b9-8004-446875e9836e service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:48.539221 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1129/2256] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:37:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:52.616033 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6c8e6-ea01-41e7-89cb-9c3fa14476a6 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:52.625720 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6c8e6-ea01-41e7-89cb-9c3fa14476a6 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:52.629314 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63272fe-fea4-49c4-9484-97c062aede03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:52.629962 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63272fe-fea4-49c4-9484-97c062aede03 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:52.630243 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63272fe-fea4-49c4-9484-97c062aede03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:52.630518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63272fe-fea4-49c4-9484-97c062aede03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:52.632334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e63272fe-fea4-49c4-9484-97c062aede03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:52.643136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63272fe-fea4-49c4-9484-97c062aede03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:52.644574 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63272fe-fea4-49c4-9484-97c062aede03 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:52.652617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1128/2257] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:37:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:52.756004 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e066052-f9a8-478d-b359-279d441e4f0d None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:52.756561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e066052-f9a8-478d-b359-279d441e4f0d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:52.756666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e066052-f9a8-478d-b359-279d441e4f0d None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:52.758035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1130/2258] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:52.765532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43c12b-b0a2-4b6e-a454-783686c63cbc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:52.766137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43c12b-b0a2-4b6e-a454-783686c63cbc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:52.766652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43c12b-b0a2-4b6e-a454-783686c63cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:52.805864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3d43c12b-b0a2-4b6e-a454-783686c63cbc None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:52.807076 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3d43c12b-b0a2-4b6e-a454-783686c63cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:52.817115 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1129/2259] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:37:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:52.828769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e066052-f9a8-478d-b359-279d441e4f0d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:52.830501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4e066052-f9a8-478d-b359-279d441e4f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:52.893894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e066052-f9a8-478d-b359-279d441e4f0d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:52.897499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fb7b1-53bf-4ef1-8b5e-1caaee58c71d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e854100c04be43c78bce1f95ff85bfc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:52.898384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fb7b1-53bf-4ef1-8b5e-1caaee58c71d service glance] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:52.898675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fb7b1-53bf-4ef1-8b5e-1caaee58c71d service glance] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:52.898953 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fb7b1-53bf-4ef1-8b5e-1caaee58c71d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:52.909668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fb7b1-53bf-4ef1-8b5e-1caaee58c71d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:52.911095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fb7b1-53bf-4ef1-8b5e-1caaee58c71d service glance] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:52.922391 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1131/2260] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:37:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:52.993081 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364e18b-16c3-46aa-ae98-cbaec16981b2 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:52.993463 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364e18b-16c3-46aa-ae98-cbaec16981b2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:52.993814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364e18b-16c3-46aa-ae98-cbaec16981b2 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:52.995288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1130/2261] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:53.000688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b81a0-dd6f-4cf3-8080-4aae9840f571 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:53.001028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b81a0-dd6f-4cf3-8080-4aae9840f571 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:53.001313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b81a0-dd6f-4cf3-8080-4aae9840f571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:53.019747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-202b81a0-dd6f-4cf3-8080-4aae9840f571 None None] MFA Rules not processed for user `d2ea8fd0ebfd42fdbed9a989d85c8787`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:53.020998 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-202b81a0-dd6f-4cf3-8080-4aae9840f571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:53.027583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1132/2262] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:37:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:53.039107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364e18b-16c3-46aa-ae98-cbaec16981b2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:53.050433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364e18b-16c3-46aa-ae98-cbaec16981b2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:53.053917 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be642d7-64d1-4886-9cdc-953c9c05a505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:53.054544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be642d7-64d1-4886-9cdc-953c9c05a505 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:53.054824 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be642d7-64d1-4886-9cdc-953c9c05a505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:53.055097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be642d7-64d1-4886-9cdc-953c9c05a505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:53.062750 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be642d7-64d1-4886-9cdc-953c9c05a505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:53.064179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be642d7-64d1-4886-9cdc-953c9c05a505 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:53.072033 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1131/2263] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:37:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:53.157044 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6279-ee99-4f4a-9e46-f16dd310ef5b None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:53.157333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6279-ee99-4f4a-9e46-f16dd310ef5b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:53.157622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c6279-ee99-4f4a-9e46-f16dd310ef5b None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:53.159009 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1133/2264] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:53.164967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063afa-9d87-4cd6-b5a3-2a3a791cd1bb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:53.165284 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063afa-9d87-4cd6-b5a3-2a3a791cd1bb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:53.165576 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063afa-9d87-4cd6-b5a3-2a3a791cd1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:53.184661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-80063afa-9d87-4cd6-b5a3-2a3a791cd1bb None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:53.186491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-80063afa-9d87-4cd6-b5a3-2a3a791cd1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:53.195783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1132/2265] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:37:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:53.206400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c6279-ee99-4f4a-9e46-f16dd310ef5b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:53.220145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c6279-ee99-4f4a-9e46-f16dd310ef5b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:53.224135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ed71-db34-4b17-ba39-c4ccfc27cbe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:53.224826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ed71-db34-4b17-ba39-c4ccfc27cbe2 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:53.225190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ed71-db34-4b17-ba39-c4ccfc27cbe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:53.225505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ed71-db34-4b17-ba39-c4ccfc27cbe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:53.237280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59ed71-db34-4b17-ba39-c4ccfc27cbe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:53.238751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59ed71-db34-4b17-ba39-c4ccfc27cbe2 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:53.249657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1134/2266] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:37:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:53.312229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80063afa-9d87-4cd6-b5a3-2a3a791cd1bb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:53.313621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-80063afa-9d87-4cd6-b5a3-2a3a791cd1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:53.381833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80063afa-9d87-4cd6-b5a3-2a3a791cd1bb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:53.387169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9eb50-f4c3-4704-9979-808a30fc4ff1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:53.387815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9eb50-f4c3-4704-9979-808a30fc4ff1 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:53.388104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9eb50-f4c3-4704-9979-808a30fc4ff1 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:53.388505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9eb50-f4c3-4704-9979-808a30fc4ff1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:53.390356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ecb9eb50-f4c3-4704-9979-808a30fc4ff1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:53.402385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9eb50-f4c3-4704-9979-808a30fc4ff1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:53.404533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb9eb50-f4c3-4704-9979-808a30fc4ff1 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:53.414332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1133/2267] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:37:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:56.340317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7bf1c-e8b1-400a-8e7d-321f65d7808a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:56.340810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7bf1c-e8b1-400a-8e7d-321f65d7808a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:56.340910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7bf1c-e8b1-400a-8e7d-321f65d7808a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:56.360119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-bdb7bf1c-e8b1-400a-8e7d-321f65d7808a None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:56.361357 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-bdb7bf1c-e8b1-400a-8e7d-321f65d7808a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:56.368646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1135/2268] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:37:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:56.381510 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9eb50-f4c3-4704-9979-808a30fc4ff1 service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:56.393462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9eb50-f4c3-4704-9979-808a30fc4ff1 service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:56.398623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb21c06-55a7-4b95-84a3-27a2a70b35a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:56.399276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21c06-55a7-4b95-84a3-27a2a70b35a1 service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:56.399665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21c06-55a7-4b95-84a3-27a2a70b35a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:56.399979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb21c06-55a7-4b95-84a3-27a2a70b35a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:56.409814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb21c06-55a7-4b95-84a3-27a2a70b35a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:56.411544 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb21c06-55a7-4b95-84a3-27a2a70b35a1 service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:56.420951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1134/2269] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:37:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:38:06.354075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=74 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:06.416578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:24.584022 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7bf1c-e8b1-400a-8e7d-321f65d7808a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:24.603208 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7bf1c-e8b1-400a-8e7d-321f65d7808a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:24.609807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b39eb-006c-40f2-839d-b06288401a33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:24.610477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b39eb-006c-40f2-839d-b06288401a33 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:24.610768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b39eb-006c-40f2-839d-b06288401a33 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:24.611058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b39eb-006c-40f2-839d-b06288401a33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:24.613131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9e7b39eb-006c-40f2-839d-b06288401a33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:24.629851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b39eb-006c-40f2-839d-b06288401a33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:24.631460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b39eb-006c-40f2-839d-b06288401a33 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:24.643418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1136/2270] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:38:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:28.117790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47587dbf-d56e-4867-ba2f-7e3a828cc0e1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:28.118316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47587dbf-d56e-4867-ba2f-7e3a828cc0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:28.118414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47587dbf-d56e-4867-ba2f-7e3a828cc0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:28.138064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-47587dbf-d56e-4867-ba2f-7e3a828cc0e1 None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:28.139445 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-47587dbf-d56e-4867-ba2f-7e3a828cc0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:28.147312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1135/2271] 10.222.0.39 () {58 vars in 967 bytes} [Thu May 26 12:38:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:28.160075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b39eb-006c-40f2-839d-b06288401a33 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:28.171921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b39eb-006c-40f2-839d-b06288401a33 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:28.177773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68be0ec-41c0-482a-a395-921a7db498b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:28.178524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68be0ec-41c0-482a-a395-921a7db498b8 service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:28.178809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68be0ec-41c0-482a-a395-921a7db498b8 service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:28.179084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68be0ec-41c0-482a-a395-921a7db498b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:28.188521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68be0ec-41c0-482a-a395-921a7db498b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:28.190186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68be0ec-41c0-482a-a395-921a7db498b8 service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:28.199156 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1137/2272] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:38:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:38:38.132180 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:38.195679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=12 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:45.454511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47587dbf-d56e-4867-ba2f-7e3a828cc0e1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:45.456002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-47587dbf-d56e-4867-ba2f-7e3a828cc0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:45.475452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47587dbf-d56e-4867-ba2f-7e3a828cc0e1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:45.480967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546051b-1f30-4d32-9a94-52b268bbf76c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:45.481625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546051b-1f30-4d32-9a94-52b268bbf76c service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:45.481907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546051b-1f30-4d32-9a94-52b268bbf76c service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:45.482179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546051b-1f30-4d32-9a94-52b268bbf76c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:45.484100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0546051b-1f30-4d32-9a94-52b268bbf76c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:45.544609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546051b-1f30-4d32-9a94-52b268bbf76c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:45.546261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546051b-1f30-4d32-9a94-52b268bbf76c service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:45.556009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1136/2273] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:38:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:55.551593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=28 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:14.924194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda823f4-664f-460e-88c0-068968bf552f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:14.924819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda823f4-664f-460e-88c0-068968bf552f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:14.925231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda823f4-664f-460e-88c0-068968bf552f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:14.949454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-cda823f4-664f-460e-88c0-068968bf552f None None] MFA Rules not processed for user `c21602eca99d48d8824c0f5c1693d573`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:14.950784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cda823f4-664f-460e-88c0-068968bf552f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:14.958448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1138/2274] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:21.425578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546051b-1f30-4d32-9a94-52b268bbf76c service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:21.438683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546051b-1f30-4d32-9a94-52b268bbf76c service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:21.447020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca16f6-0135-4d42-b0a4-220eae1cc3cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:21.447765 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca16f6-0135-4d42-b0a4-220eae1cc3cf service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:21.448309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca16f6-0135-4d42-b0a4-220eae1cc3cf service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:21.448954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca16f6-0135-4d42-b0a4-220eae1cc3cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:21.452100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f3ca16f6-0135-4d42-b0a4-220eae1cc3cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:21.465498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca16f6-0135-4d42-b0a4-220eae1cc3cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:21.467171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca16f6-0135-4d42-b0a4-220eae1cc3cf service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:21.480078 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1137/2275] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:39:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:24.940995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:31.375743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda823f4-664f-460e-88c0-068968bf552f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:31.389809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda823f4-664f-460e-88c0-068968bf552f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:31.395343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64bb58-c969-43b9-ac1d-82db91c5d6b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:31.395992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bb58-c969-43b9-ac1d-82db91c5d6b6 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:31.396283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bb58-c969-43b9-ac1d-82db91c5d6b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:31.396567 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bb58-c969-43b9-ac1d-82db91c5d6b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:31.398588 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-df64bb58-c969-43b9-ac1d-82db91c5d6b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:31.473833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:31.482340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64bb58-c969-43b9-ac1d-82db91c5d6b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:31.484064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64bb58-c969-43b9-ac1d-82db91c5d6b6 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:31.495647 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1139/2276] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:39:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:35.241880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca16f6-0135-4d42-b0a4-220eae1cc3cf service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:35.254415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca16f6-0135-4d42-b0a4-220eae1cc3cf service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:35.261444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2f7c3a-ca6b-445d-a3fe-fd599cb343fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:35.263135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f7c3a-ca6b-445d-a3fe-fd599cb343fd service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:35.263632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f7c3a-ca6b-445d-a3fe-fd599cb343fd service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:35.264102 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2f7c3a-ca6b-445d-a3fe-fd599cb343fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:35.266546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8b2f7c3a-ca6b-445d-a3fe-fd599cb343fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:35.282972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f7c3a-ca6b-445d-a3fe-fd599cb343fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:35.285821 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2f7c3a-ca6b-445d-a3fe-fd599cb343fd service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:35.314112 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1138/2277] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:39:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:41.489537 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=28 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:45.302063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:46.588464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f4551-12e9-46e6-987a-28d6bb20915e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:46.589018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f4551-12e9-46e6-987a-28d6bb20915e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:46.589127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f4551-12e9-46e6-987a-28d6bb20915e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:46.606210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-256f4551-12e9-46e6-987a-28d6bb20915e None None] MFA Rules not processed for user `7b14606965a74c71881595c71bdd2d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:46.607736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-256f4551-12e9-46e6-987a-28d6bb20915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:46.623117 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1140/2278] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:39:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:56.601128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:00.001291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666eb9a6-5a1e-43db-9278-a21a162d716c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:00.001816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666eb9a6-5a1e-43db-9278-a21a162d716c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:00.001925 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666eb9a6-5a1e-43db-9278-a21a162d716c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:00.020114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-666eb9a6-5a1e-43db-9278-a21a162d716c None None] MFA Rules not processed for user `c90e6a7a7265480ca4c817d633da4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:00.021355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-666eb9a6-5a1e-43db-9278-a21a162d716c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:00.029786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1139/2279] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:39:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:00.706341 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f4551-12e9-46e6-987a-28d6bb20915e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:00.716582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f4551-12e9-46e6-987a-28d6bb20915e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:00.720346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21709842-f8d4-4ab7-bb4a-94205e30dfab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:00.721077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21709842-f8d4-4ab7-bb4a-94205e30dfab service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:00.721367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21709842-f8d4-4ab7-bb4a-94205e30dfab service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:00.721649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21709842-f8d4-4ab7-bb4a-94205e30dfab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:00.723498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-21709842-f8d4-4ab7-bb4a-94205e30dfab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:00.734371 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21709842-f8d4-4ab7-bb4a-94205e30dfab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:00.735802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21709842-f8d4-4ab7-bb4a-94205e30dfab service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:00.744747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1141/2280] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:40:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:01.402458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666eb9a6-5a1e-43db-9278-a21a162d716c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:01.437545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666eb9a6-5a1e-43db-9278-a21a162d716c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:01.444532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d49c3b-a400-4568-a6f0-836dbd8d0e26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:01.446205 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d49c3b-a400-4568-a6f0-836dbd8d0e26 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:01.446805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d49c3b-a400-4568-a6f0-836dbd8d0e26 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:01.447108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d49c3b-a400-4568-a6f0-836dbd8d0e26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:01.449021 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c1d49c3b-a400-4568-a6f0-836dbd8d0e26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:01.528920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d49c3b-a400-4568-a6f0-836dbd8d0e26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:01.532186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d49c3b-a400-4568-a6f0-836dbd8d0e26 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:01.552143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1140/2281] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:40:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:10.740255 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:11.547172 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=31 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:36.554020 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21709842-f8d4-4ab7-bb4a-94205e30dfab service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:36.566701 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21709842-f8d4-4ab7-bb4a-94205e30dfab service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:36.572099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b0a47-4613-4c0b-b0ee-7b32e8d381eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:36.572777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b0a47-4613-4c0b-b0ee-7b32e8d381eb service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:36.573070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b0a47-4613-4c0b-b0ee-7b32e8d381eb service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:36.573353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b0a47-4613-4c0b-b0ee-7b32e8d381eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:36.575530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0e2b0a47-4613-4c0b-b0ee-7b32e8d381eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:36.589742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b0a47-4613-4c0b-b0ee-7b32e8d381eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:36.591362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b0a47-4613-4c0b-b0ee-7b32e8d381eb service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:36.602296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1142/2282] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:40:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:46.597245 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:47.019882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d49c3b-a400-4568-a6f0-836dbd8d0e26 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:47.030195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d49c3b-a400-4568-a6f0-836dbd8d0e26 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:47.034739 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bd033-8176-44d1-95ee-0b274f622bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:47.035681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bd033-8176-44d1-95ee-0b274f622bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:47.036029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bd033-8176-44d1-95ee-0b274f622bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:47.036341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bd033-8176-44d1-95ee-0b274f622bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:47.038379 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4d4bd033-8176-44d1-95ee-0b274f622bf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:47.103276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bd033-8176-44d1-95ee-0b274f622bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:47.105356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bd033-8176-44d1-95ee-0b274f622bf7 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:47.114895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1141/2283] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:50.568898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b0a47-4613-4c0b-b0ee-7b32e8d381eb service placement] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:50.568898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0e2b0a47-4613-4c0b-b0ee-7b32e8d381eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:50.584702 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b0a47-4613-4c0b-b0ee-7b32e8d381eb service placement] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:50.597686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d063f-5198-42a0-8a85-65be91fbeedd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:50.599565 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d063f-5198-42a0-8a85-65be91fbeedd service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:50.600082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d063f-5198-42a0-8a85-65be91fbeedd service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:50.600590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d063f-5198-42a0-8a85-65be91fbeedd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:50.604997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-774d063f-5198-42a0-8a85-65be91fbeedd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:50.641169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d063f-5198-42a0-8a85-65be91fbeedd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:50.641169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d063f-5198-42a0-8a85-65be91fbeedd service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:50.642183 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bd033-8176-44d1-95ee-0b274f622bf7 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:50.643763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4d4bd033-8176-44d1-95ee-0b274f622bf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:50.669953 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1143/2284] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:40:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:40:50.688788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bd033-8176-44d1-95ee-0b274f622bf7 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:50.702405 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a4cb1-3f82-44a9-9073-ac96c943bd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:50.704176 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4cb1-3f82-44a9-9073-ac96c943bd1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:50.704924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4cb1-3f82-44a9-9073-ac96c943bd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:50.705352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4cb1-3f82-44a9-9073-ac96c943bd1e admin admin] PATH_INFO: `/v3/users/c21602eca99d48d8824c0f5c1693d573` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:50.706902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a4cb1-3f82-44a9-9073-ac96c943bd1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21602eca99d48d8824c0f5c1693d573)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:50.709832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a4cb1-3f82-44a9-9073-ac96c943bd1e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:50.775084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b44a4cb1-3f82-44a9-9073-ac96c943bd1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21602eca99d48d8824c0f5c1693d573'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:50.777274 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b44a4cb1-3f82-44a9-9073-ac96c943bd1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21602eca99d48d8824c0f5c1693d573'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:50.777788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b44a4cb1-3f82-44a9-9073-ac96c943bd1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21602eca99d48d8824c0f5c1693d573'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:50.793573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b44a4cb1-3f82-44a9-9073-ac96c943bd1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21602eca99d48d8824c0f5c1693d573'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:50.800699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b44a4cb1-3f82-44a9-9073-ac96c943bd1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21602eca99d48d8824c0f5c1693d573'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:50.821257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1142/2285] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:40:50 2022] DELETE /identity/v3/users/c21602eca99d48d8824c0f5c1693d573 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:51.011461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d063f-5198-42a0-8a85-65be91fbeedd service placement] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:51.024902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d063f-5198-42a0-8a85-65be91fbeedd service placement] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:51.101099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02072402-e9a9-49bf-9420-a2cb2e13e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:51.101994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02072402-e9a9-49bf-9420-a2cb2e13e98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:51.102275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02072402-e9a9-49bf-9420-a2cb2e13e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:51.103034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02072402-e9a9-49bf-9420-a2cb2e13e98b admin admin] PATH_INFO: `/v3/projects/d04d37bf7dfc47f3b20a58a3d95c1c2b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:51.104792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02072402-e9a9-49bf-9420-a2cb2e13e98b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04d37bf7dfc47f3b20a58a3d95c1c2b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:51.106712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02072402-e9a9-49bf-9420-a2cb2e13e98b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:51.165261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-02072402-e9a9-49bf-9420-a2cb2e13e98b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'request_id': 'req-02072402-e9a9-49bf-9420-a2cb2e13e98b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:51.173151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-02072402-e9a9-49bf-9420-a2cb2e13e98b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'request_id': 'req-02072402-e9a9-49bf-9420-a2cb2e13e98b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:51.179561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-02072402-e9a9-49bf-9420-a2cb2e13e98b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04d37bf7dfc47f3b20a58a3d95c1c2b', 'request_id': 'req-02072402-e9a9-49bf-9420-a2cb2e13e98b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:51.190833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-02072402-e9a9-49bf-9420-a2cb2e13e98b admin admin] The token cache is being invalidate because project d04d37bf7dfc47f3b20a58a3d95c1c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:40:51.191173 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-02072402-e9a9-49bf-9420-a2cb2e13e98b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:51.191853 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-02072402-e9a9-49bf-9420-a2cb2e13e98b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:40:51.193485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1144/2286] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:40:51 2022] DELETE /identity/v3/projects/d04d37bf7dfc47f3b20a58a3d95c1c2b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:51.199414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816e38c-1c8f-498d-b97a-d127726f7bab None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:51.199756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816e38c-1c8f-498d-b97a-d127726f7bab None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:51.200126 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816e38c-1c8f-498d-b97a-d127726f7bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:51.223952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8816e38c-1c8f-498d-b97a-d127726f7bab None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:51.225185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8816e38c-1c8f-498d-b97a-d127726f7bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:51.284254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1143/2287] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:51.292541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0a0b0-865c-4840-90df-9a56be5a87b8 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:51.292899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0a0b0-865c-4840-90df-9a56be5a87b8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:51.293186 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0a0b0-865c-4840-90df-9a56be5a87b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:51.312841 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-29c0a0b0-865c-4840-90df-9a56be5a87b8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:51.314055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-29c0a0b0-865c-4840-90df-9a56be5a87b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:51.321949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1145/2288] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:40:51.327092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816e38c-1c8f-498d-b97a-d127726f7bab None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:51.336668 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816e38c-1c8f-498d-b97a-d127726f7bab None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:51.341741 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db09d52-bea5-49ce-9745-f54f89be2d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:51.342399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db09d52-bea5-49ce-9745-f54f89be2d8e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:51.342696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db09d52-bea5-49ce-9745-f54f89be2d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:51.342965 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db09d52-bea5-49ce-9745-f54f89be2d8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:51.343697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db09d52-bea5-49ce-9745-f54f89be2d8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:40:51.344008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db09d52-bea5-49ce-9745-f54f89be2d8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:51.345671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db09d52-bea5-49ce-9745-f54f89be2d8e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:51.347201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:51.362028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1144/2289] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:40:51.366105 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0a0b0-865c-4840-90df-9a56be5a87b8 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:51.376329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0a0b0-865c-4840-90df-9a56be5a87b8 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:51.381109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18ca2e-9646-4a11-ad35-403d2d15556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:51.381760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18ca2e-9646-4a11-ad35-403d2d15556e admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:51.382042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18ca2e-9646-4a11-ad35-403d2d15556e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:51.382316 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18ca2e-9646-4a11-ad35-403d2d15556e admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:51.383014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18ca2e-9646-4a11-ad35-403d2d15556e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:51.384936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18ca2e-9646-4a11-ad35-403d2d15556e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:51.421301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1146/2290] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:40:51 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:40:51.425407 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db09d52-bea5-49ce-9745-f54f89be2d8e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:51.436271 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db09d52-bea5-49ce-9745-f54f89be2d8e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:51.495154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c429b21-a02f-4255-967e-76011bb3f58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:51.495990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c429b21-a02f-4255-967e-76011bb3f58a admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:51.496276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c429b21-a02f-4255-967e-76011bb3f58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:51.496551 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c429b21-a02f-4255-967e-76011bb3f58a admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:51.497275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c429b21-a02f-4255-967e-76011bb3f58a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:51.499199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c429b21-a02f-4255-967e-76011bb3f58a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:51.519725 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1145/2291] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:40:51 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:40:51.524113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18ca2e-9646-4a11-ad35-403d2d15556e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:51.538115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18ca2e-9646-4a11-ad35-403d2d15556e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:51.543923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d0102-36e7-4e49-baf3-32aca51d6506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:51.544693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d0102-36e7-4e49-baf3-32aca51d6506 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:51.545094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d0102-36e7-4e49-baf3-32aca51d6506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:51.545470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d0102-36e7-4e49-baf3-32aca51d6506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:51.546365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d0102-36e7-4e49-baf3-32aca51d6506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:51.548061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d0102-36e7-4e49-baf3-32aca51d6506 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:51.558934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1147/2292] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:40:51.563300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c429b21-a02f-4255-967e-76011bb3f58a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:51.573749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c429b21-a02f-4255-967e-76011bb3f58a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:51.578341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98c567-483d-46d1-a363-17ab4a57648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:51.578995 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98c567-483d-46d1-a363-17ab4a57648e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:51.579278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98c567-483d-46d1-a363-17ab4a57648e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:51.579579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98c567-483d-46d1-a363-17ab4a57648e admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:51.580311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98c567-483d-46d1-a363-17ab4a57648e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:51.582324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98c567-483d-46d1-a363-17ab4a57648e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:51.593066 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1146/2293] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:40:51.597661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d0102-36e7-4e49-baf3-32aca51d6506 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:51.608822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d0102-36e7-4e49-baf3-32aca51d6506 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:51.613893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01260e-0fe9-4951-bc24-cbe663fabf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:51.614887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01260e-0fe9-4951-bc24-cbe663fabf79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:51.615206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01260e-0fe9-4951-bc24-cbe663fabf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:51.615529 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01260e-0fe9-4951-bc24-cbe663fabf79 admin admin] PATH_INFO: `/v3/projects/a78c9187d53e49a9b874fba0e3ab27a4/users/70fb5ab909014511a0f8709586261c43/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:51.631326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01260e-0fe9-4951-bc24-cbe663fabf79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78c9187d53e49a9b874fba0e3ab27a4, user_id=70fb5ab909014511a0f8709586261c43, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:51.633995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01260e-0fe9-4951-bc24-cbe663fabf79 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:51.648067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1148/2294] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:40:51 2022] PUT /identity/v3/projects/a78c9187d53e49a9b874fba0e3ab27a4/users/70fb5ab909014511a0f8709586261c43/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:51.659259 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e7b74-1561-4d2c-a33e-55b10d698dcb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:51.659791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e7b74-1561-4d2c-a33e-55b10d698dcb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:51.659791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e7b74-1561-4d2c-a33e-55b10d698dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:51.688212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-dc9e7b74-1561-4d2c-a33e-55b10d698dcb None None] MFA Rules not processed for user `70fb5ab909014511a0f8709586261c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:51.689407 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dc9e7b74-1561-4d2c-a33e-55b10d698dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:51.754898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1147/2295] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:40:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:51.759561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01260e-0fe9-4951-bc24-cbe663fabf79 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:51.765793 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:51.826719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01260e-0fe9-4951-bc24-cbe663fabf79 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:51.831447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3fab1-28e6-4b2c-bbc5-34d82544f08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:51.832109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3fab1-28e6-4b2c-bbc5-34d82544f08a admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:51.832394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3fab1-28e6-4b2c-bbc5-34d82544f08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:51.832669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3fab1-28e6-4b2c-bbc5-34d82544f08a admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:51.833395 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3fab1-28e6-4b2c-bbc5-34d82544f08a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:51.835293 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3fab1-28e6-4b2c-bbc5-34d82544f08a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:51.865101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1149/2296] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:40:51 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:40:51.866427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e7b74-1561-4d2c-a33e-55b10d698dcb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:51.877584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e7b74-1561-4d2c-a33e-55b10d698dcb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:51.936705 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b856468-e5e8-4942-bb61-90530d9a0533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:51.937410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b856468-e5e8-4942-bb61-90530d9a0533 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:51.937694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b856468-e5e8-4942-bb61-90530d9a0533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:51.937969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b856468-e5e8-4942-bb61-90530d9a0533 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:51.938715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b856468-e5e8-4942-bb61-90530d9a0533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:51.940580 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b856468-e5e8-4942-bb61-90530d9a0533 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:51.948386 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:51.965147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1148/2297] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:40:51 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:40:51.966371 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3fab1-28e6-4b2c-bbc5-34d82544f08a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:51.977035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3fab1-28e6-4b2c-bbc5-34d82544f08a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:51.981695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73983235-e5f5-455c-966f-00e64c50a539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:51.982352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73983235-e5f5-455c-966f-00e64c50a539 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:51.982633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73983235-e5f5-455c-966f-00e64c50a539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:51.982909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73983235-e5f5-455c-966f-00e64c50a539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:51.983634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73983235-e5f5-455c-966f-00e64c50a539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:51.985276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73983235-e5f5-455c-966f-00e64c50a539 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:51.996768 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1150/2298] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:40:52.001072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b856468-e5e8-4942-bb61-90530d9a0533 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:52.011487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b856468-e5e8-4942-bb61-90530d9a0533 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:52.016354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193cd7-4388-4a1b-a9d9-28fad00ecc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:52.017261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193cd7-4388-4a1b-a9d9-28fad00ecc3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:52.017545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193cd7-4388-4a1b-a9d9-28fad00ecc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:52.017819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193cd7-4388-4a1b-a9d9-28fad00ecc3b admin admin] PATH_INFO: `/v3/projects/2d13bb0692e94eb987b005d000ee1110/users/eeb3bc2970534b7da0626bdd13df3fc7/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:52.033399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9193cd7-4388-4a1b-a9d9-28fad00ecc3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d13bb0692e94eb987b005d000ee1110, user_id=eeb3bc2970534b7da0626bdd13df3fc7, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:52.036046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9193cd7-4388-4a1b-a9d9-28fad00ecc3b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:52.050148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1149/2299] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:40:52 2022] PUT /identity/v3/projects/2d13bb0692e94eb987b005d000ee1110/users/eeb3bc2970534b7da0626bdd13df3fc7/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:40:52.054412 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73983235-e5f5-455c-966f-00e64c50a539 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:52.064821 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73983235-e5f5-455c-966f-00e64c50a539 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:52.133484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88789b12-e16a-4c67-af3c-11109c425ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:52.134158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789b12-e16a-4c67-af3c-11109c425ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:52.134439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789b12-e16a-4c67-af3c-11109c425ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:52.134714 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789b12-e16a-4c67-af3c-11109c425ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:52.136555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88789b12-e16a-4c67-af3c-11109c425ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:52.138176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88789b12-e16a-4c67-af3c-11109c425ac8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:52.150157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1151/2300] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:40:52.155612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193cd7-4388-4a1b-a9d9-28fad00ecc3b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:52.167216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193cd7-4388-4a1b-a9d9-28fad00ecc3b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:52.171847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e0761-52ea-4ce5-80a1-885319e8f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:52.173116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e0761-52ea-4ce5-80a1-885319e8f769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:52.173414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e0761-52ea-4ce5-80a1-885319e8f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:52.173684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e0761-52ea-4ce5-80a1-885319e8f769 admin admin] PATH_INFO: `/v3/projects/2d13bb0692e94eb987b005d000ee1110/users/eeb3bc2970534b7da0626bdd13df3fc7/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:52.175662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e0761-52ea-4ce5-80a1-885319e8f769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d13bb0692e94eb987b005d000ee1110, user_id=eeb3bc2970534b7da0626bdd13df3fc7, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:52.178356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e0761-52ea-4ce5-80a1-885319e8f769 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:52.190528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1150/2301] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:40:52 2022] PUT /identity/v3/projects/2d13bb0692e94eb987b005d000ee1110/users/eeb3bc2970534b7da0626bdd13df3fc7/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:40:52.202653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ece7e-2c5d-4886-be72-6a908d8189cf None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:52.203334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ece7e-2c5d-4886-be72-6a908d8189cf None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:52.203921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ece7e-2c5d-4886-be72-6a908d8189cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:52.247715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c69ece7e-2c5d-4886-be72-6a908d8189cf None None] MFA Rules not processed for user `eeb3bc2970534b7da0626bdd13df3fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:52.248942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c69ece7e-2c5d-4886-be72-6a908d8189cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:52.340350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:52.344643 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1152/2302] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:40:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:52.357468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e0761-52ea-4ce5-80a1-885319e8f769 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:52.359434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-278e0761-52ea-4ce5-80a1-885319e8f769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:52.418151 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e0761-52ea-4ce5-80a1-885319e8f769 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:52.421871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2d1e4-024e-44d2-a10e-697ad8fabf27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:52.422515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2d1e4-024e-44d2-a10e-697ad8fabf27 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:52.422798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2d1e4-024e-44d2-a10e-697ad8fabf27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:52.423071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2d1e4-024e-44d2-a10e-697ad8fabf27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:52.433144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2d1e4-024e-44d2-a10e-697ad8fabf27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:52.434586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2d1e4-024e-44d2-a10e-697ad8fabf27 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:52.444299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1151/2303] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:40:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:52.528879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ece7e-2c5d-4886-be72-6a908d8189cf None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:52.539860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ece7e-2c5d-4886-be72-6a908d8189cf None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:52.543930 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecb5c5-a26e-455e-ab10-6ec98ae13106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:52.544425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecb5c5-a26e-455e-ab10-6ec98ae13106 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:52.544757 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecb5c5-a26e-455e-ab10-6ec98ae13106 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:52.545038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecb5c5-a26e-455e-ab10-6ec98ae13106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:52.607891 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecb5c5-a26e-455e-ab10-6ec98ae13106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:52.609385 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecb5c5-a26e-455e-ab10-6ec98ae13106 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:52.618268 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1153/2304] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:40:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:53.632442 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8159ba-3677-4d13-b001-d747b2283f89 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:53.633032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8159ba-3677-4d13-b001-d747b2283f89 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:53.633150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8159ba-3677-4d13-b001-d747b2283f89 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:53.634475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1152/2305] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:53.641473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdad43f-1eee-4ccd-83a8-004decdf8b58 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:53.641940 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdad43f-1eee-4ccd-83a8-004decdf8b58 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:53.642090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdad43f-1eee-4ccd-83a8-004decdf8b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:53.662819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2cdad43f-1eee-4ccd-83a8-004decdf8b58 None None] MFA Rules not processed for user `d2ea8fd0ebfd42fdbed9a989d85c8787`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:53.664075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2cdad43f-1eee-4ccd-83a8-004decdf8b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:53.719112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1154/2306] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:40:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:40:53.731003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8159ba-3677-4d13-b001-d747b2283f89 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:53.732798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-af8159ba-3677-4d13-b001-d747b2283f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:53.745832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8159ba-3677-4d13-b001-d747b2283f89 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:53.749462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c083aa-ee17-415f-9538-ad5ceb51101d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:53.750101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c083aa-ee17-415f-9538-ad5ceb51101d service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:53.750409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c083aa-ee17-415f-9538-ad5ceb51101d service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:53.750688 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c083aa-ee17-415f-9538-ad5ceb51101d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:53.758250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c083aa-ee17-415f-9538-ad5ceb51101d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:53.760226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c083aa-ee17-415f-9538-ad5ceb51101d service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:53.769263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1153/2307] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:40:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:53.854042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2909e94-9d54-4d96-be79-cf73bd4906c0 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:53.854326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2909e94-9d54-4d96-be79-cf73bd4906c0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:53.854602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2909e94-9d54-4d96-be79-cf73bd4906c0 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:53.856026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1155/2308] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:53.861286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb2993-171b-4ba2-8929-1d50a74ec313 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:53.861585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb2993-171b-4ba2-8929-1d50a74ec313 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:53.861866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb2993-171b-4ba2-8929-1d50a74ec313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:53.881545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-97fb2993-171b-4ba2-8929-1d50a74ec313 None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:53.883077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-97fb2993-171b-4ba2-8929-1d50a74ec313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:53.964016 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1154/2309] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:40:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:53.975065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2909e94-9d54-4d96-be79-cf73bd4906c0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:53.977330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e2909e94-9d54-4d96-be79-cf73bd4906c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:53.991464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2909e94-9d54-4d96-be79-cf73bd4906c0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:53.995876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ab7ee-1299-4deb-b152-15bb5d66dfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:53.996519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab7ee-1299-4deb-b152-15bb5d66dfcb service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:53.996836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab7ee-1299-4deb-b152-15bb5d66dfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:53.997114 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ab7ee-1299-4deb-b152-15bb5d66dfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:54.007632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ab7ee-1299-4deb-b152-15bb5d66dfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:54.009122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ab7ee-1299-4deb-b152-15bb5d66dfcb service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:54.021284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1156/2310] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:40:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:03.520369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb2993-171b-4ba2-8929-1d50a74ec313 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:03.559177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:03.583891 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb2993-171b-4ba2-8929-1d50a74ec313 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:03.588507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:03.589932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:03.590217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:03.590495 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] PATH_INFO: `/v3/users/70fb5ab909014511a0f8709586261c43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:03.591691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70fb5ab909014511a0f8709586261c43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:03.593658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:03.639198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70fb5ab909014511a0f8709586261c43'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:03.639996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70fb5ab909014511a0f8709586261c43'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:03.640611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70fb5ab909014511a0f8709586261c43'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:03.652531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70fb5ab909014511a0f8709586261c43'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:03.659282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70fb5ab909014511a0f8709586261c43'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:03.673288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1155/2311] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:41:03 2022] DELETE /identity/v3/users/70fb5ab909014511a0f8709586261c43 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:03.677940 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b9726-9f0e-46f9-a3d4-90cf57a22fb5 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:03.678416 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b9726-9f0e-46f9-a3d4-90cf57a22fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:03.678547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b9726-9f0e-46f9-a3d4-90cf57a22fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:03.697286 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-621b9726-9f0e-46f9-a3d4-90cf57a22fb5 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:03.699476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-621b9726-9f0e-46f9-a3d4-90cf57a22fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:03.758374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1157/2312] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:03.768895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:03.770298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:03.830643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f10e0b-f024-4503-940f-a820057894a0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:03.834747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95916c3-49fb-4883-9303-6c8cfa05e1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:03.835422 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95916c3-49fb-4883-9303-6c8cfa05e1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:03.835714 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95916c3-49fb-4883-9303-6c8cfa05e1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:03.836016 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95916c3-49fb-4883-9303-6c8cfa05e1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:03.845486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95916c3-49fb-4883-9303-6c8cfa05e1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:03.846940 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95916c3-49fb-4883-9303-6c8cfa05e1d0 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:03.856823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1156/2313] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:04.125257 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b9726-9f0e-46f9-a3d4-90cf57a22fb5 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:04.126726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-621b9726-9f0e-46f9-a3d4-90cf57a22fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:04.138933 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b9726-9f0e-46f9-a3d4-90cf57a22fb5 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:04.143574 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:04.144447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:04.144758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:04.145045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] PATH_INFO: `/v3/projects/a78c9187d53e49a9b874fba0e3ab27a4` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:04.146354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78c9187d53e49a9b874fba0e3ab27a4)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:04.148469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:04.183964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:04.198835 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78c9187d53e49a9b874fba0e3ab27a4', 'request_id': 'req-1ed3f6d8-1d6f-4656-a352-a136d5058d98'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.206202 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78c9187d53e49a9b874fba0e3ab27a4', 'request_id': 'req-1ed3f6d8-1d6f-4656-a352-a136d5058d98'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.212605 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78c9187d53e49a9b874fba0e3ab27a4', 'request_id': 'req-1ed3f6d8-1d6f-4656-a352-a136d5058d98'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.222898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] The token cache is being invalidate because project a78c9187d53e49a9b874fba0e3ab27a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:04.223191 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.223826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.225422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1158/2314] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:41:04 2022] DELETE /identity/v3/projects/a78c9187d53e49a9b874fba0e3ab27a4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:04.230081 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95916c3-49fb-4883-9303-6c8cfa05e1d0 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:04.239607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95916c3-49fb-4883-9303-6c8cfa05e1d0 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:04.293989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:04.301702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf36ac-71bc-473d-9a27-3d5f304230ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:04.302731 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf36ac-71bc-473d-9a27-3d5f304230ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:04.303036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf36ac-71bc-473d-9a27-3d5f304230ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:04.303542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf36ac-71bc-473d-9a27-3d5f304230ed admin admin] PATH_INFO: `/v3/users/eeb3bc2970534b7da0626bdd13df3fc7` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:04.305373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf36ac-71bc-473d-9a27-3d5f304230ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb3bc2970534b7da0626bdd13df3fc7)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:04.308472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf36ac-71bc-473d-9a27-3d5f304230ed admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:04.359844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0cbf36ac-71bc-473d-9a27-3d5f304230ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb3bc2970534b7da0626bdd13df3fc7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.360543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0cbf36ac-71bc-473d-9a27-3d5f304230ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb3bc2970534b7da0626bdd13df3fc7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.361177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0cbf36ac-71bc-473d-9a27-3d5f304230ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb3bc2970534b7da0626bdd13df3fc7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.373794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0cbf36ac-71bc-473d-9a27-3d5f304230ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb3bc2970534b7da0626bdd13df3fc7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.381074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0cbf36ac-71bc-473d-9a27-3d5f304230ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb3bc2970534b7da0626bdd13df3fc7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.394321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1157/2315] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:41:04 2022] DELETE /identity/v3/users/eeb3bc2970534b7da0626bdd13df3fc7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:04.739601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:04.741073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:04.754379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3f6d8-1d6f-4656-a352-a136d5058d98 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:04.814324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4d64f-88df-4a0a-82b7-032bddad446c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:04.815257 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4d64f-88df-4a0a-82b7-032bddad446c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:04.815541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4d64f-88df-4a0a-82b7-032bddad446c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:04.815814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4d64f-88df-4a0a-82b7-032bddad446c admin admin] PATH_INFO: `/v3/projects/2d13bb0692e94eb987b005d000ee1110` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:04.817093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4d64f-88df-4a0a-82b7-032bddad446c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d13bb0692e94eb987b005d000ee1110)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:04.819016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4d64f-88df-4a0a-82b7-032bddad446c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:04.866587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-57a4d64f-88df-4a0a-82b7-032bddad446c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d13bb0692e94eb987b005d000ee1110', 'request_id': 'req-57a4d64f-88df-4a0a-82b7-032bddad446c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.874469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-57a4d64f-88df-4a0a-82b7-032bddad446c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d13bb0692e94eb987b005d000ee1110', 'request_id': 'req-57a4d64f-88df-4a0a-82b7-032bddad446c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.880851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-57a4d64f-88df-4a0a-82b7-032bddad446c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d13bb0692e94eb987b005d000ee1110', 'request_id': 'req-57a4d64f-88df-4a0a-82b7-032bddad446c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.893285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-57a4d64f-88df-4a0a-82b7-032bddad446c admin admin] The token cache is being invalidate because project 2d13bb0692e94eb987b005d000ee1110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:04.893577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-57a4d64f-88df-4a0a-82b7-032bddad446c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.894231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-57a4d64f-88df-4a0a-82b7-032bddad446c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:04.895777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1159/2316] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:41:04 2022] DELETE /identity/v3/projects/2d13bb0692e94eb987b005d000ee1110 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:04.900695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c91c5-1f63-4981-906e-3ba570eaa428 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:04.901975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c91c5-1f63-4981-906e-3ba570eaa428 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:04.901975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c91c5-1f63-4981-906e-3ba570eaa428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:04.920369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a21c91c5-1f63-4981-906e-3ba570eaa428 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:04.921587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a21c91c5-1f63-4981-906e-3ba570eaa428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:04.980372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1158/2317] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:04.988153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e953d48-2344-4509-8df4-c2278658a9bb None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:04.988447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e953d48-2344-4509-8df4-c2278658a9bb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:04.988754 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e953d48-2344-4509-8df4-c2278658a9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.008143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7e953d48-2344-4509-8df4-c2278658a9bb None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:05.009394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7e953d48-2344-4509-8df4-c2278658a9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:05.018138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1160/2318] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:05.022157 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c91c5-1f63-4981-906e-3ba570eaa428 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:05.032665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c91c5-1f63-4981-906e-3ba570eaa428 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:05.037341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a9405-75fd-43a1-bcc7-6cb13f1fd608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:05.037997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a9405-75fd-43a1-bcc7-6cb13f1fd608 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.038285 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a9405-75fd-43a1-bcc7-6cb13f1fd608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.038564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a9405-75fd-43a1-bcc7-6cb13f1fd608 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.039293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a9405-75fd-43a1-bcc7-6cb13f1fd608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:05.039604 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a9405-75fd-43a1-bcc7-6cb13f1fd608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:05.041245 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a9405-75fd-43a1-bcc7-6cb13f1fd608 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:05.052891 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1159/2319] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:05.057230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e953d48-2344-4509-8df4-c2278658a9bb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:05.066303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e953d48-2344-4509-8df4-c2278658a9bb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:05.070983 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5eabe-a8bb-4af2-8f28-f43b4eee8ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:05.071624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5eabe-a8bb-4af2-8f28-f43b4eee8ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.071907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5eabe-a8bb-4af2-8f28-f43b4eee8ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.072179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a5eabe-a8bb-4af2-8f28-f43b4eee8ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.073417 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5eabe-a8bb-4af2-8f28-f43b4eee8ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:05.075298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a5eabe-a8bb-4af2-8f28-f43b4eee8ed4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:05.100946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1161/2320] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:41:05 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:05.105283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a9405-75fd-43a1-bcc7-6cb13f1fd608 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:05.115253 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a9405-75fd-43a1-bcc7-6cb13f1fd608 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:05.171888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb165ce-838c-42c2-be57-21d15e631c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:05.172475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb165ce-838c-42c2-be57-21d15e631c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.172804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb165ce-838c-42c2-be57-21d15e631c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.173091 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb165ce-838c-42c2-be57-21d15e631c34 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.173787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb165ce-838c-42c2-be57-21d15e631c34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:05.175710 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb165ce-838c-42c2-be57-21d15e631c34 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:05.184316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:05.197165 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1160/2321] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:41:05 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:05.201879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5eabe-a8bb-4af2-8f28-f43b4eee8ed4 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:05.211944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a5eabe-a8bb-4af2-8f28-f43b4eee8ed4 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:05.217320 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35d77e-f050-4aa4-9032-1187a1bca3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:05.217980 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35d77e-f050-4aa4-9032-1187a1bca3ea admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.218266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35d77e-f050-4aa4-9032-1187a1bca3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.218545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35d77e-f050-4aa4-9032-1187a1bca3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.219273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35d77e-f050-4aa4-9032-1187a1bca3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:05.220894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35d77e-f050-4aa4-9032-1187a1bca3ea admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:05.231200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1162/2322] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:05.235082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb165ce-838c-42c2-be57-21d15e631c34 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:05.245703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb165ce-838c-42c2-be57-21d15e631c34 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:05.251101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d3df1-45d8-4e1b-9de2-af07fea22569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:05.252260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d3df1-45d8-4e1b-9de2-af07fea22569 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.252260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d3df1-45d8-4e1b-9de2-af07fea22569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.252455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d3df1-45d8-4e1b-9de2-af07fea22569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.253109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d3df1-45d8-4e1b-9de2-af07fea22569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:05.254747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d3df1-45d8-4e1b-9de2-af07fea22569 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:05.265770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1161/2323] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:41:05.269929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35d77e-f050-4aa4-9032-1187a1bca3ea admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:05.280191 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35d77e-f050-4aa4-9032-1187a1bca3ea admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:05.285081 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a7669-d094-49b1-a913-db8f51228a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:05.286006 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a7669-d094-49b1-a913-db8f51228a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.286291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a7669-d094-49b1-a913-db8f51228a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.286569 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a7669-d094-49b1-a913-db8f51228a66 admin admin] PATH_INFO: `/v3/projects/023ef16169fb42d6afe8158f067725f2/users/01a67840d5514806b47e99f0afc02778/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.289777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:05.303350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a7669-d094-49b1-a913-db8f51228a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023ef16169fb42d6afe8158f067725f2, user_id=01a67840d5514806b47e99f0afc02778, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:05.306076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a7669-d094-49b1-a913-db8f51228a66 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:05.319083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1163/2324] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:41:05 2022] PUT /identity/v3/projects/023ef16169fb42d6afe8158f067725f2/users/01a67840d5514806b47e99f0afc02778/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:05.330968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470d7a-a8ff-40de-9890-65d792d0a7a4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.331267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470d7a-a8ff-40de-9890-65d792d0a7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.331551 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470d7a-a8ff-40de-9890-65d792d0a7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.357572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d6470d7a-a8ff-40de-9890-65d792d0a7a4 None None] MFA Rules not processed for user `01a67840d5514806b47e99f0afc02778`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:05.358785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d6470d7a-a8ff-40de-9890-65d792d0a7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:05.422331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1162/2325] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:05.426890 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a7669-d094-49b1-a913-db8f51228a66 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:05.488116 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a7669-d094-49b1-a913-db8f51228a66 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:05.492733 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b0f6d-a029-4f2c-a225-af23ca876760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:05.493399 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b0f6d-a029-4f2c-a225-af23ca876760 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.493699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b0f6d-a029-4f2c-a225-af23ca876760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.493955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b0f6d-a029-4f2c-a225-af23ca876760 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.494647 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b0f6d-a029-4f2c-a225-af23ca876760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:05.497461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b0f6d-a029-4f2c-a225-af23ca876760 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:05.522850 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1164/2326] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:41:05 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:05.527121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470d7a-a8ff-40de-9890-65d792d0a7a4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:05.538822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470d7a-a8ff-40de-9890-65d792d0a7a4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:05.594676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20632626-a224-4b5c-8395-6ece6a5ddab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:05.595397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20632626-a224-4b5c-8395-6ece6a5ddab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.595663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20632626-a224-4b5c-8395-6ece6a5ddab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.595941 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20632626-a224-4b5c-8395-6ece6a5ddab5 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.596664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20632626-a224-4b5c-8395-6ece6a5ddab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:05.598646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20632626-a224-4b5c-8395-6ece6a5ddab5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:05.618519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1163/2327] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:41:05 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:05.623244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b0f6d-a029-4f2c-a225-af23ca876760 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:05.633501 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b0f6d-a029-4f2c-a225-af23ca876760 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:05.638449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b977a-b763-4a37-b97e-bad50b479072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:05.639360 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b977a-b763-4a37-b97e-bad50b479072 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.639650 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b977a-b763-4a37-b97e-bad50b479072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.639924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b977a-b763-4a37-b97e-bad50b479072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.640657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b977a-b763-4a37-b97e-bad50b479072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:05.642532 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b977a-b763-4a37-b97e-bad50b479072 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:05.656916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1165/2328] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:05.658420 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20632626-a224-4b5c-8395-6ece6a5ddab5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:05.669169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20632626-a224-4b5c-8395-6ece6a5ddab5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:05.674082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a241cfc-ca6f-47cd-b621-e28a873f5b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:05.674906 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a241cfc-ca6f-47cd-b621-e28a873f5b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.675190 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a241cfc-ca6f-47cd-b621-e28a873f5b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.675466 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a241cfc-ca6f-47cd-b621-e28a873f5b81 admin admin] PATH_INFO: `/v3/projects/58a04aaee591483894dd013981fabe7a/users/6070c3bd15c74406ab7d565f91f1bfcf/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.691626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a241cfc-ca6f-47cd-b621-e28a873f5b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a04aaee591483894dd013981fabe7a, user_id=6070c3bd15c74406ab7d565f91f1bfcf, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:05.694329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a241cfc-ca6f-47cd-b621-e28a873f5b81 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:05.708841 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1164/2329] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:41:05 2022] PUT /identity/v3/projects/58a04aaee591483894dd013981fabe7a/users/6070c3bd15c74406ab7d565f91f1bfcf/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:05.712773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b977a-b763-4a37-b97e-bad50b479072 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:05.722865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b977a-b763-4a37-b97e-bad50b479072 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:05.789702 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e82b9-f400-4077-8fb5-852089696f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:05.790396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e82b9-f400-4077-8fb5-852089696f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.790656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e82b9-f400-4077-8fb5-852089696f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.790937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e82b9-f400-4077-8fb5-852089696f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.792192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e82b9-f400-4077-8fb5-852089696f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:05.794473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e82b9-f400-4077-8fb5-852089696f04 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:05.805110 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1166/2330] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:05.810158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a241cfc-ca6f-47cd-b621-e28a873f5b81 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:05.820518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a241cfc-ca6f-47cd-b621-e28a873f5b81 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:05.825556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbced6-93c8-46ee-8468-bccef7eb7448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:05.826442 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbced6-93c8-46ee-8468-bccef7eb7448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.826728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbced6-93c8-46ee-8468-bccef7eb7448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.827003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbced6-93c8-46ee-8468-bccef7eb7448 admin admin] PATH_INFO: `/v3/projects/58a04aaee591483894dd013981fabe7a/users/6070c3bd15c74406ab7d565f91f1bfcf/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.829121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbced6-93c8-46ee-8468-bccef7eb7448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a04aaee591483894dd013981fabe7a, user_id=6070c3bd15c74406ab7d565f91f1bfcf, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:05.831960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbced6-93c8-46ee-8468-bccef7eb7448 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:05.842538 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1165/2331] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:41:05 2022] PUT /identity/v3/projects/58a04aaee591483894dd013981fabe7a/users/6070c3bd15c74406ab7d565f91f1bfcf/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:05.852414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46bd1d-b5e0-4ec3-a543-550c007f4eea None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:05.852825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46bd1d-b5e0-4ec3-a543-550c007f4eea None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:05.853204 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46bd1d-b5e0-4ec3-a543-550c007f4eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:05.880419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fd46bd1d-b5e0-4ec3-a543-550c007f4eea None None] MFA Rules not processed for user `6070c3bd15c74406ab7d565f91f1bfcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:05.881675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fd46bd1d-b5e0-4ec3-a543-550c007f4eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:05.927560 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:05.953292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1167/2332] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:05.965002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbced6-93c8-46ee-8468-bccef7eb7448 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:05.966787 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-31fbced6-93c8-46ee-8468-bccef7eb7448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:05.994832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:06.026783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbced6-93c8-46ee-8468-bccef7eb7448 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:06.031035 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844ade4-162c-4527-bde5-c3595fb57503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:06.031715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844ade4-162c-4527-bde5-c3595fb57503 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:06.032000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844ade4-162c-4527-bde5-c3595fb57503 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:06.032299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844ade4-162c-4527-bde5-c3595fb57503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:06.041281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844ade4-162c-4527-bde5-c3595fb57503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:06.043330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844ade4-162c-4527-bde5-c3595fb57503 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:06.052610 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1166/2333] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:41:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:06.080498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46bd1d-b5e0-4ec3-a543-550c007f4eea None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:06.145358 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46bd1d-b5e0-4ec3-a543-550c007f4eea None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:06.150019 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:06.150884 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:06.151734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:06.151958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] PATH_INFO: `/v3/users/01a67840d5514806b47e99f0afc02778` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:06.153302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a67840d5514806b47e99f0afc02778)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:06.155243 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:06.203008 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a67840d5514806b47e99f0afc02778'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.203672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a67840d5514806b47e99f0afc02778'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.204290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a67840d5514806b47e99f0afc02778'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.217088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a67840d5514806b47e99f0afc02778'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.223774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a67840d5514806b47e99f0afc02778'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.237635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1168/2334] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:41:06 2022] DELETE /identity/v3/users/01a67840d5514806b47e99f0afc02778 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:06.242359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1702a-3e43-48fe-9db5-535115add0a8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:06.242656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1702a-3e43-48fe-9db5-535115add0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:06.242946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1702a-3e43-48fe-9db5-535115add0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:06.260619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f6b1702a-3e43-48fe-9db5-535115add0a8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:06.261852 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f6b1702a-3e43-48fe-9db5-535115add0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:06.324491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1167/2335] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:06.334114 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:06.335522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:06.393980 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abbb19-7490-4b97-9bcf-1b49c1e610da admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:06.397648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79048ee0-66d7-4f18-bbd3-053b5a985465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:06.398286 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79048ee0-66d7-4f18-bbd3-053b5a985465 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:06.398568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79048ee0-66d7-4f18-bbd3-053b5a985465 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:06.398954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79048ee0-66d7-4f18-bbd3-053b5a985465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:06.408896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79048ee0-66d7-4f18-bbd3-053b5a985465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:06.410333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79048ee0-66d7-4f18-bbd3-053b5a985465 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:06.419933 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1169/2336] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:06.679539 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1702a-3e43-48fe-9db5-535115add0a8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:06.681033 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f6b1702a-3e43-48fe-9db5-535115add0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:06.693113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1702a-3e43-48fe-9db5-535115add0a8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:06.698971 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:06.699951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:06.700234 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:06.700505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] PATH_INFO: `/v3/projects/023ef16169fb42d6afe8158f067725f2` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:06.701789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] RBAC: Authorizing `identity:delete_project(project_id=023ef16169fb42d6afe8158f067725f2)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:06.703710 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:06.751398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023ef16169fb42d6afe8158f067725f2', 'request_id': 'req-3099fc35-37c6-468e-90bc-56d54518efab'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.757966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023ef16169fb42d6afe8158f067725f2', 'request_id': 'req-3099fc35-37c6-468e-90bc-56d54518efab'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.765164 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023ef16169fb42d6afe8158f067725f2', 'request_id': 'req-3099fc35-37c6-468e-90bc-56d54518efab'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.775432 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] The token cache is being invalidate because project 023ef16169fb42d6afe8158f067725f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:06.775721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.776487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.778068 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1168/2337] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:41:06 2022] DELETE /identity/v3/projects/023ef16169fb42d6afe8158f067725f2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:06.781959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79048ee0-66d7-4f18-bbd3-053b5a985465 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:06.786871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:06.793332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79048ee0-66d7-4f18-bbd3-053b5a985465 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:06.853005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f670d-e2ae-471a-ac6b-2565d1549d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:06.853887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f670d-e2ae-471a-ac6b-2565d1549d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:06.854223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f670d-e2ae-471a-ac6b-2565d1549d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:06.854627 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f670d-e2ae-471a-ac6b-2565d1549d2e admin admin] PATH_INFO: `/v3/users/6070c3bd15c74406ab7d565f91f1bfcf` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:06.855973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f670d-e2ae-471a-ac6b-2565d1549d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6070c3bd15c74406ab7d565f91f1bfcf)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:06.857926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f670d-e2ae-471a-ac6b-2565d1549d2e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:06.908895 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9e2f670d-e2ae-471a-ac6b-2565d1549d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6070c3bd15c74406ab7d565f91f1bfcf'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.909558 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9e2f670d-e2ae-471a-ac6b-2565d1549d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6070c3bd15c74406ab7d565f91f1bfcf'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.910159 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9e2f670d-e2ae-471a-ac6b-2565d1549d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6070c3bd15c74406ab7d565f91f1bfcf'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.922839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9e2f670d-e2ae-471a-ac6b-2565d1549d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6070c3bd15c74406ab7d565f91f1bfcf'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.929743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-9e2f670d-e2ae-471a-ac6b-2565d1549d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6070c3bd15c74406ab7d565f91f1bfcf'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:06.943997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1170/2338] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:41:06 2022] DELETE /identity/v3/users/6070c3bd15c74406ab7d565f91f1bfcf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:07.220145 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:07.221610 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:07.237317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099fc35-37c6-468e-90bc-56d54518efab admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:07.289535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:07.300642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffad8ee-2512-44e2-b375-d72da06da9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:07.301555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffad8ee-2512-44e2-b375-d72da06da9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:07.302039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffad8ee-2512-44e2-b375-d72da06da9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:07.302493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffad8ee-2512-44e2-b375-d72da06da9c8 admin admin] PATH_INFO: `/v3/projects/58a04aaee591483894dd013981fabe7a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:07.304254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffad8ee-2512-44e2-b375-d72da06da9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58a04aaee591483894dd013981fabe7a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:07.306438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffad8ee-2512-44e2-b375-d72da06da9c8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:07.358898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ffad8ee-2512-44e2-b375-d72da06da9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58a04aaee591483894dd013981fabe7a', 'request_id': 'req-6ffad8ee-2512-44e2-b375-d72da06da9c8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:07.366681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ffad8ee-2512-44e2-b375-d72da06da9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58a04aaee591483894dd013981fabe7a', 'request_id': 'req-6ffad8ee-2512-44e2-b375-d72da06da9c8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:07.375110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ffad8ee-2512-44e2-b375-d72da06da9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58a04aaee591483894dd013981fabe7a', 'request_id': 'req-6ffad8ee-2512-44e2-b375-d72da06da9c8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:07.385701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ffad8ee-2512-44e2-b375-d72da06da9c8 admin admin] The token cache is being invalidate because project 58a04aaee591483894dd013981fabe7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:07.385987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ffad8ee-2512-44e2-b375-d72da06da9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:07.386639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ffad8ee-2512-44e2-b375-d72da06da9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:07.388186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1169/2339] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:41:07 2022] DELETE /identity/v3/projects/58a04aaee591483894dd013981fabe7a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:07.393312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597193b-f507-4ae9-b018-38b5b61e58ca None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:07.393743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597193b-f507-4ae9-b018-38b5b61e58ca None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:07.393907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597193b-f507-4ae9-b018-38b5b61e58ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:07.411207 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a597193b-f507-4ae9-b018-38b5b61e58ca None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:07.412412 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a597193b-f507-4ae9-b018-38b5b61e58ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:07.471973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1171/2340] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:07.479990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa7d5-40d7-4e04-9e3c-372b53851b22 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:07.480334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa7d5-40d7-4e04-9e3c-372b53851b22 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:07.480642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfa7d5-40d7-4e04-9e3c-372b53851b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:07.499927 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8fcfa7d5-40d7-4e04-9e3c-372b53851b22 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:07.501454 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8fcfa7d5-40d7-4e04-9e3c-372b53851b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:07.509333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1170/2341] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:07.514390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597193b-f507-4ae9-b018-38b5b61e58ca None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:07.524080 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597193b-f507-4ae9-b018-38b5b61e58ca None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:07.528974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f614f3-2b0d-4b9f-b515-d883a8abcbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:07.529635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f614f3-2b0d-4b9f-b515-d883a8abcbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:07.529919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f614f3-2b0d-4b9f-b515-d883a8abcbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:07.530196 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f614f3-2b0d-4b9f-b515-d883a8abcbf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:07.530955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f614f3-2b0d-4b9f-b515-d883a8abcbf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:07.531269 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f614f3-2b0d-4b9f-b515-d883a8abcbf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:07.532891 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f614f3-2b0d-4b9f-b515-d883a8abcbf1 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:07.546070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1172/2342] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:07.550537 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfa7d5-40d7-4e04-9e3c-372b53851b22 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:07.560898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfa7d5-40d7-4e04-9e3c-372b53851b22 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:07.565519 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac6693-ffb7-4957-977e-eaf435724638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:07.566182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6693-ffb7-4957-977e-eaf435724638 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:07.566464 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6693-ffb7-4957-977e-eaf435724638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:07.566740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6693-ffb7-4957-977e-eaf435724638 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:07.567436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac6693-ffb7-4957-977e-eaf435724638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:07.569386 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac6693-ffb7-4957-977e-eaf435724638 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:07.597421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1171/2343] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:41:07 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:07.601526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f614f3-2b0d-4b9f-b515-d883a8abcbf1 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:07.611643 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f614f3-2b0d-4b9f-b515-d883a8abcbf1 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:07.616294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:07.673635 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72d089-b1ec-43b9-ad71-0685fb1319c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:07.674309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72d089-b1ec-43b9-ad71-0685fb1319c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:07.674592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72d089-b1ec-43b9-ad71-0685fb1319c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:07.674867 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72d089-b1ec-43b9-ad71-0685fb1319c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:07.675569 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72d089-b1ec-43b9-ad71-0685fb1319c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:07.677514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72d089-b1ec-43b9-ad71-0685fb1319c7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:07.697894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1173/2344] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:41:07 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:07.703197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac6693-ffb7-4957-977e-eaf435724638 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:07.713738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac6693-ffb7-4957-977e-eaf435724638 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:07.718642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c918c59-8d2a-41b1-95ba-d09a091e4c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:07.719293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c918c59-8d2a-41b1-95ba-d09a091e4c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:07.719575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c918c59-8d2a-41b1-95ba-d09a091e4c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:07.719852 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c918c59-8d2a-41b1-95ba-d09a091e4c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:07.720577 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c918c59-8d2a-41b1-95ba-d09a091e4c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:07.722202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c918c59-8d2a-41b1-95ba-d09a091e4c6d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:07.732641 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1172/2345] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:07.736348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72d089-b1ec-43b9-ad71-0685fb1319c7 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:07.746909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72d089-b1ec-43b9-ad71-0685fb1319c7 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:07.751555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724dd78f-d221-407f-8548-ffc7ef44757d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:07.752201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dd78f-d221-407f-8548-ffc7ef44757d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:07.752484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dd78f-d221-407f-8548-ffc7ef44757d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:07.752796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724dd78f-d221-407f-8548-ffc7ef44757d admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:07.753524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dd78f-d221-407f-8548-ffc7ef44757d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:07.755228 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724dd78f-d221-407f-8548-ffc7ef44757d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:07.766169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1174/2346] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:07.770101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c918c59-8d2a-41b1-95ba-d09a091e4c6d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:07.780040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c918c59-8d2a-41b1-95ba-d09a091e4c6d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:07.784598 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b207ce-6a75-4b22-bf6f-6f8bbf18b0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:07.785493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b207ce-6a75-4b22-bf6f-6f8bbf18b0d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:07.785778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b207ce-6a75-4b22-bf6f-6f8bbf18b0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:07.786050 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b207ce-6a75-4b22-bf6f-6f8bbf18b0d2 admin admin] PATH_INFO: `/v3/projects/843a09bac01b4d0d96ebcbb74f7018ea/users/ec64a154c86e41c6a59c6b21a20b095b/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:07.800430 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b207ce-6a75-4b22-bf6f-6f8bbf18b0d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843a09bac01b4d0d96ebcbb74f7018ea, user_id=ec64a154c86e41c6a59c6b21a20b095b, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:07.803045 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b207ce-6a75-4b22-bf6f-6f8bbf18b0d2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:07.816783 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1173/2347] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:41:07 2022] PUT /identity/v3/projects/843a09bac01b4d0d96ebcbb74f7018ea/users/ec64a154c86e41c6a59c6b21a20b095b/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:07.829145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aaac77-8421-4dab-8436-a321ba4d43ad None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:07.829687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aaac77-8421-4dab-8436-a321ba4d43ad None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:07.829815 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aaac77-8421-4dab-8436-a321ba4d43ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:07.858400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-02aaac77-8421-4dab-8436-a321ba4d43ad None None] MFA Rules not processed for user `ec64a154c86e41c6a59c6b21a20b095b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:07.859678 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-02aaac77-8421-4dab-8436-a321ba4d43ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:07.925660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1175/2348] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:07.930118 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b207ce-6a75-4b22-bf6f-6f8bbf18b0d2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:07.990676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b207ce-6a75-4b22-bf6f-6f8bbf18b0d2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:07.996018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385b53b-090b-4b64-be02-b49bf87f4bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:07.996678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385b53b-090b-4b64-be02-b49bf87f4bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:07.996991 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385b53b-090b-4b64-be02-b49bf87f4bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:07.997270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385b53b-090b-4b64-be02-b49bf87f4bd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:07.997970 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385b53b-090b-4b64-be02-b49bf87f4bd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:07.999888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385b53b-090b-4b64-be02-b49bf87f4bd3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:08.029218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1174/2349] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:41:07 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:08.030700 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aaac77-8421-4dab-8436-a321ba4d43ad None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:08.041435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aaac77-8421-4dab-8436-a321ba4d43ad None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:08.098240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8e2c2-a7ff-486d-9e67-312d22a99427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:08.098946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e2c2-a7ff-486d-9e67-312d22a99427 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:08.099228 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e2c2-a7ff-486d-9e67-312d22a99427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:08.099507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8e2c2-a7ff-486d-9e67-312d22a99427 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:08.100218 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8e2c2-a7ff-486d-9e67-312d22a99427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:08.102195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8e2c2-a7ff-486d-9e67-312d22a99427 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:08.126595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1176/2350] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:41:08 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:08.131272 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385b53b-090b-4b64-be02-b49bf87f4bd3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:08.137361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:08.143374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385b53b-090b-4b64-be02-b49bf87f4bd3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:08.150077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47b82-873d-4160-b8cd-173a30ccabab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:08.151000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47b82-873d-4160-b8cd-173a30ccabab admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:08.151403 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47b82-873d-4160-b8cd-173a30ccabab admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:08.152091 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47b82-873d-4160-b8cd-173a30ccabab admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:08.152931 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f47b82-873d-4160-b8cd-173a30ccabab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:08.154785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f47b82-873d-4160-b8cd-173a30ccabab admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:08.165980 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1175/2351] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:08.170435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8e2c2-a7ff-486d-9e67-312d22a99427 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:08.180446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8e2c2-a7ff-486d-9e67-312d22a99427 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:08.185947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2d913-8708-4f0a-8c97-3afbad4bcf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:08.186621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2d913-8708-4f0a-8c97-3afbad4bcf43 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:08.186909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2d913-8708-4f0a-8c97-3afbad4bcf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:08.187191 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2d913-8708-4f0a-8c97-3afbad4bcf43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:08.187928 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2d913-8708-4f0a-8c97-3afbad4bcf43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:08.189583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2d913-8708-4f0a-8c97-3afbad4bcf43 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:08.190966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:08.202107 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1177/2352] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:08.206397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47b82-873d-4160-b8cd-173a30ccabab admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:08.217155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47b82-873d-4160-b8cd-173a30ccabab admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:08.221812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474c66d-5c12-47e1-9caa-494375a1b1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:08.222691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474c66d-5c12-47e1-9caa-494375a1b1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:08.222970 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474c66d-5c12-47e1-9caa-494375a1b1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:08.223241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474c66d-5c12-47e1-9caa-494375a1b1f1 admin admin] PATH_INFO: `/v3/projects/c16c15461f27466f836f5270a6e812e7/users/b9ab8586a93e4c359b1276ccc981c513/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:08.238763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474c66d-5c12-47e1-9caa-494375a1b1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16c15461f27466f836f5270a6e812e7, user_id=b9ab8586a93e4c359b1276ccc981c513, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:08.241608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474c66d-5c12-47e1-9caa-494375a1b1f1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:08.254503 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1176/2353] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:41:08 2022] PUT /identity/v3/projects/c16c15461f27466f836f5270a6e812e7/users/b9ab8586a93e4c359b1276ccc981c513/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:08.265324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b2303-a94f-4974-b910-2527e4b677bb None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:08.265625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b2303-a94f-4974-b910-2527e4b677bb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:08.265911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b2303-a94f-4974-b910-2527e4b677bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:08.292800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b70b2303-a94f-4974-b910-2527e4b677bb None None] MFA Rules not processed for user `b9ab8586a93e4c359b1276ccc981c513`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:08.294167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b70b2303-a94f-4974-b910-2527e4b677bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:08.357552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1178/2354] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:08.361939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474c66d-5c12-47e1-9caa-494375a1b1f1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:08.424656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474c66d-5c12-47e1-9caa-494375a1b1f1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:08.430889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83229b91-930c-40e8-9fea-e1de6901c6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:08.431876 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83229b91-930c-40e8-9fea-e1de6901c6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:08.432388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83229b91-930c-40e8-9fea-e1de6901c6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:08.432853 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83229b91-930c-40e8-9fea-e1de6901c6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:08.433953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83229b91-930c-40e8-9fea-e1de6901c6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:08.437082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83229b91-930c-40e8-9fea-e1de6901c6d9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:08.471256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1177/2355] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:41:08 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:08.475212 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b2303-a94f-4974-b910-2527e4b677bb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:08.486827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b2303-a94f-4974-b910-2527e4b677bb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:08.543089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53837a7a-6bf7-4bfa-9c50-d7a947f10d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:08.543758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53837a7a-6bf7-4bfa-9c50-d7a947f10d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:08.544043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53837a7a-6bf7-4bfa-9c50-d7a947f10d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:08.544321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53837a7a-6bf7-4bfa-9c50-d7a947f10d5e admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:08.545059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53837a7a-6bf7-4bfa-9c50-d7a947f10d5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:08.547148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53837a7a-6bf7-4bfa-9c50-d7a947f10d5e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:08.567270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1179/2356] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:41:08 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:08.571437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83229b91-930c-40e8-9fea-e1de6901c6d9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:08.582979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83229b91-930c-40e8-9fea-e1de6901c6d9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:08.587706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c29a8-064f-41d5-acbf-605900e3d6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:08.588399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c29a8-064f-41d5-acbf-605900e3d6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:08.588751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c29a8-064f-41d5-acbf-605900e3d6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:08.589026 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c29a8-064f-41d5-acbf-605900e3d6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:08.589754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c29a8-064f-41d5-acbf-605900e3d6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:08.591417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c29a8-064f-41d5-acbf-605900e3d6c6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:08.602595 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1178/2357] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:08.607316 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53837a7a-6bf7-4bfa-9c50-d7a947f10d5e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:08.617208 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53837a7a-6bf7-4bfa-9c50-d7a947f10d5e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:08.621825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0d821-c0ad-419e-9920-c91ffacca555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:08.622758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0d821-c0ad-419e-9920-c91ffacca555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:08.623048 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0d821-c0ad-419e-9920-c91ffacca555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:08.623325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0d821-c0ad-419e-9920-c91ffacca555 admin admin] PATH_INFO: `/v3/projects/ccf224d7ee3e4bf0b2c7dc098e394e66/users/1a2b842b35a946869116c7b224a5153b/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:08.640192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0d821-c0ad-419e-9920-c91ffacca555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf224d7ee3e4bf0b2c7dc098e394e66, user_id=1a2b842b35a946869116c7b224a5153b, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:08.642868 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0d821-c0ad-419e-9920-c91ffacca555 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:08.655720 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1180/2358] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:41:08 2022] PUT /identity/v3/projects/ccf224d7ee3e4bf0b2c7dc098e394e66/users/1a2b842b35a946869116c7b224a5153b/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:08.659541 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c29a8-064f-41d5-acbf-605900e3d6c6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:08.670300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c29a8-064f-41d5-acbf-605900e3d6c6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:08.728553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268efdc-1eed-43d2-ae1d-7fb79c1e543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:08.730010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268efdc-1eed-43d2-ae1d-7fb79c1e543d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:08.730446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268efdc-1eed-43d2-ae1d-7fb79c1e543d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:08.730844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268efdc-1eed-43d2-ae1d-7fb79c1e543d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:08.731996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268efdc-1eed-43d2-ae1d-7fb79c1e543d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:08.734723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268efdc-1eed-43d2-ae1d-7fb79c1e543d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:08.749905 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1179/2359] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:08.754575 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0d821-c0ad-419e-9920-c91ffacca555 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:08.766106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0d821-c0ad-419e-9920-c91ffacca555 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:08.770902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43191233-b8c2-413a-a2ce-5639d0d27b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:08.771941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43191233-b8c2-413a-a2ce-5639d0d27b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:08.772252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43191233-b8c2-413a-a2ce-5639d0d27b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:08.772579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43191233-b8c2-413a-a2ce-5639d0d27b44 admin admin] PATH_INFO: `/v3/projects/ccf224d7ee3e4bf0b2c7dc098e394e66/users/1a2b842b35a946869116c7b224a5153b/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:08.774849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43191233-b8c2-413a-a2ce-5639d0d27b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf224d7ee3e4bf0b2c7dc098e394e66, user_id=1a2b842b35a946869116c7b224a5153b, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:08.777593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43191233-b8c2-413a-a2ce-5639d0d27b44 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:08.787972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1181/2360] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:41:08 2022] PUT /identity/v3/projects/ccf224d7ee3e4bf0b2c7dc098e394e66/users/1a2b842b35a946869116c7b224a5153b/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:08.799563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a8277-b532-4ade-9643-7bee02098a77 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:08.799861 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a8277-b532-4ade-9643-7bee02098a77 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:08.800144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a8277-b532-4ade-9643-7bee02098a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:08.827293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a27a8277-b532-4ade-9643-7bee02098a77 None None] MFA Rules not processed for user `1a2b842b35a946869116c7b224a5153b`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:08.828504 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a27a8277-b532-4ade-9643-7bee02098a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:08.853905 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:08.899945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1180/2361] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:08.911648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43191233-b8c2-413a-a2ce-5639d0d27b44 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:08.913559 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-43191233-b8c2-413a-a2ce-5639d0d27b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:08.957339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:08.974109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43191233-b8c2-413a-a2ce-5639d0d27b44 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:08.977844 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab617dc-e55c-4467-af5f-d99de227c53b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:08.978487 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab617dc-e55c-4467-af5f-d99de227c53b service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:08.978770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab617dc-e55c-4467-af5f-d99de227c53b service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:08.979725 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab617dc-e55c-4467-af5f-d99de227c53b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:08.989295 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab617dc-e55c-4467-af5f-d99de227c53b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:08.990752 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab617dc-e55c-4467-af5f-d99de227c53b service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:09.000102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1182/2362] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:41:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:09.044766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a8277-b532-4ade-9643-7bee02098a77 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:09.046159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a27a8277-b532-4ade-9643-7bee02098a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:09.058137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a8277-b532-4ade-9643-7bee02098a77 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:09.061713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2895b-d2a5-48e6-9f86-47618e35ccab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:09.062345 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2895b-d2a5-48e6-9f86-47618e35ccab service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:09.062624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2895b-d2a5-48e6-9f86-47618e35ccab service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:09.062896 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2895b-d2a5-48e6-9f86-47618e35ccab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:09.118758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2895b-d2a5-48e6-9f86-47618e35ccab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:09.120598 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2895b-d2a5-48e6-9f86-47618e35ccab service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:09.129301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1181/2363] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:41:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:11.983145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab617dc-e55c-4467-af5f-d99de227c53b service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:12.046837 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab617dc-e55c-4467-af5f-d99de227c53b service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:12.051428 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:12.052311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:12.052596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:12.052903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] PATH_INFO: `/v3/users/ec64a154c86e41c6a59c6b21a20b095b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:12.054112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec64a154c86e41c6a59c6b21a20b095b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:12.056066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:12.110097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec64a154c86e41c6a59c6b21a20b095b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.110861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec64a154c86e41c6a59c6b21a20b095b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.111554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec64a154c86e41c6a59c6b21a20b095b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.123990 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec64a154c86e41c6a59c6b21a20b095b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.130761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec64a154c86e41c6a59c6b21a20b095b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.144311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1183/2364] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:41:11 2022] DELETE /identity/v3/users/ec64a154c86e41c6a59c6b21a20b095b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:12.148805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100eb6a-f079-4da6-a356-97540c5fe4cf None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:12.149292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100eb6a-f079-4da6-a356-97540c5fe4cf None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:12.149389 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100eb6a-f079-4da6-a356-97540c5fe4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:12.167173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c100eb6a-f079-4da6-a356-97540c5fe4cf None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:12.169117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c100eb6a-f079-4da6-a356-97540c5fe4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:12.227110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1182/2365] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:12.237757 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:12.239170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:12.296786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dbd19-a582-40c0-9666-00a8801e5dc0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:12.300467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd86f5-8fe3-4504-9e72-df881ff7b28f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:12.301149 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd86f5-8fe3-4504-9e72-df881ff7b28f service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:12.301435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd86f5-8fe3-4504-9e72-df881ff7b28f service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:12.301779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd86f5-8fe3-4504-9e72-df881ff7b28f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:12.311119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd86f5-8fe3-4504-9e72-df881ff7b28f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:12.312556 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd86f5-8fe3-4504-9e72-df881ff7b28f service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:12.322007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1184/2366] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:12.597903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100eb6a-f079-4da6-a356-97540c5fe4cf None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:12.599521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c100eb6a-f079-4da6-a356-97540c5fe4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:12.613602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100eb6a-f079-4da6-a356-97540c5fe4cf None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:12.618241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:12.619646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:12.619941 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:12.620533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] PATH_INFO: `/v3/projects/843a09bac01b4d0d96ebcbb74f7018ea` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:12.621882 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] RBAC: Authorizing `identity:delete_project(project_id=843a09bac01b4d0d96ebcbb74f7018ea)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:12.623875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:12.677703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843a09bac01b4d0d96ebcbb74f7018ea', 'request_id': 'req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.685351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843a09bac01b4d0d96ebcbb74f7018ea', 'request_id': 'req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.686521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:12.693285 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843a09bac01b4d0d96ebcbb74f7018ea', 'request_id': 'req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.706533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] The token cache is being invalidate because project 843a09bac01b4d0d96ebcbb74f7018ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:12.706829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.707539 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.709133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1183/2367] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:41:12 2022] DELETE /identity/v3/projects/843a09bac01b4d0d96ebcbb74f7018ea => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:12.713042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd86f5-8fe3-4504-9e72-df881ff7b28f service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:12.718127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:12.726361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd86f5-8fe3-4504-9e72-df881ff7b28f service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:12.791194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:12.792214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:12.792614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:12.792957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] PATH_INFO: `/v3/users/b9ab8586a93e4c359b1276ccc981c513` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:12.794517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ab8586a93e4c359b1276ccc981c513)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:12.796636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:12.847407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ab8586a93e4c359b1276ccc981c513'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.848079 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ab8586a93e4c359b1276ccc981c513'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.848677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ab8586a93e4c359b1276ccc981c513'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.860661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ab8586a93e4c359b1276ccc981c513'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.867679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ab8586a93e4c359b1276ccc981c513'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:12.885943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1185/2368] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:41:12 2022] DELETE /identity/v3/users/b9ab8586a93e4c359b1276ccc981c513 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:13.153660 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:13.155223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:13.168804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7678f9a-fa9b-4699-8fb6-1d7a5760618a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:13.226938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:13.227798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:13.228080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:13.228353 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] PATH_INFO: `/v3/projects/c16c15461f27466f836f5270a6e812e7` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:13.229585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16c15461f27466f836f5270a6e812e7)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:13.231644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:13.279640 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16c15461f27466f836f5270a6e812e7', 'request_id': 'req-e1b6634f-b438-408b-afac-85cb9c8c2910'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.286689 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16c15461f27466f836f5270a6e812e7', 'request_id': 'req-e1b6634f-b438-408b-afac-85cb9c8c2910'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.293101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16c15461f27466f836f5270a6e812e7', 'request_id': 'req-e1b6634f-b438-408b-afac-85cb9c8c2910'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.303572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] The token cache is being invalidate because project c16c15461f27466f836f5270a6e812e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:13.303864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.304494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.306054 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1184/2369] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:41:13 2022] DELETE /identity/v3/projects/c16c15461f27466f836f5270a6e812e7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:13.310336 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:13.311758 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:13.324788 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6670d-07d3-492b-9efd-290e59c9d20b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:13.379941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25317826-7fab-4a70-b195-25a38358167b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:13.380868 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25317826-7fab-4a70-b195-25a38358167b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:13.381151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25317826-7fab-4a70-b195-25a38358167b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:13.381427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25317826-7fab-4a70-b195-25a38358167b admin admin] PATH_INFO: `/v3/users/1a2b842b35a946869116c7b224a5153b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:13.382609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25317826-7fab-4a70-b195-25a38358167b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2b842b35a946869116c7b224a5153b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:13.384525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25317826-7fab-4a70-b195-25a38358167b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:13.411098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:13.441856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-25317826-7fab-4a70-b195-25a38358167b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2b842b35a946869116c7b224a5153b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.442637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-25317826-7fab-4a70-b195-25a38358167b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2b842b35a946869116c7b224a5153b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.443502 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-25317826-7fab-4a70-b195-25a38358167b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2b842b35a946869116c7b224a5153b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.456375 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-25317826-7fab-4a70-b195-25a38358167b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2b842b35a946869116c7b224a5153b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.463222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-25317826-7fab-4a70-b195-25a38358167b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2b842b35a946869116c7b224a5153b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.476587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1186/2370] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:41:13 2022] DELETE /identity/v3/users/1a2b842b35a946869116c7b224a5153b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:13.761757 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:13.763298 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:13.777409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6634f-b438-408b-afac-85cb9c8c2910 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:13.841397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075cc4f-1352-4868-85f0-818a7a72633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:13.842276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075cc4f-1352-4868-85f0-818a7a72633a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:13.842586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075cc4f-1352-4868-85f0-818a7a72633a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:13.842865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075cc4f-1352-4868-85f0-818a7a72633a admin admin] PATH_INFO: `/v3/projects/ccf224d7ee3e4bf0b2c7dc098e394e66` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:13.844039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075cc4f-1352-4868-85f0-818a7a72633a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf224d7ee3e4bf0b2c7dc098e394e66)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:13.845999 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075cc4f-1352-4868-85f0-818a7a72633a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:13.865782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:13.900501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d075cc4f-1352-4868-85f0-818a7a72633a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf224d7ee3e4bf0b2c7dc098e394e66', 'request_id': 'req-d075cc4f-1352-4868-85f0-818a7a72633a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.909369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d075cc4f-1352-4868-85f0-818a7a72633a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf224d7ee3e4bf0b2c7dc098e394e66', 'request_id': 'req-d075cc4f-1352-4868-85f0-818a7a72633a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.916276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d075cc4f-1352-4868-85f0-818a7a72633a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf224d7ee3e4bf0b2c7dc098e394e66', 'request_id': 'req-d075cc4f-1352-4868-85f0-818a7a72633a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.927389 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d075cc4f-1352-4868-85f0-818a7a72633a admin admin] The token cache is being invalidate because project ccf224d7ee3e4bf0b2c7dc098e394e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:13.927675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d075cc4f-1352-4868-85f0-818a7a72633a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.928342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d075cc4f-1352-4868-85f0-818a7a72633a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:13.929930 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1185/2371] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:41:13 2022] DELETE /identity/v3/projects/ccf224d7ee3e4bf0b2c7dc098e394e66 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:13.937081 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9e24d-390d-4405-bbea-cbcbc51b7a74 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:13.937378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9e24d-390d-4405-bbea-cbcbc51b7a74 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:13.937661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9e24d-390d-4405-bbea-cbcbc51b7a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:13.957108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-26e9e24d-390d-4405-bbea-cbcbc51b7a74 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:13.958339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-26e9e24d-390d-4405-bbea-cbcbc51b7a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:14.021430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1187/2372] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:14.030272 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce588-0480-47c0-8fb7-f6d143d6a0c8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.030640 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce588-0480-47c0-8fb7-f6d143d6a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.031039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ce588-0480-47c0-8fb7-f6d143d6a0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.049903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-714ce588-0480-47c0-8fb7-f6d143d6a0c8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:14.051132 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-714ce588-0480-47c0-8fb7-f6d143d6a0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:14.059616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1186/2373] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:14.063790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9e24d-390d-4405-bbea-cbcbc51b7a74 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:14.073388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9e24d-390d-4405-bbea-cbcbc51b7a74 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:14.078095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808ba56-a300-49f0-9c6c-4c652609b9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:14.078747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808ba56-a300-49f0-9c6c-4c652609b9cc admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.079030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808ba56-a300-49f0-9c6c-4c652609b9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.079304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808ba56-a300-49f0-9c6c-4c652609b9cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.080027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808ba56-a300-49f0-9c6c-4c652609b9cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:14.080338 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808ba56-a300-49f0-9c6c-4c652609b9cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:14.081985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808ba56-a300-49f0-9c6c-4c652609b9cc admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:14.093904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1188/2374] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:14.098322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce588-0480-47c0-8fb7-f6d143d6a0c8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:14.108537 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ce588-0480-47c0-8fb7-f6d143d6a0c8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:14.113193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b929f83-38b6-45b3-8222-554fbf52b454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:14.113837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b929f83-38b6-45b3-8222-554fbf52b454 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.114119 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b929f83-38b6-45b3-8222-554fbf52b454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.114398 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b929f83-38b6-45b3-8222-554fbf52b454 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.115090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b929f83-38b6-45b3-8222-554fbf52b454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:14.117038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b929f83-38b6-45b3-8222-554fbf52b454 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:14.142495 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1187/2375] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:41:14 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:14.146578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808ba56-a300-49f0-9c6c-4c652609b9cc admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:14.156575 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808ba56-a300-49f0-9c6c-4c652609b9cc admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:14.213001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7cbec-e38e-4c5f-a110-f7cb77121625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:14.213676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7cbec-e38e-4c5f-a110-f7cb77121625 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.213965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7cbec-e38e-4c5f-a110-f7cb77121625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.214811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7cbec-e38e-4c5f-a110-f7cb77121625 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.215494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7cbec-e38e-4c5f-a110-f7cb77121625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:14.217450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7cbec-e38e-4c5f-a110-f7cb77121625 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:14.236430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1189/2376] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:41:14 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:14.240684 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b929f83-38b6-45b3-8222-554fbf52b454 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:14.251072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b929f83-38b6-45b3-8222-554fbf52b454 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:14.255698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbd57b-b38f-4cec-b2e3-7e0810f57686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:14.256356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbd57b-b38f-4cec-b2e3-7e0810f57686 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.256637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbd57b-b38f-4cec-b2e3-7e0810f57686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.256950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbd57b-b38f-4cec-b2e3-7e0810f57686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.257675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbd57b-b38f-4cec-b2e3-7e0810f57686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:14.259264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbd57b-b38f-4cec-b2e3-7e0810f57686 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:14.271032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1188/2377] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:41:14.275174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7cbec-e38e-4c5f-a110-f7cb77121625 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:14.286187 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7cbec-e38e-4c5f-a110-f7cb77121625 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:14.291076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb70e0-73ec-43e0-9058-ab1b280febd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:14.291779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb70e0-73ec-43e0-9058-ab1b280febd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.292059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb70e0-73ec-43e0-9058-ab1b280febd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.292943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb70e0-73ec-43e0-9058-ab1b280febd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.293727 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb70e0-73ec-43e0-9058-ab1b280febd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:14.295347 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb70e0-73ec-43e0-9058-ab1b280febd6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:14.305197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1190/2378] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:14.309607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbd57b-b38f-4cec-b2e3-7e0810f57686 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:14.319305 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbd57b-b38f-4cec-b2e3-7e0810f57686 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:14.324018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f9be0-efa7-4f32-af63-b16bbd45375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:14.324912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f9be0-efa7-4f32-af63-b16bbd45375f admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.325196 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f9be0-efa7-4f32-af63-b16bbd45375f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.325472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f9be0-efa7-4f32-af63-b16bbd45375f admin admin] PATH_INFO: `/v3/projects/88426e3fc5154fe59820f0cebc97b789/users/ec202ade378c4aa286b715125aa09a9b/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.340153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f9be0-efa7-4f32-af63-b16bbd45375f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88426e3fc5154fe59820f0cebc97b789, user_id=ec202ade378c4aa286b715125aa09a9b, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:14.342894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f9be0-efa7-4f32-af63-b16bbd45375f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:14.356669 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1189/2379] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:41:14 2022] PUT /identity/v3/projects/88426e3fc5154fe59820f0cebc97b789/users/ec202ade378c4aa286b715125aa09a9b/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:14.367841 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2476c-6d8a-4a73-b84c-4fc5aed2e20f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.368327 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2476c-6d8a-4a73-b84c-4fc5aed2e20f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.368455 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2476c-6d8a-4a73-b84c-4fc5aed2e20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.381668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:14.397329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c2b2476c-6d8a-4a73-b84c-4fc5aed2e20f None None] MFA Rules not processed for user `ec202ade378c4aa286b715125aa09a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:14.398534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c2b2476c-6d8a-4a73-b84c-4fc5aed2e20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:14.474518 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1191/2380] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:14.479177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f9be0-efa7-4f32-af63-b16bbd45375f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:14.541106 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f9be0-efa7-4f32-af63-b16bbd45375f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:14.546375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea2ceb-7494-4fb4-8621-6438969d3f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:14.547027 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2ceb-7494-4fb4-8621-6438969d3f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.547306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2ceb-7494-4fb4-8621-6438969d3f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.547578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2ceb-7494-4fb4-8621-6438969d3f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.548265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea2ceb-7494-4fb4-8621-6438969d3f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:14.550192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea2ceb-7494-4fb4-8621-6438969d3f98 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:14.574774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1190/2381] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:41:14 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:14.578803 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2476c-6d8a-4a73-b84c-4fc5aed2e20f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:14.590085 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2476c-6d8a-4a73-b84c-4fc5aed2e20f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:14.647541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5c7de-5db6-475a-8a8c-78ecec7e463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:14.648031 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5c7de-5db6-475a-8a8c-78ecec7e463f admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.648318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5c7de-5db6-475a-8a8c-78ecec7e463f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.648593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5c7de-5db6-475a-8a8c-78ecec7e463f admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.649334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5c7de-5db6-475a-8a8c-78ecec7e463f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:14.651353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5c7de-5db6-475a-8a8c-78ecec7e463f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:14.671202 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1192/2382] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:41:14 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:14.675182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea2ceb-7494-4fb4-8621-6438969d3f98 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:14.685352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea2ceb-7494-4fb4-8621-6438969d3f98 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:14.689965 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264fba6-225e-4c3e-8e56-c015d8a24cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:14.690619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264fba6-225e-4c3e-8e56-c015d8a24cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.690922 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264fba6-225e-4c3e-8e56-c015d8a24cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.691183 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264fba6-225e-4c3e-8e56-c015d8a24cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.691908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264fba6-225e-4c3e-8e56-c015d8a24cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:14.693546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264fba6-225e-4c3e-8e56-c015d8a24cf2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:14.707641 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1191/2383] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:14.709458 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5c7de-5db6-475a-8a8c-78ecec7e463f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:14.720007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5c7de-5db6-475a-8a8c-78ecec7e463f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:14.724690 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d46cb9-4a9f-4c2e-9232-eb74aa7a85aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:14.725604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46cb9-4a9f-4c2e-9232-eb74aa7a85aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.725887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46cb9-4a9f-4c2e-9232-eb74aa7a85aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.726161 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d46cb9-4a9f-4c2e-9232-eb74aa7a85aa admin admin] PATH_INFO: `/v3/projects/67e9b769ffcd41debd9a68402e299c29/users/2d519504d00545548d2c67eb714aad36/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.741085 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d46cb9-4a9f-4c2e-9232-eb74aa7a85aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e9b769ffcd41debd9a68402e299c29, user_id=2d519504d00545548d2c67eb714aad36, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:14.743699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d46cb9-4a9f-4c2e-9232-eb74aa7a85aa admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:14.756631 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1193/2384] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:41:14 2022] PUT /identity/v3/projects/67e9b769ffcd41debd9a68402e299c29/users/2d519504d00545548d2c67eb714aad36/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:14.760532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264fba6-225e-4c3e-8e56-c015d8a24cf2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:14.788538 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264fba6-225e-4c3e-8e56-c015d8a24cf2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:14.800898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:14.848926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03415e01-726f-47c2-8170-815bcf24a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:14.849593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03415e01-726f-47c2-8170-815bcf24a542 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.849873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03415e01-726f-47c2-8170-815bcf24a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.850144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03415e01-726f-47c2-8170-815bcf24a542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.850875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03415e01-726f-47c2-8170-815bcf24a542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:14.852472 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03415e01-726f-47c2-8170-815bcf24a542 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:14.862567 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1192/2385] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:14.866735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d46cb9-4a9f-4c2e-9232-eb74aa7a85aa admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:14.877546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d46cb9-4a9f-4c2e-9232-eb74aa7a85aa admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:14.882251 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d481b02-f5a1-402f-aa66-7d8a4023c6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:14.883147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d481b02-f5a1-402f-aa66-7d8a4023c6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.883429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d481b02-f5a1-402f-aa66-7d8a4023c6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.883702 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d481b02-f5a1-402f-aa66-7d8a4023c6a9 admin admin] PATH_INFO: `/v3/projects/67e9b769ffcd41debd9a68402e299c29/users/2d519504d00545548d2c67eb714aad36/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.885717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d481b02-f5a1-402f-aa66-7d8a4023c6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e9b769ffcd41debd9a68402e299c29, user_id=2d519504d00545548d2c67eb714aad36, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:14.889328 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d481b02-f5a1-402f-aa66-7d8a4023c6a9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:14.899767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1194/2386] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:41:14 2022] PUT /identity/v3/projects/67e9b769ffcd41debd9a68402e299c29/users/2d519504d00545548d2c67eb714aad36/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:14.911083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68688-bdec-4fcf-bc39-91ccaca97d07 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:14.911378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68688-bdec-4fcf-bc39-91ccaca97d07 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:14.911656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68688-bdec-4fcf-bc39-91ccaca97d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:14.939415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-72e68688-bdec-4fcf-bc39-91ccaca97d07 None None] MFA Rules not processed for user `2d519504d00545548d2c67eb714aad36`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:14.940770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-72e68688-bdec-4fcf-bc39-91ccaca97d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:15.008008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1193/2387] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:15.020042 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d481b02-f5a1-402f-aa66-7d8a4023c6a9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:15.021787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4d481b02-f5a1-402f-aa66-7d8a4023c6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:15.075152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:15.079376 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d481b02-f5a1-402f-aa66-7d8a4023c6a9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:15.084085 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3a192-99a0-4602-ae52-2bb525f1dbc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:15.084757 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3a192-99a0-4602-ae52-2bb525f1dbc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:15.085043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3a192-99a0-4602-ae52-2bb525f1dbc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:15.085319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3a192-99a0-4602-ae52-2bb525f1dbc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:15.095325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3a192-99a0-4602-ae52-2bb525f1dbc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:15.096798 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3a192-99a0-4602-ae52-2bb525f1dbc9 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:15.106784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1195/2388] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:41:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:15.194053 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e68688-bdec-4fcf-bc39-91ccaca97d07 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:15.203559 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e68688-bdec-4fcf-bc39-91ccaca97d07 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:15.207193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5774d-c911-4587-85b8-bcb88a392b3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:15.207827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5774d-c911-4587-85b8-bcb88a392b3f service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:15.208182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5774d-c911-4587-85b8-bcb88a392b3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:15.208460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5774d-c911-4587-85b8-bcb88a392b3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:15.265453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5774d-c911-4587-85b8-bcb88a392b3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:15.266899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5774d-c911-4587-85b8-bcb88a392b3f service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:15.275687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1194/2389] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:41:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:15.530071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3a192-99a0-4602-ae52-2bb525f1dbc9 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:15.592102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3a192-99a0-4602-ae52-2bb525f1dbc9 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:15.596599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:15.597493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:15.597778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:15.598056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] PATH_INFO: `/v3/users/ec202ade378c4aa286b715125aa09a9b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:15.599233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec202ade378c4aa286b715125aa09a9b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:15.601204 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:15.652947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec202ade378c4aa286b715125aa09a9b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:15.653609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec202ade378c4aa286b715125aa09a9b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:15.654223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec202ade378c4aa286b715125aa09a9b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:15.666276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec202ade378c4aa286b715125aa09a9b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:15.673888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec202ade378c4aa286b715125aa09a9b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:15.690088 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1196/2390] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:41:15 2022] DELETE /identity/v3/users/ec202ade378c4aa286b715125aa09a9b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:15.694892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33c8c7-804c-4c8d-b3a3-4adcba7da60d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:15.695109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33c8c7-804c-4c8d-b3a3-4adcba7da60d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:15.695388 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33c8c7-804c-4c8d-b3a3-4adcba7da60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:15.718419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7f33c8c7-804c-4c8d-b3a3-4adcba7da60d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:15.719648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7f33c8c7-804c-4c8d-b3a3-4adcba7da60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:15.751078 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:15.779889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1195/2391] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:41:15.789468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:15.790854 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:15.864655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54e7dc-17e4-49d0-9990-a6af0dab133b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:15.869055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c676ee7-43a2-4c6a-85e2-f84ec6f916f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:15.869711 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676ee7-43a2-4c6a-85e2-f84ec6f916f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:15.869999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676ee7-43a2-4c6a-85e2-f84ec6f916f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:15.870267 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c676ee7-43a2-4c6a-85e2-f84ec6f916f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:15.880293 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c676ee7-43a2-4c6a-85e2-f84ec6f916f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:15.881795 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c676ee7-43a2-4c6a-85e2-f84ec6f916f2 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:15.897197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1197/2392] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:16.223540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33c8c7-804c-4c8d-b3a3-4adcba7da60d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:16.228267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7f33c8c7-804c-4c8d-b3a3-4adcba7da60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:16.239693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33c8c7-804c-4c8d-b3a3-4adcba7da60d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:16.244728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:16.245731 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:16.246982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:16.247268 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] PATH_INFO: `/v3/projects/88426e3fc5154fe59820f0cebc97b789` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:16.254209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88426e3fc5154fe59820f0cebc97b789)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:16.255724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:16.319863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88426e3fc5154fe59820f0cebc97b789', 'request_id': 'req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:16.329814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88426e3fc5154fe59820f0cebc97b789', 'request_id': 'req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:16.338020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88426e3fc5154fe59820f0cebc97b789', 'request_id': 'req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:16.350856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] The token cache is being invalidate because project 88426e3fc5154fe59820f0cebc97b789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:16.351187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:16.351871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:16.353892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1196/2393] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:41:16 2022] DELETE /identity/v3/projects/88426e3fc5154fe59820f0cebc97b789 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:16.359866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c676ee7-43a2-4c6a-85e2-f84ec6f916f2 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:16.370331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c676ee7-43a2-4c6a-85e2-f84ec6f916f2 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:16.387685 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:16.443484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37b105-18e8-4194-8d34-65589c2c085a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:16.444693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37b105-18e8-4194-8d34-65589c2c085a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:16.444693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37b105-18e8-4194-8d34-65589c2c085a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:16.444936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37b105-18e8-4194-8d34-65589c2c085a admin admin] PATH_INFO: `/v3/users/2d519504d00545548d2c67eb714aad36` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:16.446182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37b105-18e8-4194-8d34-65589c2c085a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d519504d00545548d2c67eb714aad36)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:16.448120 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37b105-18e8-4194-8d34-65589c2c085a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:16.507701 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3b37b105-18e8-4194-8d34-65589c2c085a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d519504d00545548d2c67eb714aad36'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:16.508627 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3b37b105-18e8-4194-8d34-65589c2c085a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d519504d00545548d2c67eb714aad36'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:16.509283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3b37b105-18e8-4194-8d34-65589c2c085a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d519504d00545548d2c67eb714aad36'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:16.528363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3b37b105-18e8-4194-8d34-65589c2c085a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d519504d00545548d2c67eb714aad36'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:16.536214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-3b37b105-18e8-4194-8d34-65589c2c085a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d519504d00545548d2c67eb714aad36'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:16.549748 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1198/2394] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:41:16 2022] DELETE /identity/v3/users/2d519504d00545548d2c67eb714aad36 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:16.825390 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:16.826997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:16.842946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671d684-f7e5-49b6-85f4-4c67c53e3ba8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:16.922889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba6c28-4618-44e0-b281-4ff38dce2433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:16.923883 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba6c28-4618-44e0-b281-4ff38dce2433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:16.924249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba6c28-4618-44e0-b281-4ff38dce2433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:16.924531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba6c28-4618-44e0-b281-4ff38dce2433 admin admin] PATH_INFO: `/v3/projects/67e9b769ffcd41debd9a68402e299c29` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:16.925791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba6c28-4618-44e0-b281-4ff38dce2433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e9b769ffcd41debd9a68402e299c29)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:16.927743 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba6c28-4618-44e0-b281-4ff38dce2433 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:16.981974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a3ba6c28-4618-44e0-b281-4ff38dce2433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e9b769ffcd41debd9a68402e299c29', 'request_id': 'req-a3ba6c28-4618-44e0-b281-4ff38dce2433'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:16.989711 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a3ba6c28-4618-44e0-b281-4ff38dce2433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e9b769ffcd41debd9a68402e299c29', 'request_id': 'req-a3ba6c28-4618-44e0-b281-4ff38dce2433'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:16.997135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a3ba6c28-4618-44e0-b281-4ff38dce2433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e9b769ffcd41debd9a68402e299c29', 'request_id': 'req-a3ba6c28-4618-44e0-b281-4ff38dce2433'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:16.998373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:17.010635 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a3ba6c28-4618-44e0-b281-4ff38dce2433 admin admin] The token cache is being invalidate because project 67e9b769ffcd41debd9a68402e299c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:41:17.012125 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a3ba6c28-4618-44e0-b281-4ff38dce2433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:17.012125 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a3ba6c28-4618-44e0-b281-4ff38dce2433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:41:17.013513 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1197/2395] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:41:16 2022] DELETE /identity/v3/projects/67e9b769ffcd41debd9a68402e299c29 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:41:17.019782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cbc5-a7c4-4fde-ade5-dad2a7b71ec7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:17.020374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cbc5-a7c4-4fde-ade5-dad2a7b71ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:17.020732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309cbc5-a7c4-4fde-ade5-dad2a7b71ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:17.043224 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7309cbc5-a7c4-4fde-ade5-dad2a7b71ec7 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:17.044435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7309cbc5-a7c4-4fde-ade5-dad2a7b71ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:17.106212 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1199/2396] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:17.114228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ccb17-3d75-4a48-bf29-d0e2c6e73913 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:17.114523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ccb17-3d75-4a48-bf29-d0e2c6e73913 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:17.114805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ccb17-3d75-4a48-bf29-d0e2c6e73913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:17.133656 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a03ccb17-3d75-4a48-bf29-d0e2c6e73913 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:17.134880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a03ccb17-3d75-4a48-bf29-d0e2c6e73913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:17.146266 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1198/2397] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:17.147466 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309cbc5-a7c4-4fde-ade5-dad2a7b71ec7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:17.157626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309cbc5-a7c4-4fde-ade5-dad2a7b71ec7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:17.162323 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ddc81-6583-4598-a8e6-7d8ed8327e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:17.162981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ddc81-6583-4598-a8e6-7d8ed8327e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:17.163269 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ddc81-6583-4598-a8e6-7d8ed8327e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:17.163551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ddc81-6583-4598-a8e6-7d8ed8327e85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:17.164280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ddc81-6583-4598-a8e6-7d8ed8327e85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:41:17.164593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ddc81-6583-4598-a8e6-7d8ed8327e85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:17.166365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ddc81-6583-4598-a8e6-7d8ed8327e85 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:17.178720 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1200/2398] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:41:17.183719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ccb17-3d75-4a48-bf29-d0e2c6e73913 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:17.193214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ccb17-3d75-4a48-bf29-d0e2c6e73913 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:17.198139 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f6190-ebe7-45f0-a2d9-064452306721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:17.198837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f6190-ebe7-45f0-a2d9-064452306721 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:17.199123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f6190-ebe7-45f0-a2d9-064452306721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:17.199409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f6190-ebe7-45f0-a2d9-064452306721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:17.200098 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f6190-ebe7-45f0-a2d9-064452306721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:17.202182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f6190-ebe7-45f0-a2d9-064452306721 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:17.229132 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1199/2399] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:41:17 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:17.234272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ddc81-6583-4598-a8e6-7d8ed8327e85 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:17.244087 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ddc81-6583-4598-a8e6-7d8ed8327e85 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:17.261000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:17.302307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f01ffc-c3db-4b43-b31f-af4a35a1c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:17.302898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f01ffc-c3db-4b43-b31f-af4a35a1c205 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:17.303179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f01ffc-c3db-4b43-b31f-af4a35a1c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:17.303455 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f01ffc-c3db-4b43-b31f-af4a35a1c205 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:17.304148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f01ffc-c3db-4b43-b31f-af4a35a1c205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:17.306087 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f01ffc-c3db-4b43-b31f-af4a35a1c205 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:17.327272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1201/2400] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:41:17 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:41:17.331617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f6190-ebe7-45f0-a2d9-064452306721 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:17.342483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f6190-ebe7-45f0-a2d9-064452306721 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:17.347093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df015e-c696-4540-b186-852705a7e8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:17.347747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df015e-c696-4540-b186-852705a7e8eb admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:17.348032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df015e-c696-4540-b186-852705a7e8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:17.348306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df015e-c696-4540-b186-852705a7e8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:17.349069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df015e-c696-4540-b186-852705a7e8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:17.350666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df015e-c696-4540-b186-852705a7e8eb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:17.361557 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1200/2401] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:17.365386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f01ffc-c3db-4b43-b31f-af4a35a1c205 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:17.375303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f01ffc-c3db-4b43-b31f-af4a35a1c205 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:17.379953 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d282a-1268-4b6e-b094-845c7c65f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:17.380601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d282a-1268-4b6e-b094-845c7c65f157 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:17.380921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d282a-1268-4b6e-b094-845c7c65f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:17.381198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d282a-1268-4b6e-b094-845c7c65f157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:17.381919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d282a-1268-4b6e-b094-845c7c65f157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:17.383494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d282a-1268-4b6e-b094-845c7c65f157 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:17.393573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1202/2402] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:17.397792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df015e-c696-4540-b186-852705a7e8eb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:17.408701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df015e-c696-4540-b186-852705a7e8eb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:17.413763 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618044-f0c4-4148-84cf-b536d70ab1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:17.414671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618044-f0c4-4148-84cf-b536d70ab1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:17.414952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618044-f0c4-4148-84cf-b536d70ab1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:17.415226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618044-f0c4-4148-84cf-b536d70ab1b5 admin admin] PATH_INFO: `/v3/projects/e7afe51e6433414db2377407e4e768af/users/1bf3400608b941b796b01cbc20ddb21b/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:17.430812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df618044-f0c4-4148-84cf-b536d70ab1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7afe51e6433414db2377407e4e768af, user_id=1bf3400608b941b796b01cbc20ddb21b, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:17.433888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df618044-f0c4-4148-84cf-b536d70ab1b5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:17.446396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1201/2403] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:41:17 2022] PUT /identity/v3/projects/e7afe51e6433414db2377407e4e768af/users/1bf3400608b941b796b01cbc20ddb21b/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:41:17.456803 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cf3fc-cc55-46e6-b2ab-f036ad864bb5 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:17.457095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cf3fc-cc55-46e6-b2ab-f036ad864bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:17.457492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cf3fc-cc55-46e6-b2ab-f036ad864bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:17.485153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-a67cf3fc-cc55-46e6-b2ab-f036ad864bb5 None None] MFA Rules not processed for user `1bf3400608b941b796b01cbc20ddb21b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:17.486352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a67cf3fc-cc55-46e6-b2ab-f036ad864bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:17.550719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1203/2404] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:17.563058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618044-f0c4-4148-84cf-b536d70ab1b5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:17.564707 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-df618044-f0c4-4148-84cf-b536d70ab1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:17.622902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618044-f0c4-4148-84cf-b536d70ab1b5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:17.626522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779863fb-b6f5-41ed-9b34-dca5165d2c41 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e854100c04be43c78bce1f95ff85bfc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:17.627163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779863fb-b6f5-41ed-9b34-dca5165d2c41 service glance] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:17.627443 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779863fb-b6f5-41ed-9b34-dca5165d2c41 service glance] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:17.627716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779863fb-b6f5-41ed-9b34-dca5165d2c41 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:17.636265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779863fb-b6f5-41ed-9b34-dca5165d2c41 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:17.637735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779863fb-b6f5-41ed-9b34-dca5165d2c41 service glance] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:17.646888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1202/2405] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:41:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:27.547920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=57,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:27.642717 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=2,keystone:SELECT=56,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:53.550926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845f209-0e81-4555-834d-91c1be40bc01 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:53.551512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845f209-0e81-4555-834d-91c1be40bc01 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:53.551512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845f209-0e81-4555-834d-91c1be40bc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:53.569537 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e845f209-0e81-4555-834d-91c1be40bc01 None None] MFA Rules not processed for user `1156b006d6e1426a84a521d397491135`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:53.570824 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e845f209-0e81-4555-834d-91c1be40bc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:53.625657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1204/2406] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:03.618462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=25 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:07.893811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779863fb-b6f5-41ed-9b34-dca5165d2c41 service glance] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:07.956265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779863fb-b6f5-41ed-9b34-dca5165d2c41 service glance] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:07.960832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:07.961729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:07.962013 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:07.962288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] PATH_INFO: `/v3/users/1bf3400608b941b796b01cbc20ddb21b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:07.963471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf3400608b941b796b01cbc20ddb21b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:07.965422 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:08.011173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf3400608b941b796b01cbc20ddb21b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:08.011830 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf3400608b941b796b01cbc20ddb21b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:08.012452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf3400608b941b796b01cbc20ddb21b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:08.027300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf3400608b941b796b01cbc20ddb21b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:08.034485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf3400608b941b796b01cbc20ddb21b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:08.049052 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1203/2407] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:42:07 2022] DELETE /identity/v3/users/1bf3400608b941b796b01cbc20ddb21b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:42:08.053687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae65d-b416-487c-b208-ee925ad37ea7 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.054274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae65d-b416-487c-b208-ee925ad37ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.054274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fae65d-b416-487c-b208-ee925ad37ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.073041 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d7fae65d-b416-487c-b208-ee925ad37ea7 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:08.074234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d7fae65d-b416-487c-b208-ee925ad37ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:08.138947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1205/2408] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:08.149233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:08.151164 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:08.211251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95117b5d-880f-4249-b8aa-c3fc28c05fbc admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:08.214751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fd6c9-153c-4a11-9a6b-ffed7631014a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:08.215387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd6c9-153c-4a11-9a6b-ffed7631014a service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.215724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd6c9-153c-4a11-9a6b-ffed7631014a service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.215999 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fd6c9-153c-4a11-9a6b-ffed7631014a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.225756 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fd6c9-153c-4a11-9a6b-ffed7631014a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:08.227185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33fd6c9-153c-4a11-9a6b-ffed7631014a service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:08.237515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1204/2409] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:08.505117 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fae65d-b416-487c-b208-ee925ad37ea7 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:08.506573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d7fae65d-b416-487c-b208-ee925ad37ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:08.520298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fae65d-b416-487c-b208-ee925ad37ea7 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:08.525047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77cdf0-145b-4c39-8c85-e9113d30f70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:08.525941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77cdf0-145b-4c39-8c85-e9113d30f70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.526295 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77cdf0-145b-4c39-8c85-e9113d30f70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.526592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77cdf0-145b-4c39-8c85-e9113d30f70d admin admin] PATH_INFO: `/v3/projects/e7afe51e6433414db2377407e4e768af` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.527792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77cdf0-145b-4c39-8c85-e9113d30f70d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7afe51e6433414db2377407e4e768af)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:08.529761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77cdf0-145b-4c39-8c85-e9113d30f70d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:08.579517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ef77cdf0-145b-4c39-8c85-e9113d30f70d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7afe51e6433414db2377407e4e768af', 'request_id': 'req-ef77cdf0-145b-4c39-8c85-e9113d30f70d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:08.587469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ef77cdf0-145b-4c39-8c85-e9113d30f70d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7afe51e6433414db2377407e4e768af', 'request_id': 'req-ef77cdf0-145b-4c39-8c85-e9113d30f70d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:08.595338 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ef77cdf0-145b-4c39-8c85-e9113d30f70d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7afe51e6433414db2377407e4e768af', 'request_id': 'req-ef77cdf0-145b-4c39-8c85-e9113d30f70d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:08.606505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ef77cdf0-145b-4c39-8c85-e9113d30f70d admin admin] The token cache is being invalidate because project e7afe51e6433414db2377407e4e768af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:42:08.606798 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ef77cdf0-145b-4c39-8c85-e9113d30f70d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:08.607450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ef77cdf0-145b-4c39-8c85-e9113d30f70d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:08.609674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1206/2410] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:42:08 2022] DELETE /identity/v3/projects/e7afe51e6433414db2377407e4e768af => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:42:08.615247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa510964-304a-4e8d-8317-c83e20ea667f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.615608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa510964-304a-4e8d-8317-c83e20ea667f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.615951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa510964-304a-4e8d-8317-c83e20ea667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.634571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fa510964-304a-4e8d-8317-c83e20ea667f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:08.635777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fa510964-304a-4e8d-8317-c83e20ea667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:08.654227 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:08.706002 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1205/2411] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:08.713623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a2b40-85b1-4ee4-9258-ef5ee057aa2e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.714095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a2b40-85b1-4ee4-9258-ef5ee057aa2e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.714379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a2b40-85b1-4ee4-9258-ef5ee057aa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.733828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-7e7a2b40-85b1-4ee4-9258-ef5ee057aa2e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:08.735627 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7e7a2b40-85b1-4ee4-9258-ef5ee057aa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:08.745111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1207/2412] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:42:08.748980 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa510964-304a-4e8d-8317-c83e20ea667f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:08.759431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa510964-304a-4e8d-8317-c83e20ea667f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:08.764148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72e417-06d4-46a5-b74d-eccf5925ebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:08.765093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72e417-06d4-46a5-b74d-eccf5925ebe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.765445 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72e417-06d4-46a5-b74d-eccf5925ebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.765728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72e417-06d4-46a5-b74d-eccf5925ebe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.766467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72e417-06d4-46a5-b74d-eccf5925ebe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:42:08.766789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72e417-06d4-46a5-b74d-eccf5925ebe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:08.768470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72e417-06d4-46a5-b74d-eccf5925ebe5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:08.780806 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1206/2413] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:42:08.785590 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a2b40-85b1-4ee4-9258-ef5ee057aa2e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:08.795350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a2b40-85b1-4ee4-9258-ef5ee057aa2e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:08.800998 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5958d-321b-4cca-87e9-82bbdcdd87a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:08.801658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5958d-321b-4cca-87e9-82bbdcdd87a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.801945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5958d-321b-4cca-87e9-82bbdcdd87a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.802227 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5958d-321b-4cca-87e9-82bbdcdd87a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.802924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5958d-321b-4cca-87e9-82bbdcdd87a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:08.804949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5958d-321b-4cca-87e9-82bbdcdd87a8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:08.837936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1208/2414] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:42:08 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:42:08.839118 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72e417-06d4-46a5-b74d-eccf5925ebe5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:08.852200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72e417-06d4-46a5-b74d-eccf5925ebe5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:08.925881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c4d95-8a38-46ff-82a0-80ea0cafe4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:08.926558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c4d95-8a38-46ff-82a0-80ea0cafe4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.927236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c4d95-8a38-46ff-82a0-80ea0cafe4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.927236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c4d95-8a38-46ff-82a0-80ea0cafe4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.927812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c4d95-8a38-46ff-82a0-80ea0cafe4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:08.929805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c4d95-8a38-46ff-82a0-80ea0cafe4e4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:08.956316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1207/2415] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:42:08 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:42:08.957830 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5958d-321b-4cca-87e9-82bbdcdd87a8 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:08.969239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5958d-321b-4cca-87e9-82bbdcdd87a8 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:08.974241 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651d19c-e747-4abe-a7a7-b9d7104d13a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:08.974929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d19c-e747-4abe-a7a7-b9d7104d13a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.975248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d19c-e747-4abe-a7a7-b9d7104d13a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.975533 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d19c-e747-4abe-a7a7-b9d7104d13a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.976274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651d19c-e747-4abe-a7a7-b9d7104d13a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:08.977942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651d19c-e747-4abe-a7a7-b9d7104d13a1 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:08.989834 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1209/2416] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:42:08.993590 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c4d95-8a38-46ff-82a0-80ea0cafe4e4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:09.004542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c4d95-8a38-46ff-82a0-80ea0cafe4e4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:09.009237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76667770-5c5b-4376-bec1-643440d18538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:09.009907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76667770-5c5b-4376-bec1-643440d18538 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:09.010197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76667770-5c5b-4376-bec1-643440d18538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:09.010479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76667770-5c5b-4376-bec1-643440d18538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:09.011238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76667770-5c5b-4376-bec1-643440d18538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:09.012913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76667770-5c5b-4376-bec1-643440d18538 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:09.023749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1208/2417] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:42:09.028029 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651d19c-e747-4abe-a7a7-b9d7104d13a1 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:09.039330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651d19c-e747-4abe-a7a7-b9d7104d13a1 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:09.044319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc14266-2d30-45d8-a8f0-2e8c766caf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:09.045546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc14266-2d30-45d8-a8f0-2e8c766caf68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:09.045835 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc14266-2d30-45d8-a8f0-2e8c766caf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:09.046112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc14266-2d30-45d8-a8f0-2e8c766caf68 admin admin] PATH_INFO: `/v3/projects/91ce6c14fb95466dab6338cd0fafcd0e/users/7ff0a10504ef4323a853d5f721c05299/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:09.062056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc14266-2d30-45d8-a8f0-2e8c766caf68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ce6c14fb95466dab6338cd0fafcd0e, user_id=7ff0a10504ef4323a853d5f721c05299, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:09.065061 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc14266-2d30-45d8-a8f0-2e8c766caf68 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:09.078623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1210/2418] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:42:09 2022] PUT /identity/v3/projects/91ce6c14fb95466dab6338cd0fafcd0e/users/7ff0a10504ef4323a853d5f721c05299/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:42:09.084442 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2399c3-234a-4475-9cfa-a5329c752182 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:09.084924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2399c3-234a-4475-9cfa-a5329c752182 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:09.085348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2399c3-234a-4475-9cfa-a5329c752182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:09.106648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9b2399c3-234a-4475-9cfa-a5329c752182 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:09.108066 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9b2399c3-234a-4475-9cfa-a5329c752182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:09.177724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1209/2419] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:09.188094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc14266-2d30-45d8-a8f0-2e8c766caf68 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:09.190229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4cc14266-2d30-45d8-a8f0-2e8c766caf68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:09.214110 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:09.255224 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc14266-2d30-45d8-a8f0-2e8c766caf68 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:09.259112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d8587-67a8-45e5-83c6-7a4fb1d44bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:09.259771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d8587-67a8-45e5-83c6-7a4fb1d44bbf service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:09.260051 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d8587-67a8-45e5-83c6-7a4fb1d44bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:09.260326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d8587-67a8-45e5-83c6-7a4fb1d44bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:09.271056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d8587-67a8-45e5-83c6-7a4fb1d44bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:09.272499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d8587-67a8-45e5-83c6-7a4fb1d44bbf service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:09.282902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1211/2420] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:42:14.101010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357cd40-eed3-4350-b292-876decfe2e70 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:14.101912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357cd40-eed3-4350-b292-876decfe2e70 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:14.102197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357cd40-eed3-4350-b292-876decfe2e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:14.167019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c357cd40-eed3-4350-b292-876decfe2e70 None None] MFA Rules not processed for user `7ff0a10504ef4323a853d5f721c05299`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:14.168594 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c357cd40-eed3-4350-b292-876decfe2e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:14.215399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:14.298479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1210/2421] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:42:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:14.302701 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d8587-67a8-45e5-83c6-7a4fb1d44bbf service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:14.313798 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d8587-67a8-45e5-83c6-7a4fb1d44bbf service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:14.319788 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f63e0d-409e-4051-b45a-b71e2fa9af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:14.320934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f63e0d-409e-4051-b45a-b71e2fa9af2d admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:14.321442 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f63e0d-409e-4051-b45a-b71e2fa9af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:14.321955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f63e0d-409e-4051-b45a-b71e2fa9af2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:14.322922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f63e0d-409e-4051-b45a-b71e2fa9af2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:14.325909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f63e0d-409e-4051-b45a-b71e2fa9af2d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:14.370621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1212/2422] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:42:14 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:42:14.375509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357cd40-eed3-4350-b292-876decfe2e70 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:14.386894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357cd40-eed3-4350-b292-876decfe2e70 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:14.455851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b5fc1-be23-487d-b67a-9e8d9b95c3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:14.457108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5fc1-be23-487d-b67a-9e8d9b95c3ea admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:14.457108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5fc1-be23-487d-b67a-9e8d9b95c3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:14.457108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b5fc1-be23-487d-b67a-9e8d9b95c3ea admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:14.457857 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b5fc1-be23-487d-b67a-9e8d9b95c3ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:14.459905 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b5fc1-be23-487d-b67a-9e8d9b95c3ea admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:14.488633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1211/2423] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:42:14 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:42:14.489859 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f63e0d-409e-4051-b45a-b71e2fa9af2d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:14.527554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f63e0d-409e-4051-b45a-b71e2fa9af2d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:14.543007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d40f14-ba97-4049-95e7-5641ad061317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:14.543703 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40f14-ba97-4049-95e7-5641ad061317 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:14.544122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40f14-ba97-4049-95e7-5641ad061317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:14.544405 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d40f14-ba97-4049-95e7-5641ad061317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:14.556412 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d40f14-ba97-4049-95e7-5641ad061317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:14.558239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d40f14-ba97-4049-95e7-5641ad061317 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:14.576568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1213/2424] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:42:14.580862 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b5fc1-be23-487d-b67a-9e8d9b95c3ea admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:14.594216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b5fc1-be23-487d-b67a-9e8d9b95c3ea admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:14.601558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893da658-24f0-4afe-ad55-0c0f94e32650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:14.602583 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893da658-24f0-4afe-ad55-0c0f94e32650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:14.602944 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893da658-24f0-4afe-ad55-0c0f94e32650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:14.603303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893da658-24f0-4afe-ad55-0c0f94e32650 admin admin] PATH_INFO: `/v3/projects/ca2f7e7d7e624cb99ecf139eb17be670/users/71f18383527647b5bd69f049db82d357/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:14.622711 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893da658-24f0-4afe-ad55-0c0f94e32650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2f7e7d7e624cb99ecf139eb17be670, user_id=71f18383527647b5bd69f049db82d357, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:14.625855 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893da658-24f0-4afe-ad55-0c0f94e32650 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:14.646005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1212/2425] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:42:14 2022] PUT /identity/v3/projects/ca2f7e7d7e624cb99ecf139eb17be670/users/71f18383527647b5bd69f049db82d357/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:42:14.649739 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d40f14-ba97-4049-95e7-5641ad061317 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:14.662513 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d40f14-ba97-4049-95e7-5641ad061317 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:14.742460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b3cb8-2913-4895-9702-2598541e7c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:14.743343 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b3cb8-2913-4895-9702-2598541e7c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:14.743626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b3cb8-2913-4895-9702-2598541e7c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:14.744082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b3cb8-2913-4895-9702-2598541e7c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:14.744923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b3cb8-2913-4895-9702-2598541e7c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:14.747253 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b3cb8-2913-4895-9702-2598541e7c93 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:14.760371 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1214/2426] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:42:14.764385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893da658-24f0-4afe-ad55-0c0f94e32650 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:14.776849 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893da658-24f0-4afe-ad55-0c0f94e32650 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:14.782800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142064a7-91c6-4177-bf71-550e1dcdaefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:14.783714 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142064a7-91c6-4177-bf71-550e1dcdaefc admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:14.783990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142064a7-91c6-4177-bf71-550e1dcdaefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:14.784264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142064a7-91c6-4177-bf71-550e1dcdaefc admin admin] PATH_INFO: `/v3/projects/ca2f7e7d7e624cb99ecf139eb17be670/users/71f18383527647b5bd69f049db82d357/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:14.786370 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142064a7-91c6-4177-bf71-550e1dcdaefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2f7e7d7e624cb99ecf139eb17be670, user_id=71f18383527647b5bd69f049db82d357, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:14.789080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142064a7-91c6-4177-bf71-550e1dcdaefc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:14.803385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1213/2427] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:42:14 2022] PUT /identity/v3/projects/ca2f7e7d7e624cb99ecf139eb17be670/users/71f18383527647b5bd69f049db82d357/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:42:18.202181 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4413-3dd9-48b8-8f88-8adc8f54ab7d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:18.203290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4413-3dd9-48b8-8f88-8adc8f54ab7d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:18.203623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4413-3dd9-48b8-8f88-8adc8f54ab7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:18.230832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0a7a4413-3dd9-48b8-8f88-8adc8f54ab7d None None] MFA Rules not processed for user `7b14606965a74c71881595c71bdd2d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:18.232514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0a7a4413-3dd9-48b8-8f88-8adc8f54ab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:18.316190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1215/2428] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:42:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:21.302005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58ad8d-91c5-4914-9d35-f2ecd57a053c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:21.302939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58ad8d-91c5-4914-9d35-f2ecd57a053c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:21.303331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58ad8d-91c5-4914-9d35-f2ecd57a053c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:21.334495 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3c58ad8d-91c5-4914-9d35-f2ecd57a053c None None] MFA Rules not processed for user `71f18383527647b5bd69f049db82d357`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:21.335988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3c58ad8d-91c5-4914-9d35-f2ecd57a053c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:21.405061 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:21.416987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1214/2429] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:42:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:21.430291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4413-3dd9-48b8-8f88-8adc8f54ab7d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:21.432284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0a7a4413-3dd9-48b8-8f88-8adc8f54ab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:21.472290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:21.505332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4413-3dd9-48b8-8f88-8adc8f54ab7d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:21.509309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0e524-4bcb-4b1b-8282-a4c9468e8ef6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e854100c04be43c78bce1f95ff85bfc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:21.509988 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0e524-4bcb-4b1b-8282-a4c9468e8ef6 service glance] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:21.510266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0e524-4bcb-4b1b-8282-a4c9468e8ef6 service glance] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:21.510540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0e524-4bcb-4b1b-8282-a4c9468e8ef6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:21.590907 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0e524-4bcb-4b1b-8282-a4c9468e8ef6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:21.592978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0e524-4bcb-4b1b-8282-a4c9468e8ef6 service glance] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:21.604783 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1216/2430] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:42:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:21.733399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6479c-4d0e-44ef-9ae9-bee4c4963672 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:21.733687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6479c-4d0e-44ef-9ae9-bee4c4963672 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:21.734072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6479c-4d0e-44ef-9ae9-bee4c4963672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:21.754747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-afc6479c-4d0e-44ef-9ae9-bee4c4963672 None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:21.756734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-afc6479c-4d0e-44ef-9ae9-bee4c4963672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:21.821301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1215/2431] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:42:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:21.877774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0e524-4bcb-4b1b-8282-a4c9468e8ef6 service glance] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:21.879216 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a4a0e524-4bcb-4b1b-8282-a4c9468e8ef6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:21.963308 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0e524-4bcb-4b1b-8282-a4c9468e8ef6 service glance] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:21.969077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecb0b1-85a2-4224-927b-f6d94a0cdc24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:21.969746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecb0b1-85a2-4224-927b-f6d94a0cdc24 service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:21.970036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecb0b1-85a2-4224-927b-f6d94a0cdc24 service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:21.970461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecb0b1-85a2-4224-927b-f6d94a0cdc24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:21.980109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecb0b1-85a2-4224-927b-f6d94a0cdc24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:21.981425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecb0b1-85a2-4224-927b-f6d94a0cdc24 service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:21.993814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1217/2432] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:42:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:42:26.000321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6479c-4d0e-44ef-9ae9-bee4c4963672 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:26.074881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6479c-4d0e-44ef-9ae9-bee4c4963672 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:26.078779 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaf20b-9f8c-4c1b-9add-df33d0d57ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:26.079443 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaf20b-9f8c-4c1b-9add-df33d0d57ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:26.079729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaf20b-9f8c-4c1b-9add-df33d0d57ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:26.080008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaf20b-9f8c-4c1b-9add-df33d0d57ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:26.087433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4eaaf20b-9f8c-4c1b-9add-df33d0d57ca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:26.203522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaf20b-9f8c-4c1b-9add-df33d0d57ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:26.207068 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaf20b-9f8c-4c1b-9add-df33d0d57ca3 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:26.227950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1216/2433] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:42:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:26.649098 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecb0b1-85a2-4224-927b-f6d94a0cdc24 service swift] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:26.663224 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecb0b1-85a2-4224-927b-f6d94a0cdc24 service swift] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:26.670446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fbbde-afdc-406f-a73c-99f585d015f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:26.671411 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fbbde-afdc-406f-a73c-99f585d015f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:26.671549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fbbde-afdc-406f-a73c-99f585d015f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:26.671810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fbbde-afdc-406f-a73c-99f585d015f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:26.673743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7f2fbbde-afdc-406f-a73c-99f585d015f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:26.690832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fbbde-afdc-406f-a73c-99f585d015f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:26.692277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fbbde-afdc-406f-a73c-99f585d015f0 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:26.706318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1218/2434] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:42:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:32.153342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3bdb5-e84f-4fd1-af4a-ac6667f73ac1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:32.153831 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3bdb5-e84f-4fd1-af4a-ac6667f73ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:32.154173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3bdb5-e84f-4fd1-af4a-ac6667f73ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:32.174197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a0b3bdb5-e84f-4fd1-af4a-ac6667f73ac1 None None] MFA Rules not processed for user `7ff0a10504ef4323a853d5f721c05299`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:32.175408 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a0b3bdb5-e84f-4fd1-af4a-ac6667f73ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:32.182346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1217/2435] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:42:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:36.039956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7f313-44f9-44fc-9366-044521607cfc None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:36.040451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7f313-44f9-44fc-9366-044521607cfc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:36.040656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7f313-44f9-44fc-9366-044521607cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:36.077429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-78d7f313-44f9-44fc-9366-044521607cfc None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:36.080812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-78d7f313-44f9-44fc-9366-044521607cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:36.100809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1219/2436] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:42:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:36.113928 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3bdb5-e84f-4fd1-af4a-ac6667f73ac1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:36.125215 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111967-8eab-49e7-bcf3-c7e52727ca1f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:36.125505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111967-8eab-49e7-bcf3-c7e52727ca1f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:36.125783 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53111967-8eab-49e7-bcf3-c7e52727ca1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:36.132676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3bdb5-e84f-4fd1-af4a-ac6667f73ac1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:36.139528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39736b-7a51-4ff8-a5fa-7bf1e3b7c7ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:36.140183 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39736b-7a51-4ff8-a5fa-7bf1e3b7c7ba service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:36.140746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39736b-7a51-4ff8-a5fa-7bf1e3b7c7ba service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:36.142419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39736b-7a51-4ff8-a5fa-7bf1e3b7c7ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:36.146755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-53111967-8eab-49e7-bcf3-c7e52727ca1f None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:36.147970 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-53111967-8eab-49e7-bcf3-c7e52727ca1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:36.155054 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39736b-7a51-4ff8-a5fa-7bf1e3b7c7ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:36.156591 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1220/2437] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:42:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:42:36.156748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39736b-7a51-4ff8-a5fa-7bf1e3b7c7ba service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:36.176859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1218/2438] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:42:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:42:36.177698 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111967-8eab-49e7-bcf3-c7e52727ca1f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:36.190547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53111967-8eab-49e7-bcf3-c7e52727ca1f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:36.196032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e1b29-07da-4d29-8795-ce2e1a35a01a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:36.196667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1b29-07da-4d29-8795-ce2e1a35a01a service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:36.196991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1b29-07da-4d29-8795-ce2e1a35a01a service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:36.197274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e1b29-07da-4d29-8795-ce2e1a35a01a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:36.208510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e1b29-07da-4d29-8795-ce2e1a35a01a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:36.210436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e1b29-07da-4d29-8795-ce2e1a35a01a service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:36.223756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1221/2439] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:42:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:42:46.164043 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:46.217727 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=84 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:46.255609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39736b-7a51-4ff8-a5fa-7bf1e3b7c7ba service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:46.257828 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-df39736b-7a51-4ff8-a5fa-7bf1e3b7c7ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:46.294936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39736b-7a51-4ff8-a5fa-7bf1e3b7c7ba service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:46.305386 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63ba2b-04b9-4cb1-9816-95f3f370605c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:46.307339 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63ba2b-04b9-4cb1-9816-95f3f370605c service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:46.307626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63ba2b-04b9-4cb1-9816-95f3f370605c service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:46.307895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63ba2b-04b9-4cb1-9816-95f3f370605c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:46.309785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3f63ba2b-04b9-4cb1-9816-95f3f370605c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:46.459671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63ba2b-04b9-4cb1-9816-95f3f370605c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:46.464191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63ba2b-04b9-4cb1-9816-95f3f370605c service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:46.567939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1219/2440] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:42:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:50.879755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e1b29-07da-4d29-8795-ce2e1a35a01a service swift] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:50.892021 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63ba2b-04b9-4cb1-9816-95f3f370605c service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:50.892625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e1b29-07da-4d29-8795-ce2e1a35a01a service swift] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:50.894846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3f63ba2b-04b9-4cb1-9816-95f3f370605c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:50.897568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ef873-fc8b-4dab-8698-537944641316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:50.898317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ef873-fc8b-4dab-8698-537944641316 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:50.898602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ef873-fc8b-4dab-8698-537944641316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:50.898875 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ef873-fc8b-4dab-8698-537944641316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:50.900827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6f4ef873-fc8b-4dab-8698-537944641316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:50.908336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63ba2b-04b9-4cb1-9816-95f3f370605c service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:50.912141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce7624-7c16-49f1-9ebd-a10dc7aa2dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:50.912445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ef873-fc8b-4dab-8698-537944641316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:50.912845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce7624-7c16-49f1-9ebd-a10dc7aa2dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:50.913147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce7624-7c16-49f1-9ebd-a10dc7aa2dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:50.913413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce7624-7c16-49f1-9ebd-a10dc7aa2dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:50.914138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ef873-fc8b-4dab-8698-537944641316 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:50.921381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce7624-7c16-49f1-9ebd-a10dc7aa2dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:50.923068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1222/2441] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:42:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:50.923661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce7624-7c16-49f1-9ebd-a10dc7aa2dd0 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:50.932426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1220/2442] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:42:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:58.644146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0605c2d-71fc-4663-b850-58da9816d196 None None] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:58.644663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0605c2d-71fc-4663-b850-58da9816d196 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:58.644856 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0605c2d-71fc-4663-b850-58da9816d196 None None] PATH_INFO: `/` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:58.646233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1223/2443] 10.222.0.39 () {54 vars in 921 bytes} [Thu May 26 12:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:42:58.651166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a429379-d5b8-4c72-92f0-5eb16f356000 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:58.651604 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a429379-d5b8-4c72-92f0-5eb16f356000 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:58.651869 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a429379-d5b8-4c72-92f0-5eb16f356000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:58.673617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8a429379-d5b8-4c72-92f0-5eb16f356000 None None] MFA Rules not processed for user `04f5fbbe45ec4dcf8301da8483af2941`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:58.674825 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8a429379-d5b8-4c72-92f0-5eb16f356000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:58.684634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1221/2444] 10.222.0.39 () {58 vars in 1018 bytes} [Thu May 26 12:42:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:58.696729 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0605c2d-71fc-4663-b850-58da9816d196 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:58.709224 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0605c2d-71fc-4663-b850-58da9816d196 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:58.713530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9b285-2879-47ed-9970-2838799e9d98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e854100c04be43c78bce1f95ff85bfc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:58.714179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9b285-2879-47ed-9970-2838799e9d98 service glance] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:58.714469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9b285-2879-47ed-9970-2838799e9d98 service glance] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:58.714753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9b285-2879-47ed-9970-2838799e9d98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:58.725766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9b285-2879-47ed-9970-2838799e9d98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:58.727190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9b285-2879-47ed-9970-2838799e9d98 service glance] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:58.739035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1224/2445] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:42:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:58.958498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a429379-d5b8-4c72-92f0-5eb16f356000 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:58.959907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8a429379-d5b8-4c72-92f0-5eb16f356000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:59.034569 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a429379-d5b8-4c72-92f0-5eb16f356000 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:59.039559 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c96cfb-10c9-4335-81b3-f26eb092a41c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:59.040209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c96cfb-10c9-4335-81b3-f26eb092a41c service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:59.040496 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c96cfb-10c9-4335-81b3-f26eb092a41c service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:59.040802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c96cfb-10c9-4335-81b3-f26eb092a41c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:59.042564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-98c96cfb-10c9-4335-81b3-f26eb092a41c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:59.054372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c96cfb-10c9-4335-81b3-f26eb092a41c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:59.055970 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c96cfb-10c9-4335-81b3-f26eb092a41c service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:59.066348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1222/2446] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:42:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:01.169962 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a5352-3112-4162-a963-e5d3e619c140 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:01.170455 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a5352-3112-4162-a963-e5d3e619c140 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:01.170564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a5352-3112-4162-a963-e5d3e619c140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:01.189775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-852a5352-3112-4162-a963-e5d3e619c140 None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:01.190977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-852a5352-3112-4162-a963-e5d3e619c140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:01.198092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1225/2447] 10.222.0.39 () {58 vars in 1009 bytes} [Thu May 26 12:43:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:43:01.209961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c96cfb-10c9-4335-81b3-f26eb092a41c service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:01.221636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c96cfb-10c9-4335-81b3-f26eb092a41c service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:01.227276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21399d-e991-4324-844c-b2f61f72e8b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:01.227923 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21399d-e991-4324-844c-b2f61f72e8b3 service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:01.228208 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21399d-e991-4324-844c-b2f61f72e8b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:01.228486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21399d-e991-4324-844c-b2f61f72e8b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:01.237824 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21399d-e991-4324-844c-b2f61f72e8b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:01.239418 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21399d-e991-4324-844c-b2f61f72e8b3 service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:01.247452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1223/2448] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:43:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:43:11.183773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=15 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:11.244270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:14.943185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a5352-3112-4162-a963-e5d3e619c140 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:14.952552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a5352-3112-4162-a963-e5d3e619c140 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:14.956091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd6143-8862-4bb7-a0af-8d1da89167af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:14.956750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6143-8862-4bb7-a0af-8d1da89167af service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:14.957036 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6143-8862-4bb7-a0af-8d1da89167af service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:14.957315 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6143-8862-4bb7-a0af-8d1da89167af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:14.959079 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-51fd6143-8862-4bb7-a0af-8d1da89167af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:15.024005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd6143-8862-4bb7-a0af-8d1da89167af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:15.025490 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd6143-8862-4bb7-a0af-8d1da89167af service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:15.035845 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1226/2449] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:43:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:22.246482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21399d-e991-4324-844c-b2f61f72e8b3 service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:22.257501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21399d-e991-4324-844c-b2f61f72e8b3 service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:22.261037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040d1b2-016b-4e71-b3f0-46895a2bcdf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:22.261669 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040d1b2-016b-4e71-b3f0-46895a2bcdf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:22.261948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040d1b2-016b-4e71-b3f0-46895a2bcdf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:22.262220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040d1b2-016b-4e71-b3f0-46895a2bcdf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:22.263967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b040d1b2-016b-4e71-b3f0-46895a2bcdf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:22.327712 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040d1b2-016b-4e71-b3f0-46895a2bcdf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:22.329123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040d1b2-016b-4e71-b3f0-46895a2bcdf2 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:22.339330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1224/2450] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:23.839027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96aeb3-e9e7-481c-9ccc-aa6ae2cdeee6 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:23.839504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96aeb3-e9e7-481c-9ccc-aa6ae2cdeee6 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:23.839614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96aeb3-e9e7-481c-9ccc-aa6ae2cdeee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:23.857385 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fb96aeb3-e9e7-481c-9ccc-aa6ae2cdeee6 None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:23.858514 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fb96aeb3-e9e7-481c-9ccc-aa6ae2cdeee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:23.866010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1227/2451] 10.222.0.39 () {58 vars in 967 bytes} [Thu May 26 12:43:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:23.893968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040d1b2-016b-4e71-b3f0-46895a2bcdf2 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:23.905343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040d1b2-016b-4e71-b3f0-46895a2bcdf2 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:23.911036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91b9a3-0332-40a1-8be1-d52a0afd66da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:23.911678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b9a3-0332-40a1-8be1-d52a0afd66da service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:23.911959 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b9a3-0332-40a1-8be1-d52a0afd66da service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:23.912232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b9a3-0332-40a1-8be1-d52a0afd66da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:23.920492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91b9a3-0332-40a1-8be1-d52a0afd66da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:23.922121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91b9a3-0332-40a1-8be1-d52a0afd66da service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:23.932143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1225/2452] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:43:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:43:25.893885 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96aeb3-e9e7-481c-9ccc-aa6ae2cdeee6 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:25.895390 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fb96aeb3-e9e7-481c-9ccc-aa6ae2cdeee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:25.911669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96aeb3-e9e7-481c-9ccc-aa6ae2cdeee6 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:25.917319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd37b9-39a3-4981-98d0-798210b63acf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:25.918045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd37b9-39a3-4981-98d0-798210b63acf service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:25.918337 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd37b9-39a3-4981-98d0-798210b63acf service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:25.918621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd37b9-39a3-4981-98d0-798210b63acf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:25.920692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-64cd37b9-39a3-4981-98d0-798210b63acf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:25.935808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd37b9-39a3-4981-98d0-798210b63acf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:25.937774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd37b9-39a3-4981-98d0-798210b63acf service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:25.949000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1228/2453] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:43:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:28.026813 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91b9a3-0332-40a1-8be1-d52a0afd66da service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:28.036868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91b9a3-0332-40a1-8be1-d52a0afd66da service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:28.040851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1031f24-c808-4d99-96f1-93d00462f278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:28.041503 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1031f24-c808-4d99-96f1-93d00462f278 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:28.041791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1031f24-c808-4d99-96f1-93d00462f278 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:28.042071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1031f24-c808-4d99-96f1-93d00462f278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:28.051556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1031f24-c808-4d99-96f1-93d00462f278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:28.053048 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1031f24-c808-4d99-96f1-93d00462f278 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:28.062658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1226/2454] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:43:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:29.365786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd37b9-39a3-4981-98d0-798210b63acf service placement] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:29.367377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-64cd37b9-39a3-4981-98d0-798210b63acf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:29.387854 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd37b9-39a3-4981-98d0-798210b63acf service placement] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:29.394425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:29.395555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:29.395839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:29.396129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] PATH_INFO: `/v3/users/a068f31da9dc4b589e649e4ec5cf713f` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:29.397681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a068f31da9dc4b589e649e4ec5cf713f)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:29.399630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:29.448959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a068f31da9dc4b589e649e4ec5cf713f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:29.449747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a068f31da9dc4b589e649e4ec5cf713f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:29.450370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a068f31da9dc4b589e649e4ec5cf713f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:29.465467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a068f31da9dc4b589e649e4ec5cf713f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:29.472978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a068f31da9dc4b589e649e4ec5cf713f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:29.486019 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1229/2455] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:43:29 2022] DELETE /identity/v3/users/a068f31da9dc4b589e649e4ec5cf713f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:29.673415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1031f24-c808-4d99-96f1-93d00462f278 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:29.685009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1031f24-c808-4d99-96f1-93d00462f278 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:29.745846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:29.746726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:29.747083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:29.747369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] PATH_INFO: `/v3/projects/ce0de5263b784723aca0332e63f6309e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:29.748704 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce0de5263b784723aca0332e63f6309e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:29.750648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:29.800475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0de5263b784723aca0332e63f6309e', 'request_id': 'req-1a4c4230-13b6-46e5-8594-2dc1589009f6'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:29.808254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0de5263b784723aca0332e63f6309e', 'request_id': 'req-1a4c4230-13b6-46e5-8594-2dc1589009f6'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:29.814956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0de5263b784723aca0332e63f6309e', 'request_id': 'req-1a4c4230-13b6-46e5-8594-2dc1589009f6'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:29.821415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:29.826159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] The token cache is being invalidate because project ce0de5263b784723aca0332e63f6309e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:43:29.826693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:29.828158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:29.830340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1227/2456] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:43:29 2022] DELETE /identity/v3/projects/ce0de5263b784723aca0332e63f6309e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:29.834395 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:29.835864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:29.849901 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817be53-ca30-46b6-8043-d1774276efb9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:29.909879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:29.922392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:29.923396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:29.923804 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:29.924201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] PATH_INFO: `/v3/users/cca38195d88b44fa92032dc6401d4cea` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:29.925572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca38195d88b44fa92032dc6401d4cea)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:29.927626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:29.981614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca38195d88b44fa92032dc6401d4cea'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:29.982289 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca38195d88b44fa92032dc6401d4cea'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:29.982908 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca38195d88b44fa92032dc6401d4cea'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:29.995716 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca38195d88b44fa92032dc6401d4cea'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:30.003184 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca38195d88b44fa92032dc6401d4cea'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:30.016222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1230/2457] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:43:29 2022] DELETE /identity/v3/users/cca38195d88b44fa92032dc6401d4cea => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:30.209817 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:30.211997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:30.241001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c4230-13b6-46e5-8594-2dc1589009f6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:30.328914 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:30.330509 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:30.330848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:30.331131 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] PATH_INFO: `/v3/projects/dd7fec8f753c4b86a6dc783a1eb9dbc3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:30.332569 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd7fec8f753c4b86a6dc783a1eb9dbc3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:30.334640 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:30.396949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd7fec8f753c4b86a6dc783a1eb9dbc3', 'request_id': 'req-ceee7e22-71b7-4ef1-99a5-66a825d24e88'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:30.406778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd7fec8f753c4b86a6dc783a1eb9dbc3', 'request_id': 'req-ceee7e22-71b7-4ef1-99a5-66a825d24e88'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:30.415937 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd7fec8f753c4b86a6dc783a1eb9dbc3', 'request_id': 'req-ceee7e22-71b7-4ef1-99a5-66a825d24e88'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:30.428827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] The token cache is being invalidate because project dd7fec8f753c4b86a6dc783a1eb9dbc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:43:30.429148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:30.429952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:30.440868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1228/2458] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:43:30 2022] DELETE /identity/v3/projects/dd7fec8f753c4b86a6dc783a1eb9dbc3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:40.012640 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:40.425215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:26.110458 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:26.112756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:26.389800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd79560-2dc6-4bab-ad09-71696d8cab55 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:26.570730 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66328f-273c-4366-a7dd-686ec05872c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:26.572952 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66328f-273c-4366-a7dd-686ec05872c9 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:26.573524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66328f-273c-4366-a7dd-686ec05872c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:26.574154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66328f-273c-4366-a7dd-686ec05872c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:26.580931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3b66328f-273c-4366-a7dd-686ec05872c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:26.608157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66328f-273c-4366-a7dd-686ec05872c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:26.613715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66328f-273c-4366-a7dd-686ec05872c9 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:26.654049 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1231/2459] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:30.949940 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:30.951541 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:31.033894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee7e22-71b7-4ef1-99a5-66a825d24e88 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:31.037586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a87f1-f4b6-4a84-b25c-c2a36631a594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:31.038239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a87f1-f4b6-4a84-b25c-c2a36631a594 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:31.038525 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a87f1-f4b6-4a84-b25c-c2a36631a594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:31.038807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a87f1-f4b6-4a84-b25c-c2a36631a594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:31.041282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-585a87f1-f4b6-4a84-b25c-c2a36631a594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:31.134608 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a87f1-f4b6-4a84-b25c-c2a36631a594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:31.136875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a87f1-f4b6-4a84-b25c-c2a36631a594 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:31.155994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1229/2460] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:32.089103 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66328f-273c-4366-a7dd-686ec05872c9 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:32.090583 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3b66328f-273c-4366-a7dd-686ec05872c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:32.183601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:32.202248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66328f-273c-4366-a7dd-686ec05872c9 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:32.205905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac63695-9b0a-4f39-9fdc-260b250607b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:32.206563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac63695-9b0a-4f39-9fdc-260b250607b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:32.206849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac63695-9b0a-4f39-9fdc-260b250607b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:32.207125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac63695-9b0a-4f39-9fdc-260b250607b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:32.208945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9ac63695-9b0a-4f39-9fdc-260b250607b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:32.303368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac63695-9b0a-4f39-9fdc-260b250607b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:32.304842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac63695-9b0a-4f39-9fdc-260b250607b3 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:32.325294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1232/2461] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:32.543911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a87f1-f4b6-4a84-b25c-c2a36631a594 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:32.545533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-585a87f1-f4b6-4a84-b25c-c2a36631a594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:32.557939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a87f1-f4b6-4a84-b25c-c2a36631a594 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:32.562025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139d185-89fa-4e1e-a26a-0092564033d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:32.562560 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139d185-89fa-4e1e-a26a-0092564033d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:32.562850 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139d185-89fa-4e1e-a26a-0092564033d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:32.563258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139d185-89fa-4e1e-a26a-0092564033d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:32.565122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c139d185-89fa-4e1e-a26a-0092564033d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:32.582170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139d185-89fa-4e1e-a26a-0092564033d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:32.583626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139d185-89fa-4e1e-a26a-0092564033d4 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:32.600336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1230/2462] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:36.601782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac63695-9b0a-4f39-9fdc-260b250607b3 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:36.604014 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9ac63695-9b0a-4f39-9fdc-260b250607b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:36.616211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac63695-9b0a-4f39-9fdc-260b250607b3 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:36.621139 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:36.622020 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:36.622308 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:36.622591 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] PATH_INFO: `/v3/users/1156b006d6e1426a84a521d397491135` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:36.623881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1156b006d6e1426a84a521d397491135)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:36.626152 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:36.678316 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1156b006d6e1426a84a521d397491135'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:36.679082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1156b006d6e1426a84a521d397491135'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:36.679821 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1156b006d6e1426a84a521d397491135'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:36.694639 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1156b006d6e1426a84a521d397491135'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:36.702522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1156b006d6e1426a84a521d397491135'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:36.721699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1233/2463] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:36 2022] DELETE /identity/v3/users/1156b006d6e1426a84a521d397491135 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:36.928213 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139d185-89fa-4e1e-a26a-0092564033d4 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:36.928213 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c139d185-89fa-4e1e-a26a-0092564033d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:36.995987 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139d185-89fa-4e1e-a26a-0092564033d4 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:37.075341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:37.131972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:37.133901 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:37.135657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932552b-1567-42d4-912a-acaf4e9576c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:37.136340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932552b-1567-42d4-912a-acaf4e9576c2 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.136938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932552b-1567-42d4-912a-acaf4e9576c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.137247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932552b-1567-42d4-912a-acaf4e9576c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.139446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b932552b-1567-42d4-912a-acaf4e9576c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:37.168442 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932552b-1567-42d4-912a-acaf4e9576c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:37.170147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932552b-1567-42d4-912a-acaf4e9576c2 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:37.202435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:37.213084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1231/2464] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:37.290297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ba7b1-8024-438a-b594-dcaa6dc58194 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:37.300574 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406eed36-e879-4080-bd94-06b53f662794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:37.304157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406eed36-e879-4080-bd94-06b53f662794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.304661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406eed36-e879-4080-bd94-06b53f662794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.305212 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406eed36-e879-4080-bd94-06b53f662794 admin admin] PATH_INFO: `/v3/projects/079362a77e344c61af67f7b256545329` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.308778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406eed36-e879-4080-bd94-06b53f662794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=079362a77e344c61af67f7b256545329)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:37.312450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406eed36-e879-4080-bd94-06b53f662794 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:37.383069 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-406eed36-e879-4080-bd94-06b53f662794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '079362a77e344c61af67f7b256545329', 'request_id': 'req-406eed36-e879-4080-bd94-06b53f662794'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:37.395272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-406eed36-e879-4080-bd94-06b53f662794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '079362a77e344c61af67f7b256545329', 'request_id': 'req-406eed36-e879-4080-bd94-06b53f662794'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:37.404648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-406eed36-e879-4080-bd94-06b53f662794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '079362a77e344c61af67f7b256545329', 'request_id': 'req-406eed36-e879-4080-bd94-06b53f662794'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:37.417732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-406eed36-e879-4080-bd94-06b53f662794 admin admin] The token cache is being invalidate because project 079362a77e344c61af67f7b256545329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:37.418180 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-406eed36-e879-4080-bd94-06b53f662794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:37.418756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-406eed36-e879-4080-bd94-06b53f662794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:37.424286 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1234/2465] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:37 2022] DELETE /identity/v3/projects/079362a77e344c61af67f7b256545329 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:37.426627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82fbb-fec3-4c33-adcf-49bf857ca9d2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.426928 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82fbb-fec3-4c33-adcf-49bf857ca9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.427214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82fbb-fec3-4c33-adcf-49bf857ca9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.504634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f6a82fbb-fec3-4c33-adcf-49bf857ca9d2 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:37.506276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f6a82fbb-fec3-4c33-adcf-49bf857ca9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:37.595703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1232/2466] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:37.597921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4ad55-d31a-417b-873b-62af92d5e9c3 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.598059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4ad55-d31a-417b-873b-62af92d5e9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.598370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4ad55-d31a-417b-873b-62af92d5e9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.631855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-abb4ad55-d31a-417b-873b-62af92d5e9c3 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:37.636981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-abb4ad55-d31a-417b-873b-62af92d5e9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:37.659180 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1235/2467] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:37.661470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a82fbb-fec3-4c33-adcf-49bf857ca9d2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:37.678286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a82fbb-fec3-4c33-adcf-49bf857ca9d2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:37.687999 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb443cc-5f82-4cc4-9510-8e42d8efb963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:37.687999 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb443cc-5f82-4cc4-9510-8e42d8efb963 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.687999 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb443cc-5f82-4cc4-9510-8e42d8efb963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.687999 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb443cc-5f82-4cc4-9510-8e42d8efb963 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.688480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb443cc-5f82-4cc4-9510-8e42d8efb963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:37.688816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb443cc-5f82-4cc4-9510-8e42d8efb963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:37.690462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb443cc-5f82-4cc4-9510-8e42d8efb963 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:37.720825 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1233/2468] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:44:37.725147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4ad55-d31a-417b-873b-62af92d5e9c3 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:37.740331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4ad55-d31a-417b-873b-62af92d5e9c3 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:37.747801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfddfca-1cc6-4293-a5dc-ffdf6c5b9f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:37.748520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfddfca-1cc6-4293-a5dc-ffdf6c5b9f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.748881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfddfca-1cc6-4293-a5dc-ffdf6c5b9f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.749106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfddfca-1cc6-4293-a5dc-ffdf6c5b9f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.750026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfddfca-1cc6-4293-a5dc-ffdf6c5b9f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:37.752200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfddfca-1cc6-4293-a5dc-ffdf6c5b9f71 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:37.788932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1236/2469] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:37 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:37.794745 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb443cc-5f82-4cc4-9510-8e42d8efb963 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:37.809050 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb443cc-5f82-4cc4-9510-8e42d8efb963 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:37.861261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfddfca-1cc6-4293-a5dc-ffdf6c5b9f71 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:37.863238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7cfddfca-1cc6-4293-a5dc-ffdf6c5b9f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:37.950870 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3b060-421f-4806-ad9b-896645341f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:37.954247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b060-421f-4806-ad9b-896645341f62 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:37.955025 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b060-421f-4806-ad9b-896645341f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:37.955658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b060-421f-4806-ad9b-896645341f62 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:37.956607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3b060-421f-4806-ad9b-896645341f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:37.959041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3b060-421f-4806-ad9b-896645341f62 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:37.990130 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1234/2470] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:37 2022] POST /identity/v3/users => generated 282 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:37.991211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfddfca-1cc6-4293-a5dc-ffdf6c5b9f71 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:37.995342 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3b060-421f-4806-ad9b-896645341f62 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:37.999291 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519912e8-e8fe-482c-881e-aec296a5fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:38.001120 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519912e8-e8fe-482c-881e-aec296a5fe36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:38.001418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519912e8-e8fe-482c-881e-aec296a5fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:38.001703 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519912e8-e8fe-482c-881e-aec296a5fe36 admin admin] PATH_INFO: `/v3/users/7b14606965a74c71881595c71bdd2d58` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:38.003458 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519912e8-e8fe-482c-881e-aec296a5fe36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b14606965a74c71881595c71bdd2d58)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:38.008242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519912e8-e8fe-482c-881e-aec296a5fe36 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:38.011356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3b060-421f-4806-ad9b-896645341f62 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:38.019461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5df3c5-82ee-4ca5-9474-62e8ff6b174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:38.020296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5df3c5-82ee-4ca5-9474-62e8ff6b174d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:38.020680 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5df3c5-82ee-4ca5-9474-62e8ff6b174d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:38.021078 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5df3c5-82ee-4ca5-9474-62e8ff6b174d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:38.022081 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5df3c5-82ee-4ca5-9474-62e8ff6b174d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:38.023801 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5df3c5-82ee-4ca5-9474-62e8ff6b174d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:38.028117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:38.042894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1235/2471] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:38.047414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5df3c5-82ee-4ca5-9474-62e8ff6b174d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:38.065203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:38.065452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5df3c5-82ee-4ca5-9474-62e8ff6b174d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:38.079307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba751e9-12b9-40c5-aa2c-d6fbec025bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:38.080268 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba751e9-12b9-40c5-aa2c-d6fbec025bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:38.080605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba751e9-12b9-40c5-aa2c-d6fbec025bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:38.081649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba751e9-12b9-40c5-aa2c-d6fbec025bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:38.082813 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba751e9-12b9-40c5-aa2c-d6fbec025bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:38.084454 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba751e9-12b9-40c5-aa2c-d6fbec025bd6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:38.096608 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-519912e8-e8fe-482c-881e-aec296a5fe36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b14606965a74c71881595c71bdd2d58'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:38.097511 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1236/2472] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:38.100977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-519912e8-e8fe-482c-881e-aec296a5fe36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b14606965a74c71881595c71bdd2d58'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:38.101607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba751e9-12b9-40c5-aa2c-d6fbec025bd6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:38.101871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-519912e8-e8fe-482c-881e-aec296a5fe36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b14606965a74c71881595c71bdd2d58'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:38.103999 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7ba751e9-12b9-40c5-aa2c-d6fbec025bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:38.117125 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba751e9-12b9-40c5-aa2c-d6fbec025bd6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:38.121692 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-519912e8-e8fe-482c-881e-aec296a5fe36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b14606965a74c71881595c71bdd2d58'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:38.125050 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5581709-3f5d-4500-a0b5-fe63c5421cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:38.126538 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581709-3f5d-4500-a0b5-fe63c5421cad admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:38.126998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581709-3f5d-4500-a0b5-fe63c5421cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:38.127521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581709-3f5d-4500-a0b5-fe63c5421cad admin admin] PATH_INFO: `/v3/projects/f6bc2101b1ab4afcbec6c23f7cd597c5/users/fa8c9d7251254d1683f60b034c0d50eb/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:38.132278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-519912e8-e8fe-482c-881e-aec296a5fe36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b14606965a74c71881595c71bdd2d58'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:38.154973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1237/2473] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:37 2022] DELETE /identity/v3/users/7b14606965a74c71881595c71bdd2d58 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:38.155200 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5581709-3f5d-4500-a0b5-fe63c5421cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bc2101b1ab4afcbec6c23f7cd597c5, user_id=fa8c9d7251254d1683f60b034c0d50eb, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:38.165396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5581709-3f5d-4500-a0b5-fe63c5421cad admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:38.195547 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1237/2474] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:38 2022] PUT /identity/v3/projects/f6bc2101b1ab4afcbec6c23f7cd597c5/users/fa8c9d7251254d1683f60b034c0d50eb/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:38.209361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f585c8-0ffc-499e-93e4-0a96dcab9b9b None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:38.209658 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f585c8-0ffc-499e-93e4-0a96dcab9b9b None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:38.209941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f585c8-0ffc-499e-93e4-0a96dcab9b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:38.241659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-28f585c8-0ffc-499e-93e4-0a96dcab9b9b None None] MFA Rules not processed for user `fa8c9d7251254d1683f60b034c0d50eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:38.247618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-28f585c8-0ffc-499e-93e4-0a96dcab9b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:38.365933 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1238/2475] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:38.369041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5581709-3f5d-4500-a0b5-fe63c5421cad admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:38.451993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5581709-3f5d-4500-a0b5-fe63c5421cad admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:38.458216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235e68d-f7de-412c-8a5c-40fe88e92c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:38.458903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235e68d-f7de-412c-8a5c-40fe88e92c14 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:38.459899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235e68d-f7de-412c-8a5c-40fe88e92c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:38.460194 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235e68d-f7de-412c-8a5c-40fe88e92c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:38.460939 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235e68d-f7de-412c-8a5c-40fe88e92c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:38.463724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235e68d-f7de-412c-8a5c-40fe88e92c14 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:38.505083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1238/2476] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:38 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:38.510086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f585c8-0ffc-499e-93e4-0a96dcab9b9b None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:38.528342 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f585c8-0ffc-499e-93e4-0a96dcab9b9b None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:38.551254 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235e68d-f7de-412c-8a5c-40fe88e92c14 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:38.553380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8235e68d-f7de-412c-8a5c-40fe88e92c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:38.638572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82539c1-62cd-464c-8edb-778b02a8ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:38.639271 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82539c1-62cd-464c-8edb-778b02a8ce37 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:38.639563 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82539c1-62cd-464c-8edb-778b02a8ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:38.639845 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82539c1-62cd-464c-8edb-778b02a8ce37 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:38.640554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82539c1-62cd-464c-8edb-778b02a8ce37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:38.642715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82539c1-62cd-464c-8edb-778b02a8ce37 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:38.645105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235e68d-f7de-412c-8a5c-40fe88e92c14 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:38.651794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a09963-31bd-4612-a466-2c3d7b06f77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:38.653110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a09963-31bd-4612-a466-2c3d7b06f77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:38.653330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a09963-31bd-4612-a466-2c3d7b06f77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:38.653661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a09963-31bd-4612-a466-2c3d7b06f77f admin admin] PATH_INFO: `/v3/projects/7ef656c0ca2943eb965bf10d4e943d27` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:38.655077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a09963-31bd-4612-a466-2c3d7b06f77f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef656c0ca2943eb965bf10d4e943d27)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:38.683680 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a09963-31bd-4612-a466-2c3d7b06f77f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:38.696742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1239/2477] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:38 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:38.699322 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82539c1-62cd-464c-8edb-778b02a8ce37 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:38.726965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82539c1-62cd-464c-8edb-778b02a8ce37 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:38.738127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c4f15-0f99-4d29-b4bd-2c5338d4bfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:38.738127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c4f15-0f99-4d29-b4bd-2c5338d4bfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:38.738410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c4f15-0f99-4d29-b4bd-2c5338d4bfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:38.738573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c4f15-0f99-4d29-b4bd-2c5338d4bfd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:38.739324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c4f15-0f99-4d29-b4bd-2c5338d4bfd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:38.740981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c4f15-0f99-4d29-b4bd-2c5338d4bfd3 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:38.757530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1240/2478] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:38.758896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c4f15-0f99-4d29-b4bd-2c5338d4bfd3 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:38.770983 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c4f15-0f99-4d29-b4bd-2c5338d4bfd3 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:38.780003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:38.810514 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-66a09963-31bd-4612-a466-2c3d7b06f77f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef656c0ca2943eb965bf10d4e943d27', 'request_id': 'req-66a09963-31bd-4612-a466-2c3d7b06f77f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:38.813083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:38.822402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-66a09963-31bd-4612-a466-2c3d7b06f77f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef656c0ca2943eb965bf10d4e943d27', 'request_id': 'req-66a09963-31bd-4612-a466-2c3d7b06f77f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:38.833420 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-66a09963-31bd-4612-a466-2c3d7b06f77f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef656c0ca2943eb965bf10d4e943d27', 'request_id': 'req-66a09963-31bd-4612-a466-2c3d7b06f77f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:38.844265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daab886-e76d-4051-b991-a94aca4d8a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:38.845528 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daab886-e76d-4051-b991-a94aca4d8a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:38.846018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daab886-e76d-4051-b991-a94aca4d8a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:38.846283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daab886-e76d-4051-b991-a94aca4d8a4c admin admin] PATH_INFO: `/v3/projects/8a9f1b932911462c863988ce258d1a06/users/9ecd785b01bc42a8919541b9cda8e9e9/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:38.849334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-66a09963-31bd-4612-a466-2c3d7b06f77f admin admin] The token cache is being invalidate because project 7ef656c0ca2943eb965bf10d4e943d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:38.849786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-66a09963-31bd-4612-a466-2c3d7b06f77f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:38.850768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-66a09963-31bd-4612-a466-2c3d7b06f77f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:38.854887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1239/2479] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:38 2022] DELETE /identity/v3/projects/7ef656c0ca2943eb965bf10d4e943d27 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:38.859352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b39ba5-8d9a-459f-a2ce-dce20992bfd1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:38.859755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b39ba5-8d9a-459f-a2ce-dce20992bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:38.860142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b39ba5-8d9a-459f-a2ce-dce20992bfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:38.870917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daab886-e76d-4051-b991-a94aca4d8a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9f1b932911462c863988ce258d1a06, user_id=9ecd785b01bc42a8919541b9cda8e9e9, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:38.873872 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daab886-e76d-4051-b991-a94aca4d8a4c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:38.889649 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-23b39ba5-8d9a-459f-a2ce-dce20992bfd1 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:38.891001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-23b39ba5-8d9a-459f-a2ce-dce20992bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:38.909788 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1241/2480] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:38 2022] PUT /identity/v3/projects/8a9f1b932911462c863988ce258d1a06/users/9ecd785b01bc42a8919541b9cda8e9e9/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:38.913904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daab886-e76d-4051-b991-a94aca4d8a4c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:38.916424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2daab886-e76d-4051-b991-a94aca4d8a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:38.988843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1240/2481] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:38.991239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231ee96-5012-4ac7-97b5-018893d9e3b8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:38.991535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231ee96-5012-4ac7-97b5-018893d9e3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:38.991859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3231ee96-5012-4ac7-97b5-018893d9e3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:39.003184 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daab886-e76d-4051-b991-a94aca4d8a4c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:39.008439 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e72c1-12ba-4bda-8c78-7387f7837daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:39.009729 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e72c1-12ba-4bda-8c78-7387f7837daf admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:39.010198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e72c1-12ba-4bda-8c78-7387f7837daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:39.010551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e72c1-12ba-4bda-8c78-7387f7837daf admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:39.011365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e72c1-12ba-4bda-8c78-7387f7837daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:39.013089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e72c1-12ba-4bda-8c78-7387f7837daf admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:39.021356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3231ee96-5012-4ac7-97b5-018893d9e3b8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:39.022633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3231ee96-5012-4ac7-97b5-018893d9e3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:39.024568 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1242/2482] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:39.028972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e72c1-12ba-4bda-8c78-7387f7837daf admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:39.036706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1241/2483] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:39.039398 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e72c1-12ba-4bda-8c78-7387f7837daf admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:39.042082 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231ee96-5012-4ac7-97b5-018893d9e3b8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:39.047261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4396c-b837-4ec7-b18f-e11c0538f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:39.048443 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4396c-b837-4ec7-b18f-e11c0538f2ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:39.048839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4396c-b837-4ec7-b18f-e11c0538f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:39.049494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4396c-b837-4ec7-b18f-e11c0538f2ee admin admin] PATH_INFO: `/v3/projects/8a9f1b932911462c863988ce258d1a06/users/9ecd785b01bc42a8919541b9cda8e9e9/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:39.051563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3231ee96-5012-4ac7-97b5-018893d9e3b8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:39.051689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4396c-b837-4ec7-b18f-e11c0538f2ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9f1b932911462c863988ce258d1a06, user_id=9ecd785b01bc42a8919541b9cda8e9e9, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:39.055038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4396c-b837-4ec7-b18f-e11c0538f2ee admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:39.056978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e5334-8e0e-4728-b8f1-5fa214b8f2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:39.057657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e5334-8e0e-4728-b8f1-5fa214b8f2db admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:39.057943 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e5334-8e0e-4728-b8f1-5fa214b8f2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:39.058223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e5334-8e0e-4728-b8f1-5fa214b8f2db admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:39.058969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e5334-8e0e-4728-b8f1-5fa214b8f2db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:39.059287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e5334-8e0e-4728-b8f1-5fa214b8f2db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:39.061159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e5334-8e0e-4728-b8f1-5fa214b8f2db admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:39.073947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1243/2484] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:39 2022] PUT /identity/v3/projects/8a9f1b932911462c863988ce258d1a06/users/9ecd785b01bc42a8919541b9cda8e9e9/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:39.078937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba735c7-01b0-4473-88cc-4d26ee1c791e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:39.079229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba735c7-01b0-4473-88cc-4d26ee1c791e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:39.079526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba735c7-01b0-4473-88cc-4d26ee1c791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:39.085230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1242/2485] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:44:39.086104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e5334-8e0e-4728-b8f1-5fa214b8f2db admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:39.097073 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e5334-8e0e-4728-b8f1-5fa214b8f2db admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:39.109954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2ba735c7-01b0-4473-88cc-4d26ee1c791e None None] MFA Rules not processed for user `9ecd785b01bc42a8919541b9cda8e9e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:39.111188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2ba735c7-01b0-4473-88cc-4d26ee1c791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:39.164072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cda0cf-2028-4112-8ff9-639930d96e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:39.165062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cda0cf-2028-4112-8ff9-639930d96e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:39.165611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cda0cf-2028-4112-8ff9-639930d96e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:39.165967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cda0cf-2028-4112-8ff9-639930d96e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:39.166859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cda0cf-2028-4112-8ff9-639930d96e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:39.169523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cda0cf-2028-4112-8ff9-639930d96e31 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:39.197089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1244/2486] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:39 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:39.204188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1243/2487] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:39 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:39.205447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba735c7-01b0-4473-88cc-4d26ee1c791e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:39.206901 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2ba735c7-01b0-4473-88cc-4d26ee1c791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:39.209496 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cda0cf-2028-4112-8ff9-639930d96e31 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:39.214681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:39.287164 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:39.302663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba735c7-01b0-4473-88cc-4d26ee1c791e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:39.313414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cda0cf-2028-4112-8ff9-639930d96e31 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:39.323259 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe139c6-1ad3-43a4-a329-12056fc613e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:39.324526 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe139c6-1ad3-43a4-a329-12056fc613e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:39.324526 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe139c6-1ad3-43a4-a329-12056fc613e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:39.324858 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe139c6-1ad3-43a4-a329-12056fc613e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:39.325628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe139c6-1ad3-43a4-a329-12056fc613e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:39.328237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe139c6-1ad3-43a4-a329-12056fc613e7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:39.356058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1244/2488] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:39 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:39.359522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe139c6-1ad3-43a4-a329-12056fc613e7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:39.374291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe139c6-1ad3-43a4-a329-12056fc613e7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:39.381575 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fd783-7ec9-43f1-b8d9-cf8a033019da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:39.382168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fd783-7ec9-43f1-b8d9-cf8a033019da admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:39.384295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fd783-7ec9-43f1-b8d9-cf8a033019da admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:39.384295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fd783-7ec9-43f1-b8d9-cf8a033019da admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:39.384645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed520c-82a2-431a-b195-73f4892e6f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:39.384645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed520c-82a2-431a-b195-73f4892e6f02 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:39.384965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed520c-82a2-431a-b195-73f4892e6f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:39.385292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed520c-82a2-431a-b195-73f4892e6f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:39.385923 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fd783-7ec9-43f1-b8d9-cf8a033019da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:39.387724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fd783-7ec9-43f1-b8d9-cf8a033019da admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:39.403895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1245/2489] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:39.407667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fd783-7ec9-43f1-b8d9-cf8a033019da admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:39.419500 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fd783-7ec9-43f1-b8d9-cf8a033019da admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:39.425955 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462521b-39d1-4c44-81e2-d252f9a4c42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:39.426642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462521b-39d1-4c44-81e2-d252f9a4c42a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:39.426935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462521b-39d1-4c44-81e2-d252f9a4c42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:39.427216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462521b-39d1-4c44-81e2-d252f9a4c42a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:39.427957 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462521b-39d1-4c44-81e2-d252f9a4c42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:39.429612 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462521b-39d1-4c44-81e2-d252f9a4c42a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:39.444142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1246/2490] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:39.445625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462521b-39d1-4c44-81e2-d252f9a4c42a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:39.455823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462521b-39d1-4c44-81e2-d252f9a4c42a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:39.460818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b0a82-950a-4ece-8d4a-a7c976279f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:39.462302 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b0a82-950a-4ece-8d4a-a7c976279f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:39.462585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b0a82-950a-4ece-8d4a-a7c976279f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:39.462865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b0a82-950a-4ece-8d4a-a7c976279f30 admin admin] PATH_INFO: `/v3/projects/ff6b08f53fbc4242be8692da4fdaa9ff/users/11cee8d2384a46899fd18e171c27bdf3/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:39.478674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed520c-82a2-431a-b195-73f4892e6f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:39.479303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b0a82-950a-4ece-8d4a-a7c976279f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6b08f53fbc4242be8692da4fdaa9ff, user_id=11cee8d2384a46899fd18e171c27bdf3, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:39.480126 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed520c-82a2-431a-b195-73f4892e6f02 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:39.482355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b0a82-950a-4ece-8d4a-a7c976279f30 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:39.490080 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1245/2491] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:39 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:39.496120 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1247/2492] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:39 2022] PUT /identity/v3/projects/ff6b08f53fbc4242be8692da4fdaa9ff/users/11cee8d2384a46899fd18e171c27bdf3/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:39.506179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524355e-80ad-4472-ad21-09de34d96f4f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:39.506693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524355e-80ad-4472-ad21-09de34d96f4f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:39.506978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524355e-80ad-4472-ad21-09de34d96f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:39.536770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8524355e-80ad-4472-ad21-09de34d96f4f None None] MFA Rules not processed for user `11cee8d2384a46899fd18e171c27bdf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:39.537975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8524355e-80ad-4472-ad21-09de34d96f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:39.605007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:39.611333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1246/2493] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:39.623305 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b0a82-950a-4ece-8d4a-a7c976279f30 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:39.625325 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8c8b0a82-950a-4ece-8d4a-a7c976279f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:39.718114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b0a82-950a-4ece-8d4a-a7c976279f30 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:39.725393 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b95e5-28de-47e1-94ce-c8bfd29a1b62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:39.726056 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b95e5-28de-47e1-94ce-c8bfd29a1b62 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:39.726343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b95e5-28de-47e1-94ce-c8bfd29a1b62 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:39.726628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b95e5-28de-47e1-94ce-c8bfd29a1b62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:39.735114 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b95e5-28de-47e1-94ce-c8bfd29a1b62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:39.736799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b95e5-28de-47e1-94ce-c8bfd29a1b62 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:39.746982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1248/2494] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:39.937325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524355e-80ad-4472-ad21-09de34d96f4f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:40.006083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524355e-80ad-4472-ad21-09de34d96f4f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:40.012844 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:40.013896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:40.014167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:40.014520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] PATH_INFO: `/v3/users/fa8c9d7251254d1683f60b034c0d50eb` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:40.015786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8c9d7251254d1683f60b034c0d50eb)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:40.019072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:40.076094 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8c9d7251254d1683f60b034c0d50eb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.077059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8c9d7251254d1683f60b034c0d50eb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.077928 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8c9d7251254d1683f60b034c0d50eb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.093192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8c9d7251254d1683f60b034c0d50eb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.103731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8c9d7251254d1683f60b034c0d50eb'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.122121 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1247/2495] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:39 2022] DELETE /identity/v3/users/fa8c9d7251254d1683f60b034c0d50eb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:40.126621 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404507cb-f769-4090-8c0a-7f3ddd0252cb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:40.127111 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404507cb-f769-4090-8c0a-7f3ddd0252cb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:40.127208 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404507cb-f769-4090-8c0a-7f3ddd0252cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:40.146762 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-404507cb-f769-4090-8c0a-7f3ddd0252cb None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:40.148358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-404507cb-f769-4090-8c0a-7f3ddd0252cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:40.209444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1249/2496] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:40.224070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:40.226346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:40.285534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0baf5-a5c5-4462-ae68-1ccec2b563db admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:40.289166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973842c6-bf2b-4596-9ddc-04af7bc94dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:40.290339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973842c6-bf2b-4596-9ddc-04af7bc94dab service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:40.290625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973842c6-bf2b-4596-9ddc-04af7bc94dab service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:40.291016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973842c6-bf2b-4596-9ddc-04af7bc94dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:40.300044 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973842c6-bf2b-4596-9ddc-04af7bc94dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:40.301494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973842c6-bf2b-4596-9ddc-04af7bc94dab service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:40.311592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1248/2497] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:40.687616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404507cb-f769-4090-8c0a-7f3ddd0252cb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:40.689228 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-404507cb-f769-4090-8c0a-7f3ddd0252cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:40.701632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404507cb-f769-4090-8c0a-7f3ddd0252cb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:40.706272 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ce073-6581-4703-9184-836029e63620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:40.707138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ce073-6581-4703-9184-836029e63620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:40.707423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ce073-6581-4703-9184-836029e63620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:40.707695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ce073-6581-4703-9184-836029e63620 admin admin] PATH_INFO: `/v3/projects/f6bc2101b1ab4afcbec6c23f7cd597c5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:40.708938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ce073-6581-4703-9184-836029e63620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bc2101b1ab4afcbec6c23f7cd597c5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:40.710839 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ce073-6581-4703-9184-836029e63620 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:40.722197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:40.760986 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-840ce073-6581-4703-9184-836029e63620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bc2101b1ab4afcbec6c23f7cd597c5', 'request_id': 'req-840ce073-6581-4703-9184-836029e63620'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.768996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-840ce073-6581-4703-9184-836029e63620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bc2101b1ab4afcbec6c23f7cd597c5', 'request_id': 'req-840ce073-6581-4703-9184-836029e63620'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.776631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-840ce073-6581-4703-9184-836029e63620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bc2101b1ab4afcbec6c23f7cd597c5', 'request_id': 'req-840ce073-6581-4703-9184-836029e63620'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.787273 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-840ce073-6581-4703-9184-836029e63620 admin admin] The token cache is being invalidate because project f6bc2101b1ab4afcbec6c23f7cd597c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:40.787561 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-840ce073-6581-4703-9184-836029e63620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.788215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-840ce073-6581-4703-9184-836029e63620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.790489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1250/2498] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:40 2022] DELETE /identity/v3/projects/f6bc2101b1ab4afcbec6c23f7cd597c5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:40.794444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973842c6-bf2b-4596-9ddc-04af7bc94dab service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:40.804265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973842c6-bf2b-4596-9ddc-04af7bc94dab service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:40.821813 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:40.865823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce01c5-a367-443a-a015-ede6ca3dc5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:40.866709 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce01c5-a367-443a-a015-ede6ca3dc5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:40.866991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce01c5-a367-443a-a015-ede6ca3dc5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:40.867261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce01c5-a367-443a-a015-ede6ca3dc5b5 admin admin] PATH_INFO: `/v3/users/9ecd785b01bc42a8919541b9cda8e9e9` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:40.868852 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce01c5-a367-443a-a015-ede6ca3dc5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ecd785b01bc42a8919541b9cda8e9e9)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:40.870807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce01c5-a367-443a-a015-ede6ca3dc5b5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:40.925161 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6dce01c5-a367-443a-a015-ede6ca3dc5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ecd785b01bc42a8919541b9cda8e9e9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.925820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6dce01c5-a367-443a-a015-ede6ca3dc5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ecd785b01bc42a8919541b9cda8e9e9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.926410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6dce01c5-a367-443a-a015-ede6ca3dc5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ecd785b01bc42a8919541b9cda8e9e9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.938867 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6dce01c5-a367-443a-a015-ede6ca3dc5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ecd785b01bc42a8919541b9cda8e9e9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.945773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6dce01c5-a367-443a-a015-ede6ca3dc5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ecd785b01bc42a8919541b9cda8e9e9'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:40.958969 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1249/2499] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:40 2022] DELETE /identity/v3/users/9ecd785b01bc42a8919541b9cda8e9e9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:41.250977 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ce073-6581-4703-9184-836029e63620 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.252453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-840ce073-6581-4703-9184-836029e63620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:41.266951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ce073-6581-4703-9184-836029e63620 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.339746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9452648-98b4-4d16-a8ec-d7ff3828dbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.340628 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9452648-98b4-4d16-a8ec-d7ff3828dbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.340950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9452648-98b4-4d16-a8ec-d7ff3828dbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.341226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9452648-98b4-4d16-a8ec-d7ff3828dbde admin admin] PATH_INFO: `/v3/projects/8a9f1b932911462c863988ce258d1a06` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.342419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9452648-98b4-4d16-a8ec-d7ff3828dbde admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9f1b932911462c863988ce258d1a06)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.344428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9452648-98b4-4d16-a8ec-d7ff3828dbde admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.407127 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a9452648-98b4-4d16-a8ec-d7ff3828dbde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9f1b932911462c863988ce258d1a06', 'request_id': 'req-a9452648-98b4-4d16-a8ec-d7ff3828dbde'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:41.416520 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a9452648-98b4-4d16-a8ec-d7ff3828dbde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9f1b932911462c863988ce258d1a06', 'request_id': 'req-a9452648-98b4-4d16-a8ec-d7ff3828dbde'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:41.425859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a9452648-98b4-4d16-a8ec-d7ff3828dbde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9f1b932911462c863988ce258d1a06', 'request_id': 'req-a9452648-98b4-4d16-a8ec-d7ff3828dbde'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:41.435626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a9452648-98b4-4d16-a8ec-d7ff3828dbde admin admin] The token cache is being invalidate because project 8a9f1b932911462c863988ce258d1a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:41.435626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a9452648-98b4-4d16-a8ec-d7ff3828dbde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:41.436406 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a9452648-98b4-4d16-a8ec-d7ff3828dbde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:41.438296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1251/2500] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:41 2022] DELETE /identity/v3/projects/8a9f1b932911462c863988ce258d1a06 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:41.445402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c79c3-ed89-401a-8e55-bc81129a5bd0 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.445979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c79c3-ed89-401a-8e55-bc81129a5bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.446519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c79c3-ed89-401a-8e55-bc81129a5bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.469829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d09c79c3-ed89-401a-8e55-bc81129a5bd0 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:41.471131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d09c79c3-ed89-401a-8e55-bc81129a5bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:41.543106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1250/2501] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:41.550860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed25372-1d52-43a4-93ac-973454da9e6f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.551166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed25372-1d52-43a4-93ac-973454da9e6f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.551457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed25372-1d52-43a4-93ac-973454da9e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.574127 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7ed25372-1d52-43a4-93ac-973454da9e6f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:41.575487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7ed25372-1d52-43a4-93ac-973454da9e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:41.585271 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1252/2502] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:41.589835 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c79c3-ed89-401a-8e55-bc81129a5bd0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.603733 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c79c3-ed89-401a-8e55-bc81129a5bd0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.608436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d1a36-77ab-48b9-9403-decdbd45b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.609125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d1a36-77ab-48b9-9403-decdbd45b78b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.609413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d1a36-77ab-48b9-9403-decdbd45b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.609693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d1a36-77ab-48b9-9403-decdbd45b78b admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.610424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d1a36-77ab-48b9-9403-decdbd45b78b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:41.610737 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d1a36-77ab-48b9-9403-decdbd45b78b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.612344 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d1a36-77ab-48b9-9403-decdbd45b78b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.625170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1251/2503] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:41.629526 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed25372-1d52-43a4-93ac-973454da9e6f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.639065 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed25372-1d52-43a4-93ac-973454da9e6f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.643984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772031a3-8b98-4584-8541-b6c1810ec518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.644638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772031a3-8b98-4584-8541-b6c1810ec518 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.644949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772031a3-8b98-4584-8541-b6c1810ec518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.645223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772031a3-8b98-4584-8541-b6c1810ec518 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.645958 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772031a3-8b98-4584-8541-b6c1810ec518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.647865 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772031a3-8b98-4584-8541-b6c1810ec518 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.668540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:41.676960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1253/2504] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:41 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:41.681849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d1a36-77ab-48b9-9403-decdbd45b78b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.692139 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d1a36-77ab-48b9-9403-decdbd45b78b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.725108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:41.762653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772031a3-8b98-4584-8541-b6c1810ec518 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.764703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-772031a3-8b98-4584-8541-b6c1810ec518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:41.780166 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb1bdf-37af-4634-a3d5-5b6b332ca2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.781370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb1bdf-37af-4634-a3d5-5b6b332ca2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.782214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb1bdf-37af-4634-a3d5-5b6b332ca2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.782732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb1bdf-37af-4634-a3d5-5b6b332ca2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.783597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb1bdf-37af-4634-a3d5-5b6b332ca2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.785767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb1bdf-37af-4634-a3d5-5b6b332ca2d8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.809035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1252/2505] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:41 2022] POST /identity/v3/users => generated 285 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:41.812740 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb1bdf-37af-4634-a3d5-5b6b332ca2d8 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.824345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb1bdf-37af-4634-a3d5-5b6b332ca2d8 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.830579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02d55f-3b5a-44f1-827a-500ef97acbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.830768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772031a3-8b98-4584-8541-b6c1810ec518 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.831264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02d55f-3b5a-44f1-827a-500ef97acbce admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.831549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02d55f-3b5a-44f1-827a-500ef97acbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.831826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02d55f-3b5a-44f1-827a-500ef97acbce admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.832560 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02d55f-3b5a-44f1-827a-500ef97acbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.834220 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02d55f-3b5a-44f1-827a-500ef97acbce admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.834822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac35289-c9c7-435f-839b-4a006b090c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.835548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac35289-c9c7-435f-839b-4a006b090c6f service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.835926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac35289-c9c7-435f-839b-4a006b090c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.837344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac35289-c9c7-435f-839b-4a006b090c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.839437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2ac35289-c9c7-435f-839b-4a006b090c6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:41.846777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1253/2506] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:41.850845 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02d55f-3b5a-44f1-827a-500ef97acbce admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.856776 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac35289-c9c7-435f-839b-4a006b090c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.858520 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac35289-c9c7-435f-839b-4a006b090c6f service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.861084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02d55f-3b5a-44f1-827a-500ef97acbce admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.866683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4171da4-b1ec-40dc-a09f-864c2a7c9cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.867430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4171da4-b1ec-40dc-a09f-864c2a7c9cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.867798 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4171da4-b1ec-40dc-a09f-864c2a7c9cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.868084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4171da4-b1ec-40dc-a09f-864c2a7c9cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.868864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4171da4-b1ec-40dc-a09f-864c2a7c9cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.869480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1254/2507] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:41.870639 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4171da4-b1ec-40dc-a09f-864c2a7c9cb6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.885822 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1254/2508] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:41.891037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac35289-c9c7-435f-839b-4a006b090c6f service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:41.903870 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac35289-c9c7-435f-839b-4a006b090c6f service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:41.908578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddecd8-8535-4359-a50b-24f2b9301acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:41.909528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddecd8-8535-4359-a50b-24f2b9301acf admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.909816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddecd8-8535-4359-a50b-24f2b9301acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.910085 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddecd8-8535-4359-a50b-24f2b9301acf admin admin] PATH_INFO: `/v3/projects/3add6fb4d45548328ac2749410d5df0d/users/504a018b7e1e47418d9b4034ac137604/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.926217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddecd8-8535-4359-a50b-24f2b9301acf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3add6fb4d45548328ac2749410d5df0d, user_id=504a018b7e1e47418d9b4034ac137604, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:41.928893 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddecd8-8535-4359-a50b-24f2b9301acf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:41.943366 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1255/2509] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:41 2022] PUT /identity/v3/projects/3add6fb4d45548328ac2749410d5df0d/users/504a018b7e1e47418d9b4034ac137604/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:41.954668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d707f4d-4c8b-4c05-a6c0-b185672a56cb None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:41.955195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d707f4d-4c8b-4c05-a6c0-b185672a56cb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:41.955312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d707f4d-4c8b-4c05-a6c0-b185672a56cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:41.984077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-1d707f4d-4c8b-4c05-a6c0-b185672a56cb None None] MFA Rules not processed for user `504a018b7e1e47418d9b4034ac137604`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:41.985359 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1d707f4d-4c8b-4c05-a6c0-b185672a56cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:42.051512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1255/2510] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:42.056469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddecd8-8535-4359-a50b-24f2b9301acf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.121006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddecd8-8535-4359-a50b-24f2b9301acf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.125695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d8740-188c-4512-954f-3ecb0e1d3e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.126354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d8740-188c-4512-954f-3ecb0e1d3e5b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.126638 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d8740-188c-4512-954f-3ecb0e1d3e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.126915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d8740-188c-4512-954f-3ecb0e1d3e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.127616 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d8740-188c-4512-954f-3ecb0e1d3e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.129652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d8740-188c-4512-954f-3ecb0e1d3e5b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.159549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1256/2511] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:42 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:42.160663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d707f4d-4c8b-4c05-a6c0-b185672a56cb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.171661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d707f4d-4c8b-4c05-a6c0-b185672a56cb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.235111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d86e8-fea2-4e43-ac5b-073f26fcb1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.235915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d86e8-fea2-4e43-ac5b-073f26fcb1ac admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.236201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d86e8-fea2-4e43-ac5b-073f26fcb1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.236483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d86e8-fea2-4e43-ac5b-073f26fcb1ac admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.237215 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d86e8-fea2-4e43-ac5b-073f26fcb1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.239134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d86e8-fea2-4e43-ac5b-073f26fcb1ac admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.270989 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1256/2512] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:42 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:42.272488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d8740-188c-4512-954f-3ecb0e1d3e5b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.283668 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d8740-188c-4512-954f-3ecb0e1d3e5b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.288662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8c8bc-8cea-489d-88b1-43d907fda0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.289355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8c8bc-8cea-489d-88b1-43d907fda0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.289681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8c8bc-8cea-489d-88b1-43d907fda0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.290650 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8c8bc-8cea-489d-88b1-43d907fda0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.291636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8c8bc-8cea-489d-88b1-43d907fda0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.293287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8c8bc-8cea-489d-88b1-43d907fda0c3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.304338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1257/2513] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:42.308579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d86e8-fea2-4e43-ac5b-073f26fcb1ac admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.318647 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d86e8-fea2-4e43-ac5b-073f26fcb1ac admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.324097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b43be8-4cf8-4d0e-8a05-a549cb1feb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.325019 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b43be8-4cf8-4d0e-8a05-a549cb1feb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.325309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b43be8-4cf8-4d0e-8a05-a549cb1feb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.325587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b43be8-4cf8-4d0e-8a05-a549cb1feb84 admin admin] PATH_INFO: `/v3/projects/346b9ad10c2d4792a08df0096beb0dd9/users/53e05a59e3cb41039a6da99cb9a36e23/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.338767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:42.342790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b43be8-4cf8-4d0e-8a05-a549cb1feb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=346b9ad10c2d4792a08df0096beb0dd9, user_id=53e05a59e3cb41039a6da99cb9a36e23, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.346159 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b43be8-4cf8-4d0e-8a05-a549cb1feb84 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.359331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1257/2514] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:42 2022] PUT /identity/v3/projects/346b9ad10c2d4792a08df0096beb0dd9/users/53e05a59e3cb41039a6da99cb9a36e23/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:42.363198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8c8bc-8cea-489d-88b1-43d907fda0c3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.373743 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8c8bc-8cea-489d-88b1-43d907fda0c3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.423688 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:42.435499 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec0505-2b57-4788-913b-1db17832fd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.436175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec0505-2b57-4788-913b-1db17832fd1c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.436458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec0505-2b57-4788-913b-1db17832fd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.436821 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec0505-2b57-4788-913b-1db17832fd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.437578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec0505-2b57-4788-913b-1db17832fd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.439182 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec0505-2b57-4788-913b-1db17832fd1c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.450336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1258/2515] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:42.454510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b43be8-4cf8-4d0e-8a05-a549cb1feb84 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.465972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b43be8-4cf8-4d0e-8a05-a549cb1feb84 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.470866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da4a58-ef6a-431d-8c07-4f9461d50a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.471760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4a58-ef6a-431d-8c07-4f9461d50a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.472402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4a58-ef6a-431d-8c07-4f9461d50a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.472402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4a58-ef6a-431d-8c07-4f9461d50a12 admin admin] PATH_INFO: `/v3/projects/346b9ad10c2d4792a08df0096beb0dd9/users/53e05a59e3cb41039a6da99cb9a36e23/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.474292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da4a58-ef6a-431d-8c07-4f9461d50a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=346b9ad10c2d4792a08df0096beb0dd9, user_id=53e05a59e3cb41039a6da99cb9a36e23, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.477708 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da4a58-ef6a-431d-8c07-4f9461d50a12 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.489685 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1258/2516] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:42 2022] PUT /identity/v3/projects/346b9ad10c2d4792a08df0096beb0dd9/users/53e05a59e3cb41039a6da99cb9a36e23/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:42.501497 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558559ab-329e-4259-a798-e49ada9a0f79 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.501792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558559ab-329e-4259-a798-e49ada9a0f79 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.502076 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558559ab-329e-4259-a798-e49ada9a0f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.529417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-558559ab-329e-4259-a798-e49ada9a0f79 None None] MFA Rules not processed for user `53e05a59e3cb41039a6da99cb9a36e23`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:42.530633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-558559ab-329e-4259-a798-e49ada9a0f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:42.603215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1259/2517] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:42.614756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da4a58-ef6a-431d-8c07-4f9461d50a12 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.616564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-98da4a58-ef6a-431d-8c07-4f9461d50a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:42.692140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da4a58-ef6a-431d-8c07-4f9461d50a12 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.696936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76789fa0-e64f-43fd-98d7-ac777498fda8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.697651 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76789fa0-e64f-43fd-98d7-ac777498fda8 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.697936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76789fa0-e64f-43fd-98d7-ac777498fda8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.698215 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76789fa0-e64f-43fd-98d7-ac777498fda8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.711680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76789fa0-e64f-43fd-98d7-ac777498fda8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.713328 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76789fa0-e64f-43fd-98d7-ac777498fda8 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.723347 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1259/2518] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:42.775940 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558559ab-329e-4259-a798-e49ada9a0f79 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:42.777895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-558559ab-329e-4259-a798-e49ada9a0f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:42.791387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558559ab-329e-4259-a798-e49ada9a0f79 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:42.795377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290059d-c90b-4445-8886-8126d6c36bd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:42.796050 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290059d-c90b-4445-8886-8126d6c36bd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:42.796340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290059d-c90b-4445-8886-8126d6c36bd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:42.796624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290059d-c90b-4445-8886-8126d6c36bd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:42.868399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290059d-c90b-4445-8886-8126d6c36bd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:42.869921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290059d-c90b-4445-8886-8126d6c36bd5 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:42.880748 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1260/2519] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:45.581767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76789fa0-e64f-43fd-98d7-ac777498fda8 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:45.583290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-76789fa0-e64f-43fd-98d7-ac777498fda8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:45.659714 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76789fa0-e64f-43fd-98d7-ac777498fda8 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:45.667966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9dc9a-6927-45ca-9524-166bb9e055b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:45.668879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9dc9a-6927-45ca-9524-166bb9e055b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:45.669164 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9dc9a-6927-45ca-9524-166bb9e055b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:45.669438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9dc9a-6927-45ca-9524-166bb9e055b4 admin admin] PATH_INFO: `/v3/users/c90e6a7a7265480ca4c817d633da4a1d` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:45.670622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9dc9a-6927-45ca-9524-166bb9e055b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90e6a7a7265480ca4c817d633da4a1d)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:45.672620 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9dc9a-6927-45ca-9524-166bb9e055b4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:45.719804 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ade9dc9a-6927-45ca-9524-166bb9e055b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90e6a7a7265480ca4c817d633da4a1d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:45.720657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ade9dc9a-6927-45ca-9524-166bb9e055b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90e6a7a7265480ca4c817d633da4a1d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:45.721306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ade9dc9a-6927-45ca-9524-166bb9e055b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90e6a7a7265480ca4c817d633da4a1d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:45.734805 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ade9dc9a-6927-45ca-9524-166bb9e055b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90e6a7a7265480ca4c817d633da4a1d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:45.741629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ade9dc9a-6927-45ca-9524-166bb9e055b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90e6a7a7265480ca4c817d633da4a1d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:45.749876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:45.756067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1260/2520] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:45 2022] DELETE /identity/v3/users/c90e6a7a7265480ca4c817d633da4a1d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:45.938446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290059d-c90b-4445-8886-8126d6c36bd5 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:45.956695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290059d-c90b-4445-8886-8126d6c36bd5 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:46.021229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80a13e-d989-4cc7-9ce2-af385067f4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:46.022155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80a13e-d989-4cc7-9ce2-af385067f4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.022444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80a13e-d989-4cc7-9ce2-af385067f4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.022725 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80a13e-d989-4cc7-9ce2-af385067f4e9 admin admin] PATH_INFO: `/v3/projects/978105ae032049cd85c3b1c061d10a24` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.024556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80a13e-d989-4cc7-9ce2-af385067f4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978105ae032049cd85c3b1c061d10a24)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:46.027015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80a13e-d989-4cc7-9ce2-af385067f4e9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:46.039329 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:46.083172 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ea80a13e-d989-4cc7-9ce2-af385067f4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978105ae032049cd85c3b1c061d10a24', 'request_id': 'req-ea80a13e-d989-4cc7-9ce2-af385067f4e9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:46.091462 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ea80a13e-d989-4cc7-9ce2-af385067f4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978105ae032049cd85c3b1c061d10a24', 'request_id': 'req-ea80a13e-d989-4cc7-9ce2-af385067f4e9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:46.098397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ea80a13e-d989-4cc7-9ce2-af385067f4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978105ae032049cd85c3b1c061d10a24', 'request_id': 'req-ea80a13e-d989-4cc7-9ce2-af385067f4e9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:46.111170 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ea80a13e-d989-4cc7-9ce2-af385067f4e9 admin admin] The token cache is being invalidate because project 978105ae032049cd85c3b1c061d10a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:46.111492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ea80a13e-d989-4cc7-9ce2-af385067f4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:46.112287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ea80a13e-d989-4cc7-9ce2-af385067f4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:46.114257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1261/2521] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:45 2022] DELETE /identity/v3/projects/978105ae032049cd85c3b1c061d10a24 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:46.120681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff3026-d150-4e93-91b4-1ea84b7fa737 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.120997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff3026-d150-4e93-91b4-1ea84b7fa737 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.121283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff3026-d150-4e93-91b4-1ea84b7fa737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.141447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-76ff3026-d150-4e93-91b4-1ea84b7fa737 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:46.142809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-76ff3026-d150-4e93-91b4-1ea84b7fa737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:46.208786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1261/2522] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:46.216585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a24ce-b069-4ae6-8449-b0e1f998b68b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.216909 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a24ce-b069-4ae6-8449-b0e1f998b68b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.217189 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a24ce-b069-4ae6-8449-b0e1f998b68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.236838 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d24a24ce-b069-4ae6-8449-b0e1f998b68b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:46.238048 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d24a24ce-b069-4ae6-8449-b0e1f998b68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:46.247705 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1262/2523] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:46.251709 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff3026-d150-4e93-91b4-1ea84b7fa737 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:46.261437 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff3026-d150-4e93-91b4-1ea84b7fa737 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:46.266151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf04316-76cd-499b-bca7-2f7643bb0f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:46.266741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf04316-76cd-499b-bca7-2f7643bb0f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.267022 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf04316-76cd-499b-bca7-2f7643bb0f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.267297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf04316-76cd-499b-bca7-2f7643bb0f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.268019 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf04316-76cd-499b-bca7-2f7643bb0f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:46.268577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf04316-76cd-499b-bca7-2f7643bb0f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:46.270194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf04316-76cd-499b-bca7-2f7643bb0f1a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:46.282483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1262/2524] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:46.286470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a24ce-b069-4ae6-8449-b0e1f998b68b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:46.299737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a24ce-b069-4ae6-8449-b0e1f998b68b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:46.304512 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffe6ef-21c1-4488-93d2-d819596c21af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:46.305809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffe6ef-21c1-4488-93d2-d819596c21af admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.306086 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffe6ef-21c1-4488-93d2-d819596c21af admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.306359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecffe6ef-21c1-4488-93d2-d819596c21af admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.307050 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffe6ef-21c1-4488-93d2-d819596c21af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:46.308985 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecffe6ef-21c1-4488-93d2-d819596c21af admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:46.338530 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1263/2525] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:46 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:46.339674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf04316-76cd-499b-bca7-2f7643bb0f1a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:46.349576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf04316-76cd-499b-bca7-2f7643bb0f1a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:46.414553 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd21f98-2e08-4869-a63f-9002aef2db83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:46.415243 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21f98-2e08-4869-a63f-9002aef2db83 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.415531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21f98-2e08-4869-a63f-9002aef2db83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.415811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21f98-2e08-4869-a63f-9002aef2db83 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.416521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd21f98-2e08-4869-a63f-9002aef2db83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:46.418483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd21f98-2e08-4869-a63f-9002aef2db83 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:46.440523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1263/2526] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:46 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:46.444431 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffe6ef-21c1-4488-93d2-d819596c21af admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:46.455335 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecffe6ef-21c1-4488-93d2-d819596c21af admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:46.460193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de5b17-af9b-4667-b47a-8b50291a01e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:46.460975 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de5b17-af9b-4667-b47a-8b50291a01e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.461321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de5b17-af9b-4667-b47a-8b50291a01e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.462290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de5b17-af9b-4667-b47a-8b50291a01e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.463155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de5b17-af9b-4667-b47a-8b50291a01e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:46.464779 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de5b17-af9b-4667-b47a-8b50291a01e8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:46.475288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1264/2527] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:46.479653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd21f98-2e08-4869-a63f-9002aef2db83 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:46.495817 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd21f98-2e08-4869-a63f-9002aef2db83 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:46.500783 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b0a11-7a29-474c-9294-7302f1ec46f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:46.501467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b0a11-7a29-474c-9294-7302f1ec46f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.501754 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b0a11-7a29-474c-9294-7302f1ec46f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.502546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b0a11-7a29-474c-9294-7302f1ec46f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.502801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b0a11-7a29-474c-9294-7302f1ec46f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:46.504400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b0a11-7a29-474c-9294-7302f1ec46f4 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:46.509419 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de5b17-af9b-4667-b47a-8b50291a01e8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:46.511143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b2de5b17-af9b-4667-b47a-8b50291a01e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:46.520974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1264/2528] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:46.521945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b0a11-7a29-474c-9294-7302f1ec46f4 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:46.525116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de5b17-af9b-4667-b47a-8b50291a01e8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:46.530540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1a534-884a-4789-9967-4d35e2946c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:46.531436 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1a534-884a-4789-9967-4d35e2946c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.531723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1a534-884a-4789-9967-4d35e2946c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.532030 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1a534-884a-4789-9967-4d35e2946c40 admin admin] PATH_INFO: `/v3/users/504a018b7e1e47418d9b4034ac137604` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.533065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b0a11-7a29-474c-9294-7302f1ec46f4 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:46.533320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1a534-884a-4789-9967-4d35e2946c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=504a018b7e1e47418d9b4034ac137604)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:46.535290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1a534-884a-4789-9967-4d35e2946c40 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:46.537648 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0df353-0b31-468c-96b7-e379607f864e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:46.538516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0df353-0b31-468c-96b7-e379607f864e admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.538798 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0df353-0b31-468c-96b7-e379607f864e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.539071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0df353-0b31-468c-96b7-e379607f864e admin admin] PATH_INFO: `/v3/projects/ae3ce3642778456684d1333b2db4f4c1/users/a90bae943c614475ad66c7a0fb037cd4/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.554334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0df353-0b31-468c-96b7-e379607f864e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3ce3642778456684d1333b2db4f4c1, user_id=a90bae943c614475ad66c7a0fb037cd4, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:46.558001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0df353-0b31-468c-96b7-e379607f864e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:46.572456 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1265/2529] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:46 2022] PUT /identity/v3/projects/ae3ce3642778456684d1333b2db4f4c1/users/a90bae943c614475ad66c7a0fb037cd4/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:46.582986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d63b92-a1bb-436b-a89e-a3e896861e8d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.583595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d63b92-a1bb-436b-a89e-a3e896861e8d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.583595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d63b92-a1bb-436b-a89e-a3e896861e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.583807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ee1a534-884a-4789-9967-4d35e2946c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '504a018b7e1e47418d9b4034ac137604'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:46.584280 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ee1a534-884a-4789-9967-4d35e2946c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '504a018b7e1e47418d9b4034ac137604'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:46.584924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ee1a534-884a-4789-9967-4d35e2946c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '504a018b7e1e47418d9b4034ac137604'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:46.599055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ee1a534-884a-4789-9967-4d35e2946c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '504a018b7e1e47418d9b4034ac137604'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:46.606403 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ee1a534-884a-4789-9967-4d35e2946c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '504a018b7e1e47418d9b4034ac137604'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:46.616310 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f3d63b92-a1bb-436b-a89e-a3e896861e8d None None] MFA Rules not processed for user `a90bae943c614475ad66c7a0fb037cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:46.618154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f3d63b92-a1bb-436b-a89e-a3e896861e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:46.630328 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1265/2530] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:46 2022] DELETE /identity/v3/users/504a018b7e1e47418d9b4034ac137604 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:46.635722 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf93523-999f-4bbb-9a79-c02fd69a418b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.636016 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf93523-999f-4bbb-9a79-c02fd69a418b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.636297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf93523-999f-4bbb-9a79-c02fd69a418b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.650373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:46.659721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-acf93523-999f-4bbb-9a79-c02fd69a418b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:46.661448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-acf93523-999f-4bbb-9a79-c02fd69a418b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:46.696185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:46.700954 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1266/2531] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:46.709115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d63b92-a1bb-436b-a89e-a3e896861e8d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:46.710677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f3d63b92-a1bb-436b-a89e-a3e896861e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:46.741347 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1266/2532] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:46.751018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf93523-999f-4bbb-9a79-c02fd69a418b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:46.754633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-acf93523-999f-4bbb-9a79-c02fd69a418b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:46.812680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d63b92-a1bb-436b-a89e-a3e896861e8d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:46.818220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf93523-999f-4bbb-9a79-c02fd69a418b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:46.824191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ffd04-96aa-4e8a-95c7-7359fc406b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:46.824191 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ffd04-96aa-4e8a-95c7-7359fc406b19 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.824452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ffd04-96aa-4e8a-95c7-7359fc406b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.824746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ffd04-96aa-4e8a-95c7-7359fc406b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.834911 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ffd04-96aa-4e8a-95c7-7359fc406b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:46.836495 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ffd04-96aa-4e8a-95c7-7359fc406b19 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:46.847709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1267/2533] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:46.892870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6718973-5b03-4253-bcc6-eda1bbb2f401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:46.893799 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6718973-5b03-4253-bcc6-eda1bbb2f401 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:46.894086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6718973-5b03-4253-bcc6-eda1bbb2f401 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:46.894364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6718973-5b03-4253-bcc6-eda1bbb2f401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:46.968222 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6718973-5b03-4253-bcc6-eda1bbb2f401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:46.970402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6718973-5b03-4253-bcc6-eda1bbb2f401 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:46.981687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1267/2534] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:47.166261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ffd04-96aa-4e8a-95c7-7359fc406b19 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:47.167758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-eb3ffd04-96aa-4e8a-95c7-7359fc406b19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:47.192123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ffd04-96aa-4e8a-95c7-7359fc406b19 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:47.201051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:47.202038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:47.202365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:47.202657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] PATH_INFO: `/v3/projects/3add6fb4d45548328ac2749410d5df0d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:47.203969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3add6fb4d45548328ac2749410d5df0d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:47.206013 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:47.277742 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3add6fb4d45548328ac2749410d5df0d', 'request_id': 'req-fd261e4c-beb8-4404-ba01-be20735179f1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.288071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3add6fb4d45548328ac2749410d5df0d', 'request_id': 'req-fd261e4c-beb8-4404-ba01-be20735179f1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.298576 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3add6fb4d45548328ac2749410d5df0d', 'request_id': 'req-fd261e4c-beb8-4404-ba01-be20735179f1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.318871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] The token cache is being invalidate because project 3add6fb4d45548328ac2749410d5df0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:47.319507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.320674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.324262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1268/2535] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:47 2022] DELETE /identity/v3/projects/3add6fb4d45548328ac2749410d5df0d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:47.330313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6718973-5b03-4253-bcc6-eda1bbb2f401 service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:47.342753 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:47.354480 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6718973-5b03-4253-bcc6-eda1bbb2f401 service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:47.436731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b31ca-5a8a-40d9-86fe-52e0daf629c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:47.437835 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b31ca-5a8a-40d9-86fe-52e0daf629c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:47.438239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b31ca-5a8a-40d9-86fe-52e0daf629c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:47.438535 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b31ca-5a8a-40d9-86fe-52e0daf629c6 admin admin] PATH_INFO: `/v3/users/53e05a59e3cb41039a6da99cb9a36e23` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:47.439859 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b31ca-5a8a-40d9-86fe-52e0daf629c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e05a59e3cb41039a6da99cb9a36e23)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:47.443760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b31ca-5a8a-40d9-86fe-52e0daf629c6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:47.499329 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ce7b31ca-5a8a-40d9-86fe-52e0daf629c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e05a59e3cb41039a6da99cb9a36e23'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.499986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ce7b31ca-5a8a-40d9-86fe-52e0daf629c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e05a59e3cb41039a6da99cb9a36e23'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.500575 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ce7b31ca-5a8a-40d9-86fe-52e0daf629c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e05a59e3cb41039a6da99cb9a36e23'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.513157 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ce7b31ca-5a8a-40d9-86fe-52e0daf629c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e05a59e3cb41039a6da99cb9a36e23'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.520383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ce7b31ca-5a8a-40d9-86fe-52e0daf629c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e05a59e3cb41039a6da99cb9a36e23'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.533137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1268/2536] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:47 2022] DELETE /identity/v3/users/53e05a59e3cb41039a6da99cb9a36e23 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:47.808353 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:47.809840 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:47.824406 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd261e4c-beb8-4404-ba01-be20735179f1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:47.884494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:47.885623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:47.885909 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:47.886803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68 admin admin] PATH_INFO: `/v3/projects/346b9ad10c2d4792a08df0096beb0dd9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:47.888041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=346b9ad10c2d4792a08df0096beb0dd9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:47.890005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:47.891675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:47.947370 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '346b9ad10c2d4792a08df0096beb0dd9', 'request_id': 'req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.956303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '346b9ad10c2d4792a08df0096beb0dd9', 'request_id': 'req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.963133 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '346b9ad10c2d4792a08df0096beb0dd9', 'request_id': 'req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.974417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68 admin admin] The token cache is being invalidate because project 346b9ad10c2d4792a08df0096beb0dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:47.974713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.975364 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4e3a94fc-55a6-4f2a-9d23-e9afa78e1a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:47.977192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1269/2537] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:47 2022] DELETE /identity/v3/projects/346b9ad10c2d4792a08df0096beb0dd9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:47.982609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ec96f-2f47-4f7f-883a-c8fe4621027c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:47.983127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ec96f-2f47-4f7f-883a-c8fe4621027c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:47.983233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ec96f-2f47-4f7f-883a-c8fe4621027c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.008026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-055ec96f-2f47-4f7f-883a-c8fe4621027c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:48.010254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-055ec96f-2f47-4f7f-883a-c8fe4621027c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:48.072147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1269/2538] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:48.079716 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab2efc-decd-4c5c-a472-dd928c84209c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.080013 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab2efc-decd-4c5c-a472-dd928c84209c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.080294 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab2efc-decd-4c5c-a472-dd928c84209c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.099221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0eab2efc-decd-4c5c-a472-dd928c84209c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:48.100427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0eab2efc-decd-4c5c-a472-dd928c84209c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:48.108965 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1270/2539] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:48.113145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ec96f-2f47-4f7f-883a-c8fe4621027c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:48.123136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ec96f-2f47-4f7f-883a-c8fe4621027c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:48.127684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdb5c1-43ac-46bd-99e2-2a68c7ee5217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:48.128331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdb5c1-43ac-46bd-99e2-2a68c7ee5217 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.128613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdb5c1-43ac-46bd-99e2-2a68c7ee5217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.128920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdb5c1-43ac-46bd-99e2-2a68c7ee5217 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.129645 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdb5c1-43ac-46bd-99e2-2a68c7ee5217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:48.129952 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdb5c1-43ac-46bd-99e2-2a68c7ee5217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:48.131537 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdb5c1-43ac-46bd-99e2-2a68c7ee5217 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:48.143748 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1270/2540] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:48.148037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab2efc-decd-4c5c-a472-dd928c84209c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:48.157636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab2efc-decd-4c5c-a472-dd928c84209c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:48.162226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea1d09-c75d-4565-bd7f-9eab62a92fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:48.162869 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea1d09-c75d-4565-bd7f-9eab62a92fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.163156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea1d09-c75d-4565-bd7f-9eab62a92fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.163432 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea1d09-c75d-4565-bd7f-9eab62a92fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.164121 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea1d09-c75d-4565-bd7f-9eab62a92fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:48.166693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea1d09-c75d-4565-bd7f-9eab62a92fb3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:48.193624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1271/2541] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:48 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:48.197896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdb5c1-43ac-46bd-99e2-2a68c7ee5217 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:48.209039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdb5c1-43ac-46bd-99e2-2a68c7ee5217 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:48.235992 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:48.299178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a225f25-b0d6-4628-8fed-a0f209bd54b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:48.299931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a225f25-b0d6-4628-8fed-a0f209bd54b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.300221 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a225f25-b0d6-4628-8fed-a0f209bd54b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.300505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a225f25-b0d6-4628-8fed-a0f209bd54b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.301251 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a225f25-b0d6-4628-8fed-a0f209bd54b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:48.303176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a225f25-b0d6-4628-8fed-a0f209bd54b5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:48.318461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea1d09-c75d-4565-bd7f-9eab62a92fb3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:48.319921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7bea1d09-c75d-4565-bd7f-9eab62a92fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:48.327861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1271/2542] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:48 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:48.328963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a225f25-b0d6-4628-8fed-a0f209bd54b5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:48.333545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea1d09-c75d-4565-bd7f-9eab62a92fb3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:48.338499 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787fdb5-7784-4762-9b32-571407001daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:48.339239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a225f25-b0d6-4628-8fed-a0f209bd54b5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:48.339371 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787fdb5-7784-4762-9b32-571407001daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.339644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787fdb5-7784-4762-9b32-571407001daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.339924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787fdb5-7784-4762-9b32-571407001daa admin admin] PATH_INFO: `/v3/users/11cee8d2384a46899fd18e171c27bdf3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.341328 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787fdb5-7784-4762-9b32-571407001daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=11cee8d2384a46899fd18e171c27bdf3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:48.343429 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787fdb5-7784-4762-9b32-571407001daa admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:48.344302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f339f9-7a1b-456c-b998-c0d9a1284fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:48.345010 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f339f9-7a1b-456c-b998-c0d9a1284fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.345299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f339f9-7a1b-456c-b998-c0d9a1284fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.345585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f339f9-7a1b-456c-b998-c0d9a1284fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.346313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f339f9-7a1b-456c-b998-c0d9a1284fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:48.347898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f339f9-7a1b-456c-b998-c0d9a1284fb0 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:48.361416 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1272/2543] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:48.362400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f339f9-7a1b-456c-b998-c0d9a1284fb0 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:48.373030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f339f9-7a1b-456c-b998-c0d9a1284fb0 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:48.378866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954c1bd-c4f6-46c0-965a-0d2e6c255d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:48.379541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c1bd-c4f6-46c0-965a-0d2e6c255d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.380245 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c1bd-c4f6-46c0-965a-0d2e6c255d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.380407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c1bd-c4f6-46c0-965a-0d2e6c255d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.381097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954c1bd-c4f6-46c0-965a-0d2e6c255d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:48.382941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954c1bd-c4f6-46c0-965a-0d2e6c255d65 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:48.393694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6787fdb5-7784-4762-9b32-571407001daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11cee8d2384a46899fd18e171c27bdf3'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:48.394373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6787fdb5-7784-4762-9b32-571407001daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11cee8d2384a46899fd18e171c27bdf3'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:48.394785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1273/2544] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:48.395000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6787fdb5-7784-4762-9b32-571407001daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11cee8d2384a46899fd18e171c27bdf3'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:48.399593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954c1bd-c4f6-46c0-965a-0d2e6c255d65 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:48.401256 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c954c1bd-c4f6-46c0-965a-0d2e6c255d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:48.407868 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6787fdb5-7784-4762-9b32-571407001daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11cee8d2384a46899fd18e171c27bdf3'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:48.413646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954c1bd-c4f6-46c0-965a-0d2e6c255d65 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:48.414931 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6787fdb5-7784-4762-9b32-571407001daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11cee8d2384a46899fd18e171c27bdf3'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:48.418901 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a6ac9-afa1-4977-8195-2891467bee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:48.419836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a6ac9-afa1-4977-8195-2891467bee2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.420079 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a6ac9-afa1-4977-8195-2891467bee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.420363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a6ac9-afa1-4977-8195-2891467bee2c admin admin] PATH_INFO: `/v3/projects/2db8a24f5ab54aee9c1eaa402fe6bc2e/users/d5906433fdd14244931d4a170d0a0c98/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.428477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1272/2545] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:48 2022] DELETE /identity/v3/users/11cee8d2384a46899fd18e171c27bdf3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:48.433223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78052d05-f291-4749-b8e5-332f925b43a6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.433523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78052d05-f291-4749-b8e5-332f925b43a6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.433806 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78052d05-f291-4749-b8e5-332f925b43a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.438799 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a6ac9-afa1-4977-8195-2891467bee2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db8a24f5ab54aee9c1eaa402fe6bc2e, user_id=d5906433fdd14244931d4a170d0a0c98, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:48.442448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a6ac9-afa1-4977-8195-2891467bee2c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:48.452105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-78052d05-f291-4749-b8e5-332f925b43a6 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:48.453384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-78052d05-f291-4749-b8e5-332f925b43a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:48.456891 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1274/2546] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:48 2022] PUT /identity/v3/projects/2db8a24f5ab54aee9c1eaa402fe6bc2e/users/d5906433fdd14244931d4a170d0a0c98/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:48.469854 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4098c-759b-42c5-9320-da158bd8eee2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.470203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4098c-759b-42c5-9320-da158bd8eee2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.470489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4098c-759b-42c5-9320-da158bd8eee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.484746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:48.505434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c9f4098c-759b-42c5-9320-da158bd8eee2 None None] MFA Rules not processed for user `d5906433fdd14244931d4a170d0a0c98`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:48.507227 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c9f4098c-759b-42c5-9320-da158bd8eee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:48.525979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1273/2547] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:48.535755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78052d05-f291-4749-b8e5-332f925b43a6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:48.537411 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-78052d05-f291-4749-b8e5-332f925b43a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:48.588966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1275/2548] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:48.603643 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4098c-759b-42c5-9320-da158bd8eee2 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:48.605080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78052d05-f291-4749-b8e5-332f925b43a6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:48.605220 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c9f4098c-759b-42c5-9320-da158bd8eee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:48.608904 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d4e39-8834-4932-bfa3-bf25abf27abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:48.609565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d4e39-8834-4932-bfa3-bf25abf27abf service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.609867 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d4e39-8834-4932-bfa3-bf25abf27abf service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.610125 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d4e39-8834-4932-bfa3-bf25abf27abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.621890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d4e39-8834-4932-bfa3-bf25abf27abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:48.623344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d4e39-8834-4932-bfa3-bf25abf27abf service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:48.633807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1274/2549] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:48.659697 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:48.705256 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4098c-759b-42c5-9320-da158bd8eee2 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:48.709599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706a685-bbaf-48b6-b2ae-488592720ee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:48.710351 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706a685-bbaf-48b6-b2ae-488592720ee9 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.710766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706a685-bbaf-48b6-b2ae-488592720ee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.711109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706a685-bbaf-48b6-b2ae-488592720ee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.723097 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706a685-bbaf-48b6-b2ae-488592720ee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:48.724663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706a685-bbaf-48b6-b2ae-488592720ee9 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:48.737320 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1276/2550] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:48.757630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d4e39-8834-4932-bfa3-bf25abf27abf service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:48.767993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d4e39-8834-4932-bfa3-bf25abf27abf service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:48.777532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:48.778016 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.778304 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.778657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] PATH_INFO: `/v3/users/d5906433fdd14244931d4a170d0a0c98` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.780437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5906433fdd14244931d4a170d0a0c98)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:48.782543 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:48.834823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5906433fdd14244931d4a170d0a0c98'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:48.835506 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5906433fdd14244931d4a170d0a0c98'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:48.836135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5906433fdd14244931d4a170d0a0c98'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:48.848727 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5906433fdd14244931d4a170d0a0c98'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:48.856488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5906433fdd14244931d4a170d0a0c98'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:48.872333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1275/2551] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:48 2022] DELETE /identity/v3/users/d5906433fdd14244931d4a170d0a0c98 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:48.877198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bccf9a-5431-47d8-809c-17ea406ba72d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:48.877491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bccf9a-5431-47d8-809c-17ea406ba72d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:48.878397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bccf9a-5431-47d8-809c-17ea406ba72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:48.897558 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f6bccf9a-5431-47d8-809c-17ea406ba72d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:48.898847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f6bccf9a-5431-47d8-809c-17ea406ba72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:48.942074 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:48.943594 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:48.989032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1277/2552] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:48.995949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bccf9a-5431-47d8-809c-17ea406ba72d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:48.997866 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f6bccf9a-5431-47d8-809c-17ea406ba72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:49.005395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:49.023306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd82e9-f989-4459-bee7-33efb15a6b84 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.028965 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.029822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.030102 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.030374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f admin admin] PATH_INFO: `/v3/projects/ff6b08f53fbc4242be8692da4fdaa9ff` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.031554 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6b08f53fbc4242be8692da4fdaa9ff)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.033496 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.058724 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bccf9a-5431-47d8-809c-17ea406ba72d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.062698 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319d0e4-90f2-498d-b24a-b90e9a167856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.063319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319d0e4-90f2-498d-b24a-b90e9a167856 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.063600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319d0e4-90f2-498d-b24a-b90e9a167856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.063878 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319d0e4-90f2-498d-b24a-b90e9a167856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.074348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319d0e4-90f2-498d-b24a-b90e9a167856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.075843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319d0e4-90f2-498d-b24a-b90e9a167856 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.083493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6b08f53fbc4242be8692da4fdaa9ff', 'request_id': 'req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.088450 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1278/2553] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:49.092797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6b08f53fbc4242be8692da4fdaa9ff', 'request_id': 'req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.100517 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6b08f53fbc4242be8692da4fdaa9ff', 'request_id': 'req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.112968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f admin admin] The token cache is being invalidate because project ff6b08f53fbc4242be8692da4fdaa9ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:49.113471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.114162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-13d86c3c-74c3-4dc4-be7f-bd244777fe9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.116124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1276/2554] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:48 2022] DELETE /identity/v3/projects/ff6b08f53fbc4242be8692da4fdaa9ff => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:49.121256 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8a8c-2d2f-412a-9993-df57de0b933c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.121678 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8a8c-2d2f-412a-9993-df57de0b933c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.122030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e8a8c-2d2f-412a-9993-df57de0b933c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.142455 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3d2e8a8c-2d2f-412a-9993-df57de0b933c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:49.144129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3d2e8a8c-2d2f-412a-9993-df57de0b933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:49.218479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1279/2555] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:49.227851 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd92b7-da8d-4572-9cdf-99766f6f36cd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.228523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd92b7-da8d-4572-9cdf-99766f6f36cd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.228635 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd92b7-da8d-4572-9cdf-99766f6f36cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.249880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-52bd92b7-da8d-4572-9cdf-99766f6f36cd None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:49.251083 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-52bd92b7-da8d-4572-9cdf-99766f6f36cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:49.261978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1277/2556] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:49.266283 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e8a8c-2d2f-412a-9993-df57de0b933c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.278140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e8a8c-2d2f-412a-9993-df57de0b933c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.284364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d53f7-64c7-449e-8594-b0e5a6c12522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.285397 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d53f7-64c7-449e-8594-b0e5a6c12522 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.286130 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d53f7-64c7-449e-8594-b0e5a6c12522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.286569 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d53f7-64c7-449e-8594-b0e5a6c12522 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.287534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d53f7-64c7-449e-8594-b0e5a6c12522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:49.288002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d53f7-64c7-449e-8594-b0e5a6c12522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.290441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d53f7-64c7-449e-8594-b0e5a6c12522 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.302955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:49.311522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1280/2557] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:49.315902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd92b7-da8d-4572-9cdf-99766f6f36cd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.331833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd92b7-da8d-4572-9cdf-99766f6f36cd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.337299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034a7ef-8bb6-41aa-b680-29f1e1078700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.337965 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034a7ef-8bb6-41aa-b680-29f1e1078700 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.338246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034a7ef-8bb6-41aa-b680-29f1e1078700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.338522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034a7ef-8bb6-41aa-b680-29f1e1078700 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.339260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034a7ef-8bb6-41aa-b680-29f1e1078700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.341220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034a7ef-8bb6-41aa-b680-29f1e1078700 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.372047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1278/2558] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:49 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:49.376675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d53f7-64c7-449e-8594-b0e5a6c12522 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.389072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d53f7-64c7-449e-8594-b0e5a6c12522 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.398240 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034a7ef-8bb6-41aa-b680-29f1e1078700 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.401130 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7034a7ef-8bb6-41aa-b680-29f1e1078700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:49.453249 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56981ac-76e3-44c7-a173-f922a900663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.454076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56981ac-76e3-44c7-a173-f922a900663b admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.454463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56981ac-76e3-44c7-a173-f922a900663b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.454846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56981ac-76e3-44c7-a173-f922a900663b admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.455679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56981ac-76e3-44c7-a173-f922a900663b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.457773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56981ac-76e3-44c7-a173-f922a900663b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.471659 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034a7ef-8bb6-41aa-b680-29f1e1078700 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.476697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e212f-d26f-4c58-a24d-b7f39a6a192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.478237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e212f-d26f-4c58-a24d-b7f39a6a192c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.478517 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e212f-d26f-4c58-a24d-b7f39a6a192c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.478796 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e212f-d26f-4c58-a24d-b7f39a6a192c admin admin] PATH_INFO: `/v3/projects/2db8a24f5ab54aee9c1eaa402fe6bc2e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.482394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1281/2559] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:49 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:49.482596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e212f-d26f-4c58-a24d-b7f39a6a192c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db8a24f5ab54aee9c1eaa402fe6bc2e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.482596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e212f-d26f-4c58-a24d-b7f39a6a192c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.483506 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56981ac-76e3-44c7-a173-f922a900663b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.494703 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56981ac-76e3-44c7-a173-f922a900663b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.499385 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a79d09-872b-443f-b69b-140814df7a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.500035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a79d09-872b-443f-b69b-140814df7a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.500318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a79d09-872b-443f-b69b-140814df7a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.500586 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a79d09-872b-443f-b69b-140814df7a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.501335 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a79d09-872b-443f-b69b-140814df7a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.502905 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a79d09-872b-443f-b69b-140814df7a12 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.513718 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1282/2560] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:49.517541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a79d09-872b-443f-b69b-140814df7a12 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.528112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a79d09-872b-443f-b69b-140814df7a12 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.531507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-672e212f-d26f-4c58-a24d-b7f39a6a192c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db8a24f5ab54aee9c1eaa402fe6bc2e', 'request_id': 'req-672e212f-d26f-4c58-a24d-b7f39a6a192c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.534319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:49.541815 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-672e212f-d26f-4c58-a24d-b7f39a6a192c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db8a24f5ab54aee9c1eaa402fe6bc2e', 'request_id': 'req-672e212f-d26f-4c58-a24d-b7f39a6a192c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.550528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-672e212f-d26f-4c58-a24d-b7f39a6a192c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db8a24f5ab54aee9c1eaa402fe6bc2e', 'request_id': 'req-672e212f-d26f-4c58-a24d-b7f39a6a192c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.561546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-672e212f-d26f-4c58-a24d-b7f39a6a192c admin admin] The token cache is being invalidate because project 2db8a24f5ab54aee9c1eaa402fe6bc2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:49.561836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-672e212f-d26f-4c58-a24d-b7f39a6a192c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.562860 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-672e212f-d26f-4c58-a24d-b7f39a6a192c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:49.564105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1279/2561] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:49 2022] DELETE /identity/v3/projects/2db8a24f5ab54aee9c1eaa402fe6bc2e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:49.568819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea331db-e215-4c34-80a4-1f96dbc53a0d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.569051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea331db-e215-4c34-80a4-1f96dbc53a0d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.569331 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea331db-e215-4c34-80a4-1f96dbc53a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.586246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4af3d4-a08b-431b-804c-527dfa13205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.587430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4af3d4-a08b-431b-804c-527dfa13205b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.587719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4af3d4-a08b-431b-804c-527dfa13205b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.587998 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4af3d4-a08b-431b-804c-527dfa13205b admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.588122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6ea331db-e215-4c34-80a4-1f96dbc53a0d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:49.588746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4af3d4-a08b-431b-804c-527dfa13205b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.589369 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6ea331db-e215-4c34-80a4-1f96dbc53a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:49.590330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4af3d4-a08b-431b-804c-527dfa13205b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.597639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1280/2562] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:49.600427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1283/2563] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:49.604397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea331db-e215-4c34-80a4-1f96dbc53a0d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.605796 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6ea331db-e215-4c34-80a4-1f96dbc53a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:49.606438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94aa1a-7b4a-4dcc-906e-00e62493b6cc None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.606729 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94aa1a-7b4a-4dcc-906e-00e62493b6cc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.607034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94aa1a-7b4a-4dcc-906e-00e62493b6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.619289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea331db-e215-4c34-80a4-1f96dbc53a0d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.624111 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0baef6d-9770-44b9-a9bc-ba27476d512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.625036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baef6d-9770-44b9-a9bc-ba27476d512f admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.625315 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baef6d-9770-44b9-a9bc-ba27476d512f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.625588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0baef6d-9770-44b9-a9bc-ba27476d512f admin admin] PATH_INFO: `/v3/projects/37c9f8ab5350409d80bd4f06edb9a8cb/users/35a8cef5909c4436b931b850075d7bce/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.626627 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-af94aa1a-7b4a-4dcc-906e-00e62493b6cc None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:49.627823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-af94aa1a-7b4a-4dcc-906e-00e62493b6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:49.636637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1284/2564] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:49.640806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94aa1a-7b4a-4dcc-906e-00e62493b6cc None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.641276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baef6d-9770-44b9-a9bc-ba27476d512f admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c9f8ab5350409d80bd4f06edb9a8cb, user_id=35a8cef5909c4436b931b850075d7bce, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.644300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0baef6d-9770-44b9-a9bc-ba27476d512f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.650779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94aa1a-7b4a-4dcc-906e-00e62493b6cc None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.655807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc5541-e32a-4be0-acad-bb5dc0641cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.656536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc5541-e32a-4be0-acad-bb5dc0641cea admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.656921 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc5541-e32a-4be0-acad-bb5dc0641cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.657267 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc5541-e32a-4be0-acad-bb5dc0641cea admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.658066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc5541-e32a-4be0-acad-bb5dc0641cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:49.658448 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc5541-e32a-4be0-acad-bb5dc0641cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.658714 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1281/2565] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:49 2022] PUT /identity/v3/projects/37c9f8ab5350409d80bd4f06edb9a8cb/users/35a8cef5909c4436b931b850075d7bce/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:49.660314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc5541-e32a-4be0-acad-bb5dc0641cea admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.668784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96609ec-9a20-4281-a786-05f35e79efbe None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.669080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96609ec-9a20-4281-a786-05f35e79efbe None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.669366 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96609ec-9a20-4281-a786-05f35e79efbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.675751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1285/2566] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:44:49.676746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc5541-e32a-4be0-acad-bb5dc0641cea admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.688486 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc5541-e32a-4be0-acad-bb5dc0641cea admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.699873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d96609ec-9a20-4281-a786-05f35e79efbe None None] MFA Rules not processed for user `35a8cef5909c4436b931b850075d7bce`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:49.701107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d96609ec-9a20-4281-a786-05f35e79efbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:49.738925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:49.752609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06004729-6dda-471f-8e8f-3c4455c9fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.753470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06004729-6dda-471f-8e8f-3c4455c9fe74 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.753812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06004729-6dda-471f-8e8f-3c4455c9fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.754207 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06004729-6dda-471f-8e8f-3c4455c9fe74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.755065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06004729-6dda-471f-8e8f-3c4455c9fe74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.757243 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06004729-6dda-471f-8e8f-3c4455c9fe74 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.776798 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1282/2567] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:49.783869 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96609ec-9a20-4281-a786-05f35e79efbe None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.794031 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96609ec-9a20-4281-a786-05f35e79efbe None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.801250 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1286/2568] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:49 2022] POST /identity/v3/projects => generated 361 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:49.801384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0757253-a14b-49ed-8778-e1a1ea000ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.801494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06004729-6dda-471f-8e8f-3c4455c9fe74 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.801607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0757253-a14b-49ed-8778-e1a1ea000ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.801607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0757253-a14b-49ed-8778-e1a1ea000ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.801607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0757253-a14b-49ed-8778-e1a1ea000ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.801607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0757253-a14b-49ed-8778-e1a1ea000ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.802619 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0757253-a14b-49ed-8778-e1a1ea000ee4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.802887 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-06004729-6dda-471f-8e8f-3c4455c9fe74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:49.832162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1283/2569] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:49 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:49.832162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0757253-a14b-49ed-8778-e1a1ea000ee4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.873223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06004729-6dda-471f-8e8f-3c4455c9fe74 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.899743 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0757253-a14b-49ed-8778-e1a1ea000ee4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.904728 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9838dcf-9b11-45a0-b7b0-1cadd18f0edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.905411 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838dcf-9b11-45a0-b7b0-1cadd18f0edb admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.905693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838dcf-9b11-45a0-b7b0-1cadd18f0edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.905968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9838dcf-9b11-45a0-b7b0-1cadd18f0edb admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.906661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9838dcf-9b11-45a0-b7b0-1cadd18f0edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.908679 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9838dcf-9b11-45a0-b7b0-1cadd18f0edb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.930979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1284/2570] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:49 2022] POST /identity/v3/users => generated 281 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:49.934961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9838dcf-9b11-45a0-b7b0-1cadd18f0edb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.938607 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.939493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.939834 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.940234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] PATH_INFO: `/v3/users/a90bae943c614475ad66c7a0fb037cd4` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.941685 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a90bae943c614475ad66c7a0fb037cd4)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.943593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.944602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9838dcf-9b11-45a0-b7b0-1cadd18f0edb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.951563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c42be-35ad-402c-87db-71a06c45c028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:49.952237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c42be-35ad-402c-87db-71a06c45c028 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:49.952524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c42be-35ad-402c-87db-71a06c45c028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:49.952836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c42be-35ad-402c-87db-71a06c45c028 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:49.953541 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c42be-35ad-402c-87db-71a06c45c028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:49.956685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c42be-35ad-402c-87db-71a06c45c028 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:49.964768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:49.985722 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1285/2571] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:49 2022] POST /identity/v3/users => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:49.985722 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c42be-35ad-402c-87db-71a06c45c028 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:49.994490 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c42be-35ad-402c-87db-71a06c45c028 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:49.999439 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a502765-d40f-4330-b4eb-5721f8a1ffd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.000139 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a502765-d40f-4330-b4eb-5721f8a1ffd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.000427 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a502765-d40f-4330-b4eb-5721f8a1ffd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.000730 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a502765-d40f-4330-b4eb-5721f8a1ffd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.001505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a502765-d40f-4330-b4eb-5721f8a1ffd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.003187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a502765-d40f-4330-b4eb-5721f8a1ffd2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.003399 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a90bae943c614475ad66c7a0fb037cd4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.004067 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a90bae943c614475ad66c7a0fb037cd4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.004842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a90bae943c614475ad66c7a0fb037cd4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.014166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1286/2572] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:50.017785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a502765-d40f-4330-b4eb-5721f8a1ffd2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.018002 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a90bae943c614475ad66c7a0fb037cd4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.019784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9a502765-d40f-4330-b4eb-5721f8a1ffd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.025679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a90bae943c614475ad66c7a0fb037cd4'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.032690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a502765-d40f-4330-b4eb-5721f8a1ffd2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.037680 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a84244-70a5-443d-bda6-b8437b123fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.038334 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a84244-70a5-443d-bda6-b8437b123fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.038615 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a84244-70a5-443d-bda6-b8437b123fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.038889 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a84244-70a5-443d-bda6-b8437b123fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.039269 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1287/2573] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:49 2022] DELETE /identity/v3/users/a90bae943c614475ad66c7a0fb037cd4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:50.040137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a84244-70a5-443d-bda6-b8437b123fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.040706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.041747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a84244-70a5-443d-bda6-b8437b123fcf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.042085 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.048878 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:50.053998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1287/2574] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:50.056794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d124043-77a6-4c57-af81-79dd9cc2d8c3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.057449 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d124043-77a6-4c57-af81-79dd9cc2d8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.058662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d124043-77a6-4c57-af81-79dd9cc2d8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.076390 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7d124043-77a6-4c57-af81-79dd9cc2d8c3 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:50.077646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7d124043-77a6-4c57-af81-79dd9cc2d8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.112281 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853afce-5f34-48f6-91f2-4f394c235e39 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.117039 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444255a-db14-47b4-860a-7e12d11df862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.118382 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444255a-db14-47b4-860a-7e12d11df862 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.118778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444255a-db14-47b4-860a-7e12d11df862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.119059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444255a-db14-47b4-860a-7e12d11df862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.119794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444255a-db14-47b4-860a-7e12d11df862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.121470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444255a-db14-47b4-860a-7e12d11df862 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.131538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1288/2575] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:50.132305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444255a-db14-47b4-860a-7e12d11df862 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.140363 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1288/2576] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:50.141438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d124043-77a6-4c57-af81-79dd9cc2d8c3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.145201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444255a-db14-47b4-860a-7e12d11df862 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.150700 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3b320-4bc1-45de-a06e-0a57909ec494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.151716 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3b320-4bc1-45de-a06e-0a57909ec494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.152001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3b320-4bc1-45de-a06e-0a57909ec494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.152281 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3b320-4bc1-45de-a06e-0a57909ec494 admin admin] PATH_INFO: `/v3/projects/b76777e79e184406a021db2e23557b62/users/66b02738b4534ba08c370f3056609d5d/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.152381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d124043-77a6-4c57-af81-79dd9cc2d8c3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.157352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6cf7b-9055-47a0-b074-1ef7c5d98a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.158322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6cf7b-9055-47a0-b074-1ef7c5d98a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.158609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6cf7b-9055-47a0-b074-1ef7c5d98a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.158979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6cf7b-9055-47a0-b074-1ef7c5d98a7d admin admin] PATH_INFO: `/v3/projects/29100ef4da6f41e7b5f4e767175044c5/users/c53d1adfb31b414683dbbcb4a8b7c419/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.168058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3b320-4bc1-45de-a06e-0a57909ec494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76777e79e184406a021db2e23557b62, user_id=66b02738b4534ba08c370f3056609d5d, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.170879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3b320-4bc1-45de-a06e-0a57909ec494 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.174611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6cf7b-9055-47a0-b074-1ef7c5d98a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29100ef4da6f41e7b5f4e767175044c5, user_id=c53d1adfb31b414683dbbcb4a8b7c419, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.177983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d6cf7b-9055-47a0-b074-1ef7c5d98a7d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.185953 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1289/2577] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:50 2022] PUT /identity/v3/projects/b76777e79e184406a021db2e23557b62/users/66b02738b4534ba08c370f3056609d5d/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:50.187046 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3b320-4bc1-45de-a06e-0a57909ec494 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.190102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e3d3b320-4bc1-45de-a06e-0a57909ec494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.194694 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1289/2578] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:50 2022] PUT /identity/v3/projects/29100ef4da6f41e7b5f4e767175044c5/users/c53d1adfb31b414683dbbcb4a8b7c419/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:50.195507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6cf7b-9055-47a0-b074-1ef7c5d98a7d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.254416 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3b320-4bc1-45de-a06e-0a57909ec494 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.257809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d6cf7b-9055-47a0-b074-1ef7c5d98a7d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.262810 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8bc8d7-4b50-47e7-8b01-00a33927a445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.263477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bc8d7-4b50-47e7-8b01-00a33927a445 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.263764 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bc8d7-4b50-47e7-8b01-00a33927a445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.264043 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8bc8d7-4b50-47e7-8b01-00a33927a445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.264804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bc8d7-4b50-47e7-8b01-00a33927a445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.266406 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8bc8d7-4b50-47e7-8b01-00a33927a445 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.277491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1290/2579] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:50.278555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edb376-a4fa-445b-8b36-9bd1f0b69a67 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.278846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edb376-a4fa-445b-8b36-9bd1f0b69a67 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.279734 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edb376-a4fa-445b-8b36-9bd1f0b69a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.306998 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c0edb376-a4fa-445b-8b36-9bd1f0b69a67 None None] MFA Rules not processed for user `c53d1adfb31b414683dbbcb4a8b7c419`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:50.308215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c0edb376-a4fa-445b-8b36-9bd1f0b69a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.311963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb2b37-015c-4b5c-9276-5cbe5020ec9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.312957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb2b37-015c-4b5c-9276-5cbe5020ec9c service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.313362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb2b37-015c-4b5c-9276-5cbe5020ec9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.313769 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb2b37-015c-4b5c-9276-5cbe5020ec9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.325696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb2b37-015c-4b5c-9276-5cbe5020ec9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.328319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb2b37-015c-4b5c-9276-5cbe5020ec9c service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.343428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:50.344384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1290/2580] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:50.346000 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb2b37-015c-4b5c-9276-5cbe5020ec9c service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.359956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb2b37-015c-4b5c-9276-5cbe5020ec9c service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.364949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1e66a-eee2-4d5f-a35c-bb443858cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.365909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1e66a-eee2-4d5f-a35c-bb443858cac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.366259 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1e66a-eee2-4d5f-a35c-bb443858cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.366910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1e66a-eee2-4d5f-a35c-bb443858cac9 admin admin] PATH_INFO: `/v3/projects/b76777e79e184406a021db2e23557b62/users/66b02738b4534ba08c370f3056609d5d/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.368821 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1e66a-eee2-4d5f-a35c-bb443858cac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76777e79e184406a021db2e23557b62, user_id=66b02738b4534ba08c370f3056609d5d, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.371560 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1e66a-eee2-4d5f-a35c-bb443858cac9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.382734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1291/2581] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:50 2022] PUT /identity/v3/projects/b76777e79e184406a021db2e23557b62/users/66b02738b4534ba08c370f3056609d5d/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:50.392920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801832-8b4b-48be-9c0c-c77eac2f1497 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.393213 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801832-8b4b-48be-9c0c-c77eac2f1497 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.393740 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20801832-8b4b-48be-9c0c-c77eac2f1497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.396654 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1291/2582] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:50.436678 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-20801832-8b4b-48be-9c0c-c77eac2f1497 None None] MFA Rules not processed for user `66b02738b4534ba08c370f3056609d5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:50.437470 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edb376-a4fa-445b-8b36-9bd1f0b69a67 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.439469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-20801832-8b4b-48be-9c0c-c77eac2f1497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.439613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c0edb376-a4fa-445b-8b36-9bd1f0b69a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.454034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:50.528507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edb376-a4fa-445b-8b36-9bd1f0b69a67 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.553693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1292/2583] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:50.567997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20801832-8b4b-48be-9c0c-c77eac2f1497 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.579025 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-20801832-8b4b-48be-9c0c-c77eac2f1497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.604053 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2590ed-3a1b-4722-9354-a74e133d8f44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.604731 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2590ed-3a1b-4722-9354-a74e133d8f44 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.605060 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2590ed-3a1b-4722-9354-a74e133d8f44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.605326 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2590ed-3a1b-4722-9354-a74e133d8f44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.637091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20801832-8b4b-48be-9c0c-c77eac2f1497 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.640961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cbf98-06c9-462c-a774-2fd0622506be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.641873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cbf98-06c9-462c-a774-2fd0622506be service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.641873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cbf98-06c9-462c-a774-2fd0622506be service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.642284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cbf98-06c9-462c-a774-2fd0622506be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.653746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cbf98-06c9-462c-a774-2fd0622506be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.655434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cbf98-06c9-462c-a774-2fd0622506be service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.667096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1293/2584] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:50.678286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2590ed-3a1b-4722-9354-a74e133d8f44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.679776 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2590ed-3a1b-4722-9354-a74e133d8f44 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.688115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cbf98-06c9-462c-a774-2fd0622506be service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.690260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1292/2585] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:50.691879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-af7cbf98-06c9-462c-a774-2fd0622506be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.706843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2590ed-3a1b-4722-9354-a74e133d8f44 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.772385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:50.781507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cbf98-06c9-462c-a774-2fd0622506be service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.786872 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.787744 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.788027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.788301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] PATH_INFO: `/v3/projects/ae3ce3642778456684d1333b2db4f4c1` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.789898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3ce3642778456684d1333b2db4f4c1)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.791814 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.795011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2590ed-3a1b-4722-9354-a74e133d8f44 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.800235 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e72f44-ec9c-4be9-aafb-a6309500e3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:50.800981 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e72f44-ec9c-4be9-aafb-a6309500e3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.801272 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e72f44-ec9c-4be9-aafb-a6309500e3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.801538 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e72f44-ec9c-4be9-aafb-a6309500e3cb admin admin] PATH_INFO: `/v3/users/c53d1adfb31b414683dbbcb4a8b7c419` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.802755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e72f44-ec9c-4be9-aafb-a6309500e3cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53d1adfb31b414683dbbcb4a8b7c419)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:50.804686 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e72f44-ec9c-4be9-aafb-a6309500e3cb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:50.842294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3ce3642778456684d1333b2db4f4c1', 'request_id': 'req-36e2dcf6-704c-4630-986b-52641607475c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.845364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:50.851253 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3ce3642778456684d1333b2db4f4c1', 'request_id': 'req-36e2dcf6-704c-4630-986b-52641607475c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.856765 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b0e72f44-ec9c-4be9-aafb-a6309500e3cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53d1adfb31b414683dbbcb4a8b7c419'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.857503 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b0e72f44-ec9c-4be9-aafb-a6309500e3cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53d1adfb31b414683dbbcb4a8b7c419'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.858220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b0e72f44-ec9c-4be9-aafb-a6309500e3cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53d1adfb31b414683dbbcb4a8b7c419'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.859552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3ce3642778456684d1333b2db4f4c1', 'request_id': 'req-36e2dcf6-704c-4630-986b-52641607475c'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.870741 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b0e72f44-ec9c-4be9-aafb-a6309500e3cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53d1adfb31b414683dbbcb4a8b7c419'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.870893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] The token cache is being invalidate because project ae3ce3642778456684d1333b2db4f4c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:50.871137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.871833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.873570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1294/2586] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:50 2022] DELETE /identity/v3/projects/ae3ce3642778456684d1333b2db4f4c1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:50.878190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:50.879552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.881562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b0e72f44-ec9c-4be9-aafb-a6309500e3cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53d1adfb31b414683dbbcb4a8b7c419'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:50.897885 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1293/2587] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:50 2022] DELETE /identity/v3/users/c53d1adfb31b414683dbbcb4a8b7c419 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:50.899806 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce569c01-55cb-407f-86f4-96cd22758eb4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.900093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce569c01-55cb-407f-86f4-96cd22758eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.900561 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce569c01-55cb-407f-86f4-96cd22758eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:50.918479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ce569c01-55cb-407f-86f4-96cd22758eb4 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:50.919719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ce569c01-55cb-407f-86f4-96cd22758eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:50.949694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2dcf6-704c-4630-986b-52641607475c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:50.988358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1294/2588] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:50.989595 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044bf46-58fa-4453-9c25-0b2f3f6613c4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:50.989963 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044bf46-58fa-4453-9c25-0b2f3f6613c4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:50.990309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044bf46-58fa-4453-9c25-0b2f3f6613c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.005536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47961752-c30e-4937-b476-134c1552d7ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.006229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47961752-c30e-4937-b476-134c1552d7ad service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.006519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47961752-c30e-4937-b476-134c1552d7ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.006802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47961752-c30e-4937-b476-134c1552d7ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.008188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4044bf46-58fa-4453-9c25-0b2f3f6613c4 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:51.008896 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-47961752-c30e-4937-b476-134c1552d7ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:51.009471 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4044bf46-58fa-4453-9c25-0b2f3f6613c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:51.017491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1295/2589] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:51.019038 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeac1a2-fa98-41d6-89a4-255e81b88c7c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.019489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeac1a2-fa98-41d6-89a4-255e81b88c7c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.020136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeac1a2-fa98-41d6-89a4-255e81b88c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.039174 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-aeeac1a2-fa98-41d6-89a4-255e81b88c7c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:51.040491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-aeeac1a2-fa98-41d6-89a4-255e81b88c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:51.048549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1296/2590] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:51.049374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeac1a2-fa98-41d6-89a4-255e81b88c7c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.050584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-aeeac1a2-fa98-41d6-89a4-255e81b88c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:51.075414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47961752-c30e-4937-b476-134c1552d7ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.076914 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47961752-c30e-4937-b476-134c1552d7ad service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.086985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1295/2591] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:51.088062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47961752-c30e-4937-b476-134c1552d7ad service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.100255 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47961752-c30e-4937-b476-134c1552d7ad service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.107182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55464aeb-c822-4338-af97-c0653e96d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.107903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55464aeb-c822-4338-af97-c0653e96d599 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.108183 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55464aeb-c822-4338-af97-c0653e96d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.108456 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55464aeb-c822-4338-af97-c0653e96d599 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.109385 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55464aeb-c822-4338-af97-c0653e96d599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:51.109923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55464aeb-c822-4338-af97-c0653e96d599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.111625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55464aeb-c822-4338-af97-c0653e96d599 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.113503 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:51.120019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeac1a2-fa98-41d6-89a4-255e81b88c7c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.125971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1296/2592] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:51.126361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65224e-d59b-4fea-a189-ddfee1a92176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.127275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65224e-d59b-4fea-a189-ddfee1a92176 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.127630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65224e-d59b-4fea-a189-ddfee1a92176 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.128322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65224e-d59b-4fea-a189-ddfee1a92176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.130484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55464aeb-c822-4338-af97-c0653e96d599 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.141924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65224e-d59b-4fea-a189-ddfee1a92176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.142125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55464aeb-c822-4338-af97-c0653e96d599 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.143976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65224e-d59b-4fea-a189-ddfee1a92176 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.148576 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5cb8a-a396-4023-b521-28e0f339cc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.149307 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5cb8a-a396-4023-b521-28e0f339cc84 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.150252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5cb8a-a396-4023-b521-28e0f339cc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.150252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5cb8a-a396-4023-b521-28e0f339cc84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.150524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5cb8a-a396-4023-b521-28e0f339cc84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.152496 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5cb8a-a396-4023-b521-28e0f339cc84 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.155582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1297/2593] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:51.185290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1297/2594] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:51.189532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65224e-d59b-4fea-a189-ddfee1a92176 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.205215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65224e-d59b-4fea-a189-ddfee1a92176 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.285983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a683e0-0d38-4213-a38a-240990d75ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.286668 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a683e0-0d38-4213-a38a-240990d75ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.286956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a683e0-0d38-4213-a38a-240990d75ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.287231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a683e0-0d38-4213-a38a-240990d75ccf admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.287928 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a683e0-0d38-4213-a38a-240990d75ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.290736 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a683e0-0d38-4213-a38a-240990d75ccf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.314275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1298/2595] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:51.315554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5cb8a-a396-4023-b521-28e0f339cc84 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.326734 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5cb8a-a396-4023-b521-28e0f339cc84 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.331621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5d66a-36a3-412c-a6df-2de5263beb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.332470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5d66a-36a3-412c-a6df-2de5263beb17 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.332470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5d66a-36a3-412c-a6df-2de5263beb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.332786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5d66a-36a3-412c-a6df-2de5263beb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.333491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5d66a-36a3-412c-a6df-2de5263beb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.335090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5d66a-36a3-412c-a6df-2de5263beb17 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.348284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1298/2596] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:51.352338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a683e0-0d38-4213-a38a-240990d75ccf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.362658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a683e0-0d38-4213-a38a-240990d75ccf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.368050 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d292d-64a1-4bf0-9c43-0006c0598bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.368757 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d292d-64a1-4bf0-9c43-0006c0598bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.369049 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d292d-64a1-4bf0-9c43-0006c0598bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.369326 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d292d-64a1-4bf0-9c43-0006c0598bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.370069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d292d-64a1-4bf0-9c43-0006c0598bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.371672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d292d-64a1-4bf0-9c43-0006c0598bf6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.382152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1299/2597] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:51.386776 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5d66a-36a3-412c-a6df-2de5263beb17 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.393752 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:51.398515 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5d66a-36a3-412c-a6df-2de5263beb17 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.405863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5c340-8e50-4da7-91d3-baa943f18c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.406752 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5c340-8e50-4da7-91d3-baa943f18c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.407174 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5c340-8e50-4da7-91d3-baa943f18c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.407684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5c340-8e50-4da7-91d3-baa943f18c8b admin admin] PATH_INFO: `/v3/projects/a3d2bb70207041388d27e1b17cbaa8bb/users/0b6fc288187c46729f812b634f5179cc/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.424161 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5c340-8e50-4da7-91d3-baa943f18c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d2bb70207041388d27e1b17cbaa8bb, user_id=0b6fc288187c46729f812b634f5179cc, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.426908 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5c340-8e50-4da7-91d3-baa943f18c8b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.440630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1299/2598] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:51 2022] PUT /identity/v3/projects/a3d2bb70207041388d27e1b17cbaa8bb/users/0b6fc288187c46729f812b634f5179cc/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:51.452093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55c3c-28bc-4245-a563-104655c568c3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.452484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55c3c-28bc-4245-a563-104655c568c3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.452919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55c3c-28bc-4245-a563-104655c568c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.469518 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5c340-8e50-4da7-91d3-baa943f18c8b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.471542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-aef5c340-8e50-4da7-91d3-baa943f18c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:51.486558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-12c55c3c-28bc-4245-a563-104655c568c3 None None] MFA Rules not processed for user `0b6fc288187c46729f812b634f5179cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:51.488051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-12c55c3c-28bc-4245-a563-104655c568c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:51.551498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5c340-8e50-4da7-91d3-baa943f18c8b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.562453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.563279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.563417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1300/2599] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:51.563580 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.563838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a admin admin] PATH_INFO: `/v3/projects/29100ef4da6f41e7b5f4e767175044c5` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.565093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a admin admin] RBAC: Authorizing `identity:delete_project(project_id=29100ef4da6f41e7b5f4e767175044c5)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.567017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.574908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c55c3c-28bc-4245-a563-104655c568c3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.621566 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29100ef4da6f41e7b5f4e767175044c5', 'request_id': 'req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:51.629705 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29100ef4da6f41e7b5f4e767175044c5', 'request_id': 'req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:51.637214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29100ef4da6f41e7b5f4e767175044c5', 'request_id': 'req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:51.638371 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c55c3c-28bc-4245-a563-104655c568c3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.649824 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a admin admin] The token cache is being invalidate because project 29100ef4da6f41e7b5f4e767175044c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:51.650102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:51.650870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e08c9cc6-2528-4dc5-bb6d-1210bd18929a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:51.651358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:51.652465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1300/2600] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:51 2022] DELETE /identity/v3/projects/29100ef4da6f41e7b5f4e767175044c5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:51.658054 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed514b78-f14c-4648-a358-5fd327483cc3 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.658717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed514b78-f14c-4648-a358-5fd327483cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.659096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed514b78-f14c-4648-a358-5fd327483cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.678452 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ed514b78-f14c-4648-a358-5fd327483cc3 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:51.679674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ed514b78-f14c-4648-a358-5fd327483cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:51.700786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620af8ab-0e67-405f-a7c6-fa0dc27ff3fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.701444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620af8ab-0e67-405f-a7c6-fa0dc27ff3fa service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.701727 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620af8ab-0e67-405f-a7c6-fa0dc27ff3fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.702003 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620af8ab-0e67-405f-a7c6-fa0dc27ff3fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.703833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-620af8ab-0e67-405f-a7c6-fa0dc27ff3fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:51.755964 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1301/2601] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:51.758260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be32a80-6766-446e-8eae-2d5753676ffc None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.759078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be32a80-6766-446e-8eae-2d5753676ffc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.759362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be32a80-6766-446e-8eae-2d5753676ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.778097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620af8ab-0e67-405f-a7c6-fa0dc27ff3fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.778561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2be32a80-6766-446e-8eae-2d5753676ffc None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:51.779555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620af8ab-0e67-405f-a7c6-fa0dc27ff3fa service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.779779 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2be32a80-6766-446e-8eae-2d5753676ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:51.794564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1301/2602] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:51.798567 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1302/2603] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:51.802816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620af8ab-0e67-405f-a7c6-fa0dc27ff3fa service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.814839 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620af8ab-0e67-405f-a7c6-fa0dc27ff3fa service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.819475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae40e74-3932-40f3-9fe5-4e006dc5774e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.820168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae40e74-3932-40f3-9fe5-4e006dc5774e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.820457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae40e74-3932-40f3-9fe5-4e006dc5774e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.820816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae40e74-3932-40f3-9fe5-4e006dc5774e admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.822079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae40e74-3932-40f3-9fe5-4e006dc5774e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:51.822394 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae40e74-3932-40f3-9fe5-4e006dc5774e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.824005 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae40e74-3932-40f3-9fe5-4e006dc5774e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.839473 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1302/2604] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:44:51.840582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be32a80-6766-446e-8eae-2d5753676ffc None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.846153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:51.849968 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be32a80-6766-446e-8eae-2d5753676ffc None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.857119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85df7bd-633e-4d2e-9b37-01fd882cf118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.858418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85df7bd-633e-4d2e-9b37-01fd882cf118 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.858708 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85df7bd-633e-4d2e-9b37-01fd882cf118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.858991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85df7bd-633e-4d2e-9b37-01fd882cf118 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.859865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85df7bd-633e-4d2e-9b37-01fd882cf118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.861836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85df7bd-633e-4d2e-9b37-01fd882cf118 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:51.899392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1303/2605] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:51.903788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae40e74-3932-40f3-9fe5-4e006dc5774e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:51.913525 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae40e74-3932-40f3-9fe5-4e006dc5774e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:51.976732 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ba62b-3c75-4ba2-b403-88f15f990c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:51.978222 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ba62b-3c75-4ba2-b403-88f15f990c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:51.978590 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ba62b-3c75-4ba2-b403-88f15f990c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:51.978873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ba62b-3c75-4ba2-b403-88f15f990c0f admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:51.979579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ba62b-3c75-4ba2-b403-88f15f990c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:51.981542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ba62b-3c75-4ba2-b403-88f15f990c0f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.002568 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1303/2606] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:51 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:52.006855 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85df7bd-633e-4d2e-9b37-01fd882cf118 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:52.019463 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85df7bd-633e-4d2e-9b37-01fd882cf118 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:52.025228 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1b8ad-457b-441b-a5a1-d459c9cd2172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:52.026030 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1b8ad-457b-441b-a5a1-d459c9cd2172 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.026317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1b8ad-457b-441b-a5a1-d459c9cd2172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.026595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1b8ad-457b-441b-a5a1-d459c9cd2172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.027328 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1b8ad-457b-441b-a5a1-d459c9cd2172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:52.028956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1b8ad-457b-441b-a5a1-d459c9cd2172 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.040642 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1304/2607] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:52.044879 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ba62b-3c75-4ba2-b403-88f15f990c0f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:52.055812 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ba62b-3c75-4ba2-b403-88f15f990c0f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:52.060776 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37737de4-dd7f-48a3-8dcf-47d89e8d3a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:52.061453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737de4-dd7f-48a3-8dcf-47d89e8d3a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.061741 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737de4-dd7f-48a3-8dcf-47d89e8d3a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.062020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737de4-dd7f-48a3-8dcf-47d89e8d3a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.062755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37737de4-dd7f-48a3-8dcf-47d89e8d3a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:52.064378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37737de4-dd7f-48a3-8dcf-47d89e8d3a5f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.077000 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1304/2608] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:52.079961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1b8ad-457b-441b-a5a1-d459c9cd2172 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:52.094688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1b8ad-457b-441b-a5a1-d459c9cd2172 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:52.100375 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396ac1d-ecfd-4fdd-ac59-268a3a287c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:52.101349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396ac1d-ecfd-4fdd-ac59-268a3a287c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.101634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396ac1d-ecfd-4fdd-ac59-268a3a287c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.102294 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396ac1d-ecfd-4fdd-ac59-268a3a287c20 admin admin] PATH_INFO: `/v3/projects/1ed917e26b614159b90325dcec81e5d6/users/931ee65c126244e4a1fb43fa06b08334/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.118634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396ac1d-ecfd-4fdd-ac59-268a3a287c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed917e26b614159b90325dcec81e5d6, user_id=931ee65c126244e4a1fb43fa06b08334, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:52.121412 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396ac1d-ecfd-4fdd-ac59-268a3a287c20 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.135277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1305/2609] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:52 2022] PUT /identity/v3/projects/1ed917e26b614159b90325dcec81e5d6/users/931ee65c126244e4a1fb43fa06b08334/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:52.147010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15932-ec92-42bd-962c-1f52fd937cfd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.147262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15932-ec92-42bd-962c-1f52fd937cfd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.147549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff15932-ec92-42bd-962c-1f52fd937cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.174890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0ff15932-ec92-42bd-962c-1f52fd937cfd None None] MFA Rules not processed for user `931ee65c126244e4a1fb43fa06b08334`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:52.176105 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0ff15932-ec92-42bd-962c-1f52fd937cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:52.196539 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:52.241677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1305/2610] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:52.246302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396ac1d-ecfd-4fdd-ac59-268a3a287c20 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:52.315391 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396ac1d-ecfd-4fdd-ac59-268a3a287c20 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:52.320400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dee9e-0555-4102-a46b-2713f8e5e5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:52.321653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dee9e-0555-4102-a46b-2713f8e5e5ce admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.321936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dee9e-0555-4102-a46b-2713f8e5e5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.322215 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dee9e-0555-4102-a46b-2713f8e5e5ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.322913 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dee9e-0555-4102-a46b-2713f8e5e5ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:52.324826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dee9e-0555-4102-a46b-2713f8e5e5ce admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.350730 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1306/2611] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:52 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:52.354758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff15932-ec92-42bd-962c-1f52fd937cfd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:52.365428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff15932-ec92-42bd-962c-1f52fd937cfd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:52.424490 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cc8a7-c678-4304-baf3-e7e80a60b568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:52.425067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cc8a7-c678-4304-baf3-e7e80a60b568 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.425351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cc8a7-c678-4304-baf3-e7e80a60b568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.425629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cc8a7-c678-4304-baf3-e7e80a60b568 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.426327 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cc8a7-c678-4304-baf3-e7e80a60b568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:52.428242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29cc8a7-c678-4304-baf3-e7e80a60b568 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.449799 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1306/2612] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:52 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:52.453876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dee9e-0555-4102-a46b-2713f8e5e5ce admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:52.464835 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dee9e-0555-4102-a46b-2713f8e5e5ce admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:52.475372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec0955-ed3b-4584-a166-162ba4c5e20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:52.476045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec0955-ed3b-4584-a166-162ba4c5e20f admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.476333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec0955-ed3b-4584-a166-162ba4c5e20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.476624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec0955-ed3b-4584-a166-162ba4c5e20f admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.477941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec0955-ed3b-4584-a166-162ba4c5e20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:52.479523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec0955-ed3b-4584-a166-162ba4c5e20f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.491659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1307/2613] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:52.496971 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cc8a7-c678-4304-baf3-e7e80a60b568 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:52.510418 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cc8a7-c678-4304-baf3-e7e80a60b568 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:52.515097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962b6ef-0428-4026-9a68-56aec84bc1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:52.516155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962b6ef-0428-4026-9a68-56aec84bc1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.516501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962b6ef-0428-4026-9a68-56aec84bc1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.516874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962b6ef-0428-4026-9a68-56aec84bc1f4 admin admin] PATH_INFO: `/v3/projects/eadf1b0fbd584f2eacc5da4b43a57d9d/users/b65c8a176e9c4fb0aa2fc8741fe02e53/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.535110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962b6ef-0428-4026-9a68-56aec84bc1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadf1b0fbd584f2eacc5da4b43a57d9d, user_id=b65c8a176e9c4fb0aa2fc8741fe02e53, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:52.538045 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962b6ef-0428-4026-9a68-56aec84bc1f4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.552452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1307/2614] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:52 2022] PUT /identity/v3/projects/eadf1b0fbd584f2eacc5da4b43a57d9d/users/b65c8a176e9c4fb0aa2fc8741fe02e53/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:52.556976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec0955-ed3b-4584-a166-162ba4c5e20f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:52.566810 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec0955-ed3b-4584-a166-162ba4c5e20f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:52.628394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c67fe-e32f-4a12-b951-fdb390539b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:52.629176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c67fe-e32f-4a12-b951-fdb390539b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.629459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c67fe-e32f-4a12-b951-fdb390539b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.629732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c67fe-e32f-4a12-b951-fdb390539b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.630454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c67fe-e32f-4a12-b951-fdb390539b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:52.632027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c67fe-e32f-4a12-b951-fdb390539b3e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.642496 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1308/2615] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:52.646993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962b6ef-0428-4026-9a68-56aec84bc1f4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:52.658154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962b6ef-0428-4026-9a68-56aec84bc1f4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:52.664155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee2276-f113-48ba-b12c-f3e6907d6166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:52.665676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2276-f113-48ba-b12c-f3e6907d6166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.665963 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2276-f113-48ba-b12c-f3e6907d6166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.666237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2276-f113-48ba-b12c-f3e6907d6166 admin admin] PATH_INFO: `/v3/projects/eadf1b0fbd584f2eacc5da4b43a57d9d/users/b65c8a176e9c4fb0aa2fc8741fe02e53/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.668540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee2276-f113-48ba-b12c-f3e6907d6166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadf1b0fbd584f2eacc5da4b43a57d9d, user_id=b65c8a176e9c4fb0aa2fc8741fe02e53, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:52.671361 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee2276-f113-48ba-b12c-f3e6907d6166 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.683368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1308/2616] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:52 2022] PUT /identity/v3/projects/eadf1b0fbd584f2eacc5da4b43a57d9d/users/b65c8a176e9c4fb0aa2fc8741fe02e53/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:52.697156 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c4fe8-7569-452d-b203-db3ace6367df None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.697519 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c4fe8-7569-452d-b203-db3ace6367df None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.697927 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c4fe8-7569-452d-b203-db3ace6367df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.727798 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-151c4fe8-7569-452d-b203-db3ace6367df None None] MFA Rules not processed for user `b65c8a176e9c4fb0aa2fc8741fe02e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:52.729254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-151c4fe8-7569-452d-b203-db3ace6367df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:52.734348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:52.805188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1309/2617] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:52.820434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee2276-f113-48ba-b12c-f3e6907d6166 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:52.822293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1cee2276-f113-48ba-b12c-f3e6907d6166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:52.897523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee2276-f113-48ba-b12c-f3e6907d6166 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:52.901300 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653e244-58a4-4258-bddf-8c8f19c2bff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:52.901965 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653e244-58a4-4258-bddf-8c8f19c2bff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:52.902249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653e244-58a4-4258-bddf-8c8f19c2bff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:52.902528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653e244-58a4-4258-bddf-8c8f19c2bff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:52.933637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:52.967493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653e244-58a4-4258-bddf-8c8f19c2bff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:52.968976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653e244-58a4-4258-bddf-8c8f19c2bff9 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:52.978593 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1309/2618] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:53.832318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c4fe8-7569-452d-b203-db3ace6367df None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:53.833919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-151c4fe8-7569-452d-b203-db3ace6367df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:53.903836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c4fe8-7569-452d-b203-db3ace6367df None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:53.908392 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:53.909313 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:53.909623 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:53.909922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] PATH_INFO: `/v3/users/35a8cef5909c4436b931b850075d7bce` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:53.911187 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a8cef5909c4436b931b850075d7bce)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:53.913182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:53.959116 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a8cef5909c4436b931b850075d7bce'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:53.959761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a8cef5909c4436b931b850075d7bce'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:53.960430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a8cef5909c4436b931b850075d7bce'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:53.973715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a8cef5909c4436b931b850075d7bce'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:53.982778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a8cef5909c4436b931b850075d7bce'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:53.997612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1310/2619] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:53 2022] DELETE /identity/v3/users/35a8cef5909c4436b931b850075d7bce => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:54.002374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefaa2f-208e-456f-ab0c-5a981a2f80f9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:54.002858 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefaa2f-208e-456f-ab0c-5a981a2f80f9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:54.002960 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefaa2f-208e-456f-ab0c-5a981a2f80f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:54.022068 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-caefaa2f-208e-456f-ab0c-5a981a2f80f9 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:54.023290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-caefaa2f-208e-456f-ab0c-5a981a2f80f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:54.095627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1310/2620] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:54.105528 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:54.107068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:54.137017 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:54.172422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb217e-0b99-49db-8877-5abd2890c917 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:54.176125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fc715-e40d-4d10-859a-24f3deef60b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:54.176800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fc715-e40d-4d10-859a-24f3deef60b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:54.177085 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fc715-e40d-4d10-859a-24f3deef60b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:54.177361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fc715-e40d-4d10-859a-24f3deef60b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:54.187600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fc715-e40d-4d10-859a-24f3deef60b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:54.189104 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fc715-e40d-4d10-859a-24f3deef60b2 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:54.199545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1311/2621] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:54.507721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefaa2f-208e-456f-ab0c-5a981a2f80f9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:54.510259 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-caefaa2f-208e-456f-ab0c-5a981a2f80f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:54.522584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefaa2f-208e-456f-ab0c-5a981a2f80f9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:54.528175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:54.529144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:54.529428 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:54.529863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] PATH_INFO: `/v3/projects/37c9f8ab5350409d80bd4f06edb9a8cb` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:54.531381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c9f8ab5350409d80bd4f06edb9a8cb)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:54.533660 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:54.588453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c9f8ab5350409d80bd4f06edb9a8cb', 'request_id': 'req-1bc073e4-067e-4d02-b133-734242e95670'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:54.596479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c9f8ab5350409d80bd4f06edb9a8cb', 'request_id': 'req-1bc073e4-067e-4d02-b133-734242e95670'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:54.603947 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c9f8ab5350409d80bd4f06edb9a8cb', 'request_id': 'req-1bc073e4-067e-4d02-b133-734242e95670'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:54.619346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] The token cache is being invalidate because project 37c9f8ab5350409d80bd4f06edb9a8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:54.619346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:54.619346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:54.619346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1311/2622] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:54 2022] DELETE /identity/v3/projects/37c9f8ab5350409d80bd4f06edb9a8cb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:54.622516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fc715-e40d-4d10-859a-24f3deef60b2 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:54.633147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fc715-e40d-4d10-859a-24f3deef60b2 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:54.696949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910eca9-13eb-45bf-8738-ee7dead8cab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:54.697869 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910eca9-13eb-45bf-8738-ee7dead8cab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:54.698153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910eca9-13eb-45bf-8738-ee7dead8cab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:54.698429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910eca9-13eb-45bf-8738-ee7dead8cab3 admin admin] PATH_INFO: `/v3/users/66b02738b4534ba08c370f3056609d5d` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:54.699677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910eca9-13eb-45bf-8738-ee7dead8cab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b02738b4534ba08c370f3056609d5d)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:54.701736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910eca9-13eb-45bf-8738-ee7dead8cab3 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:54.753003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e910eca9-13eb-45bf-8738-ee7dead8cab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b02738b4534ba08c370f3056609d5d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:54.753577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e910eca9-13eb-45bf-8738-ee7dead8cab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b02738b4534ba08c370f3056609d5d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:54.754176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e910eca9-13eb-45bf-8738-ee7dead8cab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b02738b4534ba08c370f3056609d5d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:54.767578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e910eca9-13eb-45bf-8738-ee7dead8cab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b02738b4534ba08c370f3056609d5d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:54.776675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e910eca9-13eb-45bf-8738-ee7dead8cab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b02738b4534ba08c370f3056609d5d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:54.793033 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1312/2623] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:54 2022] DELETE /identity/v3/users/66b02738b4534ba08c370f3056609d5d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:55.099252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.100701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:55.115473 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc073e4-067e-4d02-b133-734242e95670 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:55.166460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:55.176194 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58faeb2e-c88e-4a48-a7f3-0174ec40a185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:55.177130 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faeb2e-c88e-4a48-a7f3-0174ec40a185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.177591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faeb2e-c88e-4a48-a7f3-0174ec40a185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.177869 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faeb2e-c88e-4a48-a7f3-0174ec40a185 admin admin] PATH_INFO: `/v3/projects/b76777e79e184406a021db2e23557b62` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.179046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58faeb2e-c88e-4a48-a7f3-0174ec40a185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76777e79e184406a021db2e23557b62)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:55.181019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58faeb2e-c88e-4a48-a7f3-0174ec40a185 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:55.229488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-58faeb2e-c88e-4a48-a7f3-0174ec40a185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76777e79e184406a021db2e23557b62', 'request_id': 'req-58faeb2e-c88e-4a48-a7f3-0174ec40a185'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:55.238650 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-58faeb2e-c88e-4a48-a7f3-0174ec40a185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76777e79e184406a021db2e23557b62', 'request_id': 'req-58faeb2e-c88e-4a48-a7f3-0174ec40a185'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:55.250123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-58faeb2e-c88e-4a48-a7f3-0174ec40a185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76777e79e184406a021db2e23557b62', 'request_id': 'req-58faeb2e-c88e-4a48-a7f3-0174ec40a185'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:55.263275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-58faeb2e-c88e-4a48-a7f3-0174ec40a185 admin admin] The token cache is being invalidate because project b76777e79e184406a021db2e23557b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:55.263597 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-58faeb2e-c88e-4a48-a7f3-0174ec40a185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:55.264275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-58faeb2e-c88e-4a48-a7f3-0174ec40a185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:55.265952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1312/2624] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:55 2022] DELETE /identity/v3/projects/b76777e79e184406a021db2e23557b62 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:55.271165 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cde1be-29e0-4ba2-983f-03d72615de9c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.271710 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cde1be-29e0-4ba2-983f-03d72615de9c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.271710 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cde1be-29e0-4ba2-983f-03d72615de9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.291854 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f2cde1be-29e0-4ba2-983f-03d72615de9c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:55.293194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f2cde1be-29e0-4ba2-983f-03d72615de9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:55.335740 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:55.361911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1313/2625] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:55.370481 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e5622-c12a-40a6-b53c-579915038597 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.370771 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e5622-c12a-40a6-b53c-579915038597 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.371050 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e5622-c12a-40a6-b53c-579915038597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.390055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e70e5622-c12a-40a6-b53c-579915038597 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:55.391282 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e70e5622-c12a-40a6-b53c-579915038597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:55.400526 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1313/2626] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:55.404675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cde1be-29e0-4ba2-983f-03d72615de9c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.415311 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cde1be-29e0-4ba2-983f-03d72615de9c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:55.420136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd5197-fa55-413e-b072-a0f93da7331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:55.420833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd5197-fa55-413e-b072-a0f93da7331b admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.421124 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd5197-fa55-413e-b072-a0f93da7331b admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.421406 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd5197-fa55-413e-b072-a0f93da7331b admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.422133 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd5197-fa55-413e-b072-a0f93da7331b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:55.422446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd5197-fa55-413e-b072-a0f93da7331b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:55.424044 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd5197-fa55-413e-b072-a0f93da7331b admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:55.435818 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1314/2627] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:55.440059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e5622-c12a-40a6-b53c-579915038597 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.449964 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e5622-c12a-40a6-b53c-579915038597 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:55.454733 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8b55d-39cb-4280-b82f-9c28626fedea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:55.455492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8b55d-39cb-4280-b82f-9c28626fedea admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.455827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8b55d-39cb-4280-b82f-9c28626fedea admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.456155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8b55d-39cb-4280-b82f-9c28626fedea admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.456934 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8b55d-39cb-4280-b82f-9c28626fedea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:55.459110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8b55d-39cb-4280-b82f-9c28626fedea admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:55.487942 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1314/2628] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:55 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:55.492015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd5197-fa55-413e-b072-a0f93da7331b admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.503005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd5197-fa55-413e-b072-a0f93da7331b admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:55.533043 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8b55d-39cb-4280-b82f-9c28626fedea admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.535448 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8ff8b55d-39cb-4280-b82f-9c28626fedea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:55.566385 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190be24-15a7-42ce-a0cd-dbf9dd15cc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:55.567064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190be24-15a7-42ce-a0cd-dbf9dd15cc61 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.567469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190be24-15a7-42ce-a0cd-dbf9dd15cc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.567749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190be24-15a7-42ce-a0cd-dbf9dd15cc61 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.568444 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190be24-15a7-42ce-a0cd-dbf9dd15cc61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:55.570407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1190be24-15a7-42ce-a0cd-dbf9dd15cc61 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:55.593433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1315/2629] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:55 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:55.594742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190be24-15a7-42ce-a0cd-dbf9dd15cc61 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.601162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8b55d-39cb-4280-b82f-9c28626fedea admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:55.604757 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190be24-15a7-42ce-a0cd-dbf9dd15cc61 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:55.606875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe479-5e35-4b39-8459-397c19ea25f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:55.608391 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe479-5e35-4b39-8459-397c19ea25f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.608676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe479-5e35-4b39-8459-397c19ea25f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.609007 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe479-5e35-4b39-8459-397c19ea25f6 admin admin] PATH_INFO: `/v3/users/931ee65c126244e4a1fb43fa06b08334` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.610244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa50028-7f20-4e8a-b561-c89f397276a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:55.610444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe479-5e35-4b39-8459-397c19ea25f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=931ee65c126244e4a1fb43fa06b08334)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:55.610944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa50028-7f20-4e8a-b561-c89f397276a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.611657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa50028-7f20-4e8a-b561-c89f397276a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.611950 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa50028-7f20-4e8a-b561-c89f397276a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.612631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe479-5e35-4b39-8459-397c19ea25f6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:55.613254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa50028-7f20-4e8a-b561-c89f397276a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:55.614833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa50028-7f20-4e8a-b561-c89f397276a8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:55.625330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1316/2630] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:55.629216 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa50028-7f20-4e8a-b561-c89f397276a8 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.639090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa50028-7f20-4e8a-b561-c89f397276a8 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:55.645919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffd1c2-4d82-4b88-b78d-ea528baebf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:55.646884 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffd1c2-4d82-4b88-b78d-ea528baebf2c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.647233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffd1c2-4d82-4b88-b78d-ea528baebf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.647600 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffd1c2-4d82-4b88-b78d-ea528baebf2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.649248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffd1c2-4d82-4b88-b78d-ea528baebf2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:55.651238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffd1c2-4d82-4b88-b78d-ea528baebf2c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:55.662733 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1317/2631] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:55.668177 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffd1c2-4d82-4b88-b78d-ea528baebf2c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.670046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-151fe479-5e35-4b39-8459-397c19ea25f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931ee65c126244e4a1fb43fa06b08334'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:55.670729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-151fe479-5e35-4b39-8459-397c19ea25f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931ee65c126244e4a1fb43fa06b08334'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:55.671354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-151fe479-5e35-4b39-8459-397c19ea25f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931ee65c126244e4a1fb43fa06b08334'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:55.679168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:55.682373 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffd1c2-4d82-4b88-b78d-ea528baebf2c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:55.686982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-151fe479-5e35-4b39-8459-397c19ea25f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931ee65c126244e4a1fb43fa06b08334'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:55.689915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca55f3-d4b5-4755-a19c-81ccf9cfccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:55.691258 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca55f3-d4b5-4755-a19c-81ccf9cfccd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.691675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca55f3-d4b5-4755-a19c-81ccf9cfccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.692086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca55f3-d4b5-4755-a19c-81ccf9cfccd7 admin admin] PATH_INFO: `/v3/projects/2b4f29e56980423fb088d07757232de3/users/62b2ac56b2d54eadbf35faa61c0a6521/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.697816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-151fe479-5e35-4b39-8459-397c19ea25f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931ee65c126244e4a1fb43fa06b08334'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:55.713031 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca55f3-d4b5-4755-a19c-81ccf9cfccd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4f29e56980423fb088d07757232de3, user_id=62b2ac56b2d54eadbf35faa61c0a6521, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:55.717111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca55f3-d4b5-4755-a19c-81ccf9cfccd7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:55.721566 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1315/2632] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:55 2022] DELETE /identity/v3/users/931ee65c126244e4a1fb43fa06b08334 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:55.726782 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af479f-3989-4698-8230-c9b7b9b2180c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.727827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af479f-3989-4698-8230-c9b7b9b2180c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.728068 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af479f-3989-4698-8230-c9b7b9b2180c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.733868 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1318/2633] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:55 2022] PUT /identity/v3/projects/2b4f29e56980423fb088d07757232de3/users/62b2ac56b2d54eadbf35faa61c0a6521/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:55.744766 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7977b87-1761-40d1-a967-c17fd8a57d91 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.745053 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7977b87-1761-40d1-a967-c17fd8a57d91 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.745338 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7977b87-1761-40d1-a967-c17fd8a57d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.747930 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-91af479f-3989-4698-8230-c9b7b9b2180c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:55.749187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-91af479f-3989-4698-8230-c9b7b9b2180c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:55.773930 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e7977b87-1761-40d1-a967-c17fd8a57d91 None None] MFA Rules not processed for user `62b2ac56b2d54eadbf35faa61c0a6521`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:55.775158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e7977b87-1761-40d1-a967-c17fd8a57d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:55.812588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1316/2634] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:55.822401 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af479f-3989-4698-8230-c9b7b9b2180c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.826371 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-91af479f-3989-4698-8230-c9b7b9b2180c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:55.845108 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1319/2635] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:44:55.849700 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7977b87-1761-40d1-a967-c17fd8a57d91 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.852517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e7977b87-1761-40d1-a967-c17fd8a57d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:55.870559 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:55.878091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7977b87-1761-40d1-a967-c17fd8a57d91 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:55.883172 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85944d-4b4a-42e8-9afe-bbb33e5586a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:55.883819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85944d-4b4a-42e8-9afe-bbb33e5586a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.884220 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85944d-4b4a-42e8-9afe-bbb33e5586a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.885479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85944d-4b4a-42e8-9afe-bbb33e5586a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:55.886562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85944d-4b4a-42e8-9afe-bbb33e5586a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:55.888663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85944d-4b4a-42e8-9afe-bbb33e5586a9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:55.917161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af479f-3989-4698-8230-c9b7b9b2180c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:55.922114 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1320/2636] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:55 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:55.922937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85944d-4b4a-42e8-9afe-bbb33e5586a9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:55.972831 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ea7ad-a118-47f6-bd31-d02708f40fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:55.973494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ea7ad-a118-47f6-bd31-d02708f40fff service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:55.973778 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ea7ad-a118-47f6-bd31-d02708f40fff service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:55.974058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ea7ad-a118-47f6-bd31-d02708f40fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.000943 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85944d-4b4a-42e8-9afe-bbb33e5586a9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:56.006543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad52903-883c-4580-90f0-e43d8b6c894a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:56.007323 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad52903-883c-4580-90f0-e43d8b6c894a admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.007757 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad52903-883c-4580-90f0-e43d8b6c894a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.008129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad52903-883c-4580-90f0-e43d8b6c894a admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.009073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad52903-883c-4580-90f0-e43d8b6c894a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.011257 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad52903-883c-4580-90f0-e43d8b6c894a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.027251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:56.037201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1321/2637] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:55 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:44:56.041941 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad52903-883c-4580-90f0-e43d8b6c894a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:56.053574 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad52903-883c-4580-90f0-e43d8b6c894a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:56.053976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ea7ad-a118-47f6-bd31-d02708f40fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.057097 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ea7ad-a118-47f6-bd31-d02708f40fff service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.062020 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756d74c-d289-4ca9-836e-653d42d4f0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:56.062694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d74c-d289-4ca9-836e-653d42d4f0ad admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.062694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d74c-d289-4ca9-836e-653d42d4f0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.066203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756d74c-d289-4ca9-836e-653d42d4f0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.066203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756d74c-d289-4ca9-836e-653d42d4f0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.071279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1317/2638] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:56.074246 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756d74c-d289-4ca9-836e-653d42d4f0ad admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.088748 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1322/2639] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:44:56.091697 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ea7ad-a118-47f6-bd31-d02708f40fff service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:56.104010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ea7ad-a118-47f6-bd31-d02708f40fff service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:56.109410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3160e-aa20-46c4-bc6e-c66d47979686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:56.110561 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3160e-aa20-46c4-bc6e-c66d47979686 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.110912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3160e-aa20-46c4-bc6e-c66d47979686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.111261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3160e-aa20-46c4-bc6e-c66d47979686 admin admin] PATH_INFO: `/v3/projects/0e8b06ded828450cb0dc560151626589/users/f05ffe9ed4204bb68ad95af9c4f8ea93/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.129652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3160e-aa20-46c4-bc6e-c66d47979686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8b06ded828450cb0dc560151626589, user_id=f05ffe9ed4204bb68ad95af9c4f8ea93, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.132421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3160e-aa20-46c4-bc6e-c66d47979686 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.160645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1318/2640] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:56 2022] PUT /identity/v3/projects/0e8b06ded828450cb0dc560151626589/users/f05ffe9ed4204bb68ad95af9c4f8ea93/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:44:56.165012 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756d74c-d289-4ca9-836e-653d42d4f0ad admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:56.176301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756d74c-d289-4ca9-836e-653d42d4f0ad admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:56.269367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3916d-f633-4a3e-b502-d13a23e8b426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:56.270324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3916d-f633-4a3e-b502-d13a23e8b426 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.270707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3916d-f633-4a3e-b502-d13a23e8b426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.271163 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3916d-f633-4a3e-b502-d13a23e8b426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.272484 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3916d-f633-4a3e-b502-d13a23e8b426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.275085 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3916d-f633-4a3e-b502-d13a23e8b426 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.293240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1323/2641] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:56.293658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3160e-aa20-46c4-bc6e-c66d47979686 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:56.307168 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3160e-aa20-46c4-bc6e-c66d47979686 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:56.317167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c4c10-ec78-4c3f-a12d-43d82fa7bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:56.318381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c4c10-ec78-4c3f-a12d-43d82fa7bbd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.319872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c4c10-ec78-4c3f-a12d-43d82fa7bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.320322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c4c10-ec78-4c3f-a12d-43d82fa7bbd4 admin admin] PATH_INFO: `/v3/projects/0e8b06ded828450cb0dc560151626589/users/f05ffe9ed4204bb68ad95af9c4f8ea93/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.323023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c4c10-ec78-4c3f-a12d-43d82fa7bbd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8b06ded828450cb0dc560151626589, user_id=f05ffe9ed4204bb68ad95af9c4f8ea93, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.325969 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c4c10-ec78-4c3f-a12d-43d82fa7bbd4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.341007 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1319/2642] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:56 2022] PUT /identity/v3/projects/0e8b06ded828450cb0dc560151626589/users/f05ffe9ed4204bb68ad95af9c4f8ea93/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:56.353264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c78453-c127-4d77-87a8-87dd11cf4c53 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.353694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c78453-c127-4d77-87a8-87dd11cf4c53 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.354046 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c78453-c127-4d77-87a8-87dd11cf4c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.386315 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-43c78453-c127-4d77-87a8-87dd11cf4c53 None None] MFA Rules not processed for user `f05ffe9ed4204bb68ad95af9c4f8ea93`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:56.387972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-43c78453-c127-4d77-87a8-87dd11cf4c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:56.422339 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c4c10-ec78-4c3f-a12d-43d82fa7bbd4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:56.425343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-124c4c10-ec78-4c3f-a12d-43d82fa7bbd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:56.479604 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:56.519967 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1324/2643] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:56.527416 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c4c10-ec78-4c3f-a12d-43d82fa7bbd4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:56.534826 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:56.535075 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c78453-c127-4d77-87a8-87dd11cf4c53 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:56.535768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.536158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.536324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] PATH_INFO: `/v3/projects/1ed917e26b614159b90325dcec81e5d6` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.536483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-43c78453-c127-4d77-87a8-87dd11cf4c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:56.538645 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed917e26b614159b90325dcec81e5d6)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.541290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.605232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed917e26b614159b90325dcec81e5d6', 'request_id': 'req-902586d4-4a69-496d-b07d-fe9a37c9a40d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.614327 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed917e26b614159b90325dcec81e5d6', 'request_id': 'req-902586d4-4a69-496d-b07d-fe9a37c9a40d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.619727 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c78453-c127-4d77-87a8-87dd11cf4c53 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:56.627197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed917e26b614159b90325dcec81e5d6', 'request_id': 'req-902586d4-4a69-496d-b07d-fe9a37c9a40d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.641837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] The token cache is being invalidate because project 1ed917e26b614159b90325dcec81e5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:56.642218 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.643184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.645840 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1320/2644] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:56 2022] DELETE /identity/v3/projects/1ed917e26b614159b90325dcec81e5d6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:56.651463 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:56.654167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:56.691947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5449c7d-8d93-4ed0-a728-842c54df42d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:56.692626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449c7d-8d93-4ed0-a728-842c54df42d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.692923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449c7d-8d93-4ed0-a728-842c54df42d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.693466 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449c7d-8d93-4ed0-a728-842c54df42d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.695369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a5449c7d-8d93-4ed0-a728-842c54df42d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:56.746869 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:56.785314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5449c7d-8d93-4ed0-a728-842c54df42d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.787657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5449c7d-8d93-4ed0-a728-842c54df42d0 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.789392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902586d4-4a69-496d-b07d-fe9a37c9a40d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:56.797477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:56.798446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:56.798634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:56.798894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] PATH_INFO: `/v3/users/b65c8a176e9c4fb0aa2fc8741fe02e53` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:56.800164 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65c8a176e9c4fb0aa2fc8741fe02e53)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:56.802399 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1325/2645] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:56.802527 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:56.889348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65c8a176e9c4fb0aa2fc8741fe02e53'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.890229 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65c8a176e9c4fb0aa2fc8741fe02e53'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.890976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65c8a176e9c4fb0aa2fc8741fe02e53'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.910459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65c8a176e9c4fb0aa2fc8741fe02e53'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.920775 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65c8a176e9c4fb0aa2fc8741fe02e53'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:56.942629 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1321/2646] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:56 2022] DELETE /identity/v3/users/b65c8a176e9c4fb0aa2fc8741fe02e53 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:56.952522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5449c7d-8d93-4ed0-a728-842c54df42d0 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:56.954001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a5449c7d-8d93-4ed0-a728-842c54df42d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:56.966699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5449c7d-8d93-4ed0-a728-842c54df42d0 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.027092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:57.032455 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b54797-89ed-4b4b-a082-f4c3555887fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.033261 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b54797-89ed-4b4b-a082-f4c3555887fa service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.033548 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b54797-89ed-4b4b-a082-f4c3555887fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.033826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b54797-89ed-4b4b-a082-f4c3555887fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.035756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f1b54797-89ed-4b4b-a082-f4c3555887fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:57.141466 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b54797-89ed-4b4b-a082-f4c3555887fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.143118 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b54797-89ed-4b4b-a082-f4c3555887fa service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.155082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1326/2647] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:57.280238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.282063 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:57.373713 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77b3e1-a0c4-476b-b22a-04f7ad112997 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.378651 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.379646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.380032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.380573 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231 admin admin] PATH_INFO: `/v3/projects/eadf1b0fbd584f2eacc5da4b43a57d9d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.382031 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadf1b0fbd584f2eacc5da4b43a57d9d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.384825 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.447999 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadf1b0fbd584f2eacc5da4b43a57d9d', 'request_id': 'req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:57.452510 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:57.459171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadf1b0fbd584f2eacc5da4b43a57d9d', 'request_id': 'req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:57.466677 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadf1b0fbd584f2eacc5da4b43a57d9d', 'request_id': 'req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:57.479277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231 admin admin] The token cache is being invalidate because project eadf1b0fbd584f2eacc5da4b43a57d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:44:57.479646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:57.480350 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-096a38a0-f32f-4a7f-9bd1-a61e8d3ca231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:57.482130 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1322/2648] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:44:57 2022] DELETE /identity/v3/projects/eadf1b0fbd584f2eacc5da4b43a57d9d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:57.487693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb0ee0-f388-4c4a-a466-ece1a4d431eb None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.488160 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb0ee0-f388-4c4a-a466-ece1a4d431eb None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.488276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb0ee0-f388-4c4a-a466-ece1a4d431eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.507252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5aeb0ee0-f388-4c4a-a466-ece1a4d431eb None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:57.508507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5aeb0ee0-f388-4c4a-a466-ece1a4d431eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:57.572389 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1327/2649] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:57.583217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757e564-aaf7-4761-a3b9-ce8e8d08d278 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.583599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757e564-aaf7-4761-a3b9-ce8e8d08d278 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.583951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757e564-aaf7-4761-a3b9-ce8e8d08d278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.603352 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e757e564-aaf7-4761-a3b9-ce8e8d08d278 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:57.604563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e757e564-aaf7-4761-a3b9-ce8e8d08d278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:57.612705 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1323/2650] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:57.616936 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb0ee0-f388-4c4a-a466-ece1a4d431eb None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.627119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb0ee0-f388-4c4a-a466-ece1a4d431eb None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.631913 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c152e50-611c-41f8-a53c-151e5fdf95ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.632602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c152e50-611c-41f8-a53c-151e5fdf95ff admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.632922 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c152e50-611c-41f8-a53c-151e5fdf95ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.633250 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c152e50-611c-41f8-a53c-151e5fdf95ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.633958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c152e50-611c-41f8-a53c-151e5fdf95ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:44:57.634269 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c152e50-611c-41f8-a53c-151e5fdf95ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.635860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c152e50-611c-41f8-a53c-151e5fdf95ff admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.647717 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1328/2651] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:44:57.652510 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757e564-aaf7-4761-a3b9-ce8e8d08d278 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.661636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757e564-aaf7-4761-a3b9-ce8e8d08d278 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.666940 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd68253-eeb0-4106-9ca8-04fead5c24b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.667588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd68253-eeb0-4106-9ca8-04fead5c24b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.667873 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd68253-eeb0-4106-9ca8-04fead5c24b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.668154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd68253-eeb0-4106-9ca8-04fead5c24b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.668881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd68253-eeb0-4106-9ca8-04fead5c24b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.670784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd68253-eeb0-4106-9ca8-04fead5c24b0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.695605 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1324/2652] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:44:57 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:57.700592 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c152e50-611c-41f8-a53c-151e5fdf95ff admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.710689 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c152e50-611c-41f8-a53c-151e5fdf95ff admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.768894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa181-b4d0-486e-8ba2-66b5fee6487e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.769571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa181-b4d0-486e-8ba2-66b5fee6487e admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.769909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa181-b4d0-486e-8ba2-66b5fee6487e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.770171 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa181-b4d0-486e-8ba2-66b5fee6487e admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.770871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aa181-b4d0-486e-8ba2-66b5fee6487e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.772803 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aa181-b4d0-486e-8ba2-66b5fee6487e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.794018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1329/2653] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:44:57 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:44:57.798260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd68253-eeb0-4106-9ca8-04fead5c24b0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.808755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd68253-eeb0-4106-9ca8-04fead5c24b0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.813454 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187474e-e0e9-40d8-b842-ceee41bf3de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.814153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187474e-e0e9-40d8-b842-ceee41bf3de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.814441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187474e-e0e9-40d8-b842-ceee41bf3de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.814719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187474e-e0e9-40d8-b842-ceee41bf3de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.815483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187474e-e0e9-40d8-b842-ceee41bf3de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.817140 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187474e-e0e9-40d8-b842-ceee41bf3de4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.827701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1325/2654] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:57.831582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa181-b4d0-486e-8ba2-66b5fee6487e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.842192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa181-b4d0-486e-8ba2-66b5fee6487e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.846851 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c5156-c90e-4a86-9363-73bb4477404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.847505 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c5156-c90e-4a86-9363-73bb4477404c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.847794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c5156-c90e-4a86-9363-73bb4477404c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.848076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c5156-c90e-4a86-9363-73bb4477404c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.848841 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c5156-c90e-4a86-9363-73bb4477404c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.850462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c5156-c90e-4a86-9363-73bb4477404c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.861756 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1330/2655] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:44:57.865706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187474e-e0e9-40d8-b842-ceee41bf3de4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:57.875943 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187474e-e0e9-40d8-b842-ceee41bf3de4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:57.880690 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69fed8-5150-4209-9db3-c53c1e577715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:57.881552 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69fed8-5150-4209-9db3-c53c1e577715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.881835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69fed8-5150-4209-9db3-c53c1e577715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.882110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69fed8-5150-4209-9db3-c53c1e577715 admin admin] PATH_INFO: `/v3/projects/c5545fd5c02a4d909ad6a504e075adad/users/5ccfad816b3945be917d5aef96e008cd/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.899385 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69fed8-5150-4209-9db3-c53c1e577715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5545fd5c02a4d909ad6a504e075adad, user_id=5ccfad816b3945be917d5aef96e008cd, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:57.902084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69fed8-5150-4209-9db3-c53c1e577715 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:57.915560 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1326/2656] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:44:57 2022] PUT /identity/v3/projects/c5545fd5c02a4d909ad6a504e075adad/users/5ccfad816b3945be917d5aef96e008cd/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:57.925676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c602cf-1582-491f-aae2-edc2652a6dfd None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:57.925971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c602cf-1582-491f-aae2-edc2652a6dfd None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:57.926252 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c602cf-1582-491f-aae2-edc2652a6dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:57.944629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:57.955256 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-83c602cf-1582-491f-aae2-edc2652a6dfd None None] MFA Rules not processed for user `5ccfad816b3945be917d5aef96e008cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:57.956490 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-83c602cf-1582-491f-aae2-edc2652a6dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:58.021570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1331/2657] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:58.033213 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69fed8-5150-4209-9db3-c53c1e577715 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:58.034900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1f69fed8-5150-4209-9db3-c53c1e577715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:58.092484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69fed8-5150-4209-9db3-c53c1e577715 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:58.096233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebdcdc-24a7-4fc9-be5b-6af18a12832d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:58.096986 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebdcdc-24a7-4fc9-be5b-6af18a12832d service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:58.097276 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebdcdc-24a7-4fc9-be5b-6af18a12832d service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:58.097556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebdcdc-24a7-4fc9-be5b-6af18a12832d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:58.106323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebdcdc-24a7-4fc9-be5b-6af18a12832d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:58.107768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebdcdc-24a7-4fc9-be5b-6af18a12832d service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:58.116407 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1327/2658] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:44:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:59.767812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c602cf-1582-491f-aae2-edc2652a6dfd None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:59.769546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-83c602cf-1582-491f-aae2-edc2652a6dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:59.844820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c602cf-1582-491f-aae2-edc2652a6dfd None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:59.850230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:59.851305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:59.851595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:59.851904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] PATH_INFO: `/v3/users/62b2ac56b2d54eadbf35faa61c0a6521` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:59.853188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b2ac56b2d54eadbf35faa61c0a6521)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:59.855113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:59.910724 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b2ac56b2d54eadbf35faa61c0a6521'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:59.911384 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b2ac56b2d54eadbf35faa61c0a6521'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:59.912045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b2ac56b2d54eadbf35faa61c0a6521'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:59.925598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b2ac56b2d54eadbf35faa61c0a6521'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:59.933319 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b2ac56b2d54eadbf35faa61c0a6521'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:44:59.946624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1332/2659] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:44:59 2022] DELETE /identity/v3/users/62b2ac56b2d54eadbf35faa61c0a6521 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:44:59.951107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69d39e-46a0-4f5b-8d3a-68f1d7005710 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:59.951585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69d39e-46a0-4f5b-8d3a-68f1d7005710 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:59.951700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69d39e-46a0-4f5b-8d3a-68f1d7005710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:59.970545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4f69d39e-46a0-4f5b-8d3a-68f1d7005710 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:59.971758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4f69d39e-46a0-4f5b-8d3a-68f1d7005710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:00.030312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1328/2660] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:00.039791 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:00.041279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:00.062076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:00.105916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae76f74-02c1-4f38-9fe6-509bbeed2de5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:00.109693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aebb7c-bae1-41d8-a4c0-004a923f91f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:00.110348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aebb7c-bae1-41d8-a4c0-004a923f91f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:00.110637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aebb7c-bae1-41d8-a4c0-004a923f91f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:00.110923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aebb7c-bae1-41d8-a4c0-004a923f91f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:00.120906 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aebb7c-bae1-41d8-a4c0-004a923f91f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:00.122340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aebb7c-bae1-41d8-a4c0-004a923f91f1 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:00.131973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1333/2661] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:00.411488 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69d39e-46a0-4f5b-8d3a-68f1d7005710 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:00.413145 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4f69d39e-46a0-4f5b-8d3a-68f1d7005710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:00.420655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aebb7c-bae1-41d8-a4c0-004a923f91f1 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:00.422351 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-29aebb7c-bae1-41d8-a4c0-004a923f91f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:00.426426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69d39e-46a0-4f5b-8d3a-68f1d7005710 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:00.432337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:00.432848 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:00.433250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:00.433564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] PATH_INFO: `/v3/projects/2b4f29e56980423fb088d07757232de3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:00.434817 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4f29e56980423fb088d07757232de3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:00.436801 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:00.436956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aebb7c-bae1-41d8-a4c0-004a923f91f1 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:00.442055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa44ec-d791-485b-a05b-4db0292702d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:00.442986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa44ec-d791-485b-a05b-4db0292702d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:00.443213 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa44ec-d791-485b-a05b-4db0292702d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:00.443495 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa44ec-d791-485b-a05b-4db0292702d1 admin admin] PATH_INFO: `/v3/users/0b6fc288187c46729f812b634f5179cc` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:00.444783 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa44ec-d791-485b-a05b-4db0292702d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6fc288187c46729f812b634f5179cc)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:00.446985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa44ec-d791-485b-a05b-4db0292702d1 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:00.459108 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:00.491765 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4f29e56980423fb088d07757232de3', 'request_id': 'req-87d5e244-ee36-4014-8ef8-ca74cf569210'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.495993 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-58aa44ec-d791-485b-a05b-4db0292702d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6fc288187c46729f812b634f5179cc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.496693 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-58aa44ec-d791-485b-a05b-4db0292702d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6fc288187c46729f812b634f5179cc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.497332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-58aa44ec-d791-485b-a05b-4db0292702d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6fc288187c46729f812b634f5179cc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.500835 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4f29e56980423fb088d07757232de3', 'request_id': 'req-87d5e244-ee36-4014-8ef8-ca74cf569210'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.507781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4f29e56980423fb088d07757232de3', 'request_id': 'req-87d5e244-ee36-4014-8ef8-ca74cf569210'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.510380 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-58aa44ec-d791-485b-a05b-4db0292702d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6fc288187c46729f812b634f5179cc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.517752 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-58aa44ec-d791-485b-a05b-4db0292702d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6fc288187c46729f812b634f5179cc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.519920 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] The token cache is being invalidate because project 2b4f29e56980423fb088d07757232de3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:00.520257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.521115 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.522917 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1329/2662] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:00 2022] DELETE /identity/v3/projects/2b4f29e56980423fb088d07757232de3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:00.528041 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:00.529665 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:00.533492 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1334/2663] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:00 2022] DELETE /identity/v3/users/0b6fc288187c46729f812b634f5179cc => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:00.538182 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc534c-c754-4b95-81ef-c31569810580 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:00.538572 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc534c-c754-4b95-81ef-c31569810580 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:00.538904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc534c-c754-4b95-81ef-c31569810580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:00.558247 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-e8bc534c-c754-4b95-81ef-c31569810580 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:00.559458 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e8bc534c-c754-4b95-81ef-c31569810580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:00.597214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5e244-ee36-4014-8ef8-ca74cf569210 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:00.624857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1335/2664] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:00.634573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc534c-c754-4b95-81ef-c31569810580 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:00.636024 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e8bc534c-c754-4b95-81ef-c31569810580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:00.656344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:00.657308 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:00.657595 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:00.657874 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] PATH_INFO: `/v3/users/f05ffe9ed4204bb68ad95af9c4f8ea93` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:00.659154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05ffe9ed4204bb68ad95af9c4f8ea93)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:00.661193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:00.673613 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:00.704472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc534c-c754-4b95-81ef-c31569810580 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:00.708646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420e657-bdec-4f8f-89ae-df65e0a0a592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:00.709333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e657-bdec-4f8f-89ae-df65e0a0a592 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:00.709614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e657-bdec-4f8f-89ae-df65e0a0a592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:00.709888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420e657-bdec-4f8f-89ae-df65e0a0a592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:00.714451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05ffe9ed4204bb68ad95af9c4f8ea93'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.715134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05ffe9ed4204bb68ad95af9c4f8ea93'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.715844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05ffe9ed4204bb68ad95af9c4f8ea93'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.720091 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420e657-bdec-4f8f-89ae-df65e0a0a592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:00.721574 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420e657-bdec-4f8f-89ae-df65e0a0a592 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:00.721802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:00.732443 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1336/2665] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:45:00.732643 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05ffe9ed4204bb68ad95af9c4f8ea93'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.740475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05ffe9ed4204bb68ad95af9c4f8ea93'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:00.754125 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1330/2666] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:00 2022] DELETE /identity/v3/users/f05ffe9ed4204bb68ad95af9c4f8ea93 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:01.120607 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420e657-bdec-4f8f-89ae-df65e0a0a592 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.122853 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c420e657-bdec-4f8f-89ae-df65e0a0a592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:01.136924 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420e657-bdec-4f8f-89ae-df65e0a0a592 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.169201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.170582 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:01.225741 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c823d-c2c5-40aa-8097-279cf95a80e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.227396 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c823d-c2c5-40aa-8097-279cf95a80e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.227688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c823d-c2c5-40aa-8097-279cf95a80e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.227970 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c823d-c2c5-40aa-8097-279cf95a80e3 admin admin] PATH_INFO: `/v3/projects/a3d2bb70207041388d27e1b17cbaa8bb` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.229784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c823d-c2c5-40aa-8097-279cf95a80e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d2bb70207041388d27e1b17cbaa8bb)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.232707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c823d-c2c5-40aa-8097-279cf95a80e3 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.263895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccb69b-3702-4867-aadc-8fffa9837f08 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.269311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bceb2aa-0ceb-4335-b20d-abee593858ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.270269 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceb2aa-0ceb-4335-b20d-abee593858ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.270631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceb2aa-0ceb-4335-b20d-abee593858ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.270976 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceb2aa-0ceb-4335-b20d-abee593858ac admin admin] PATH_INFO: `/v3/projects/0e8b06ded828450cb0dc560151626589` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.272270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bceb2aa-0ceb-4335-b20d-abee593858ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8b06ded828450cb0dc560151626589)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.274663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bceb2aa-0ceb-4335-b20d-abee593858ac admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.316828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b64c823d-c2c5-40aa-8097-279cf95a80e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d2bb70207041388d27e1b17cbaa8bb', 'request_id': 'req-b64c823d-c2c5-40aa-8097-279cf95a80e3'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.326840 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b64c823d-c2c5-40aa-8097-279cf95a80e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d2bb70207041388d27e1b17cbaa8bb', 'request_id': 'req-b64c823d-c2c5-40aa-8097-279cf95a80e3'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.336845 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b64c823d-c2c5-40aa-8097-279cf95a80e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d2bb70207041388d27e1b17cbaa8bb', 'request_id': 'req-b64c823d-c2c5-40aa-8097-279cf95a80e3'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.340475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bceb2aa-0ceb-4335-b20d-abee593858ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8b06ded828450cb0dc560151626589', 'request_id': 'req-1bceb2aa-0ceb-4335-b20d-abee593858ac'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.348161 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b64c823d-c2c5-40aa-8097-279cf95a80e3 admin admin] The token cache is being invalidate because project a3d2bb70207041388d27e1b17cbaa8bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:01.348454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b64c823d-c2c5-40aa-8097-279cf95a80e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.349354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-b64c823d-c2c5-40aa-8097-279cf95a80e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.350951 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1337/2667] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:01 2022] DELETE /identity/v3/projects/a3d2bb70207041388d27e1b17cbaa8bb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:01.352784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bceb2aa-0ceb-4335-b20d-abee593858ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8b06ded828450cb0dc560151626589', 'request_id': 'req-1bceb2aa-0ceb-4335-b20d-abee593858ac'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.357755 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe168e5-82f1-4bc8-830a-52fd73fb9749 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.358278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe168e5-82f1-4bc8-830a-52fd73fb9749 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.358632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe168e5-82f1-4bc8-830a-52fd73fb9749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.360186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bceb2aa-0ceb-4335-b20d-abee593858ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8b06ded828450cb0dc560151626589', 'request_id': 'req-1bceb2aa-0ceb-4335-b20d-abee593858ac'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.372789 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bceb2aa-0ceb-4335-b20d-abee593858ac admin admin] The token cache is being invalidate because project 0e8b06ded828450cb0dc560151626589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:01.373151 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bceb2aa-0ceb-4335-b20d-abee593858ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.373936 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bceb2aa-0ceb-4335-b20d-abee593858ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:01.375800 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1331/2668] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:01 2022] DELETE /identity/v3/projects/0e8b06ded828450cb0dc560151626589 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:01.379146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-abe168e5-82f1-4bc8-830a-52fd73fb9749 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:01.380414 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-abe168e5-82f1-4bc8-830a-52fd73fb9749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:01.380572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d64562-e326-48c4-ac34-ec0f4bcc261c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.380745 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d64562-e326-48c4-ac34-ec0f4bcc261c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.381047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d64562-e326-48c4-ac34-ec0f4bcc261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.402459 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-85d64562-e326-48c4-ac34-ec0f4bcc261c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:01.403715 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-85d64562-e326-48c4-ac34-ec0f4bcc261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:01.444033 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1338/2669] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:01.451895 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133ded5-b9c6-4e79-84fa-9ac7a2a23909 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.452184 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133ded5-b9c6-4e79-84fa-9ac7a2a23909 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.452465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133ded5-b9c6-4e79-84fa-9ac7a2a23909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.465680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:01.466468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1332/2670] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:01.471827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-0133ded5-b9c6-4e79-84fa-9ac7a2a23909 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:01.473393 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0133ded5-b9c6-4e79-84fa-9ac7a2a23909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:01.474664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f60811-ec34-4190-99b8-68f051f0ad25 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.474949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f60811-ec34-4190-99b8-68f051f0ad25 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.475248 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f60811-ec34-4190-99b8-68f051f0ad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.482850 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:01.484889 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1339/2671] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:01.488787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133ded5-b9c6-4e79-84fa-9ac7a2a23909 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.499746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133ded5-b9c6-4e79-84fa-9ac7a2a23909 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.500474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-89f60811-ec34-4190-99b8-68f051f0ad25 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:01.502624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-89f60811-ec34-4190-99b8-68f051f0ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:01.504665 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dc531-3883-4431-9850-88bfd6bb1105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.505363 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dc531-3883-4431-9850-88bfd6bb1105 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.505637 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dc531-3883-4431-9850-88bfd6bb1105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.505911 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5dc531-3883-4431-9850-88bfd6bb1105 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.506644 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5dc531-3883-4431-9850-88bfd6bb1105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:01.506956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5dc531-3883-4431-9850-88bfd6bb1105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.508618 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5dc531-3883-4431-9850-88bfd6bb1105 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.513034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1333/2672] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:01.517277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f60811-ec34-4190-99b8-68f051f0ad25 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.521148 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1340/2673] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:45:01.525918 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dc531-3883-4431-9850-88bfd6bb1105 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.527666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f60811-ec34-4190-99b8-68f051f0ad25 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.533248 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ddac9-19ee-42cd-a9ea-020ae3139ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.533908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ddac9-19ee-42cd-a9ea-020ae3139ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.534199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ddac9-19ee-42cd-a9ea-020ae3139ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.534478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ddac9-19ee-42cd-a9ea-020ae3139ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.535211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ddac9-19ee-42cd-a9ea-020ae3139ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:01.535522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ddac9-19ee-42cd-a9ea-020ae3139ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.535627 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5dc531-3883-4431-9850-88bfd6bb1105 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.537165 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ddac9-19ee-42cd-a9ea-020ae3139ac1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.541272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c3254-190a-4b3f-afea-e7ded3fc88d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.541984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c3254-190a-4b3f-afea-e7ded3fc88d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.542275 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c3254-190a-4b3f-afea-e7ded3fc88d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.542552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c3254-190a-4b3f-afea-e7ded3fc88d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.543235 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c3254-190a-4b3f-afea-e7ded3fc88d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.545340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c3254-190a-4b3f-afea-e7ded3fc88d8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.553090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1334/2674] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:45:01.554986 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ddac9-19ee-42cd-a9ea-020ae3139ac1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.567622 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ddac9-19ee-42cd-a9ea-020ae3139ac1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.572978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f022c-9dfb-40a2-a18b-bd6070c4868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.573676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f022c-9dfb-40a2-a18b-bd6070c4868b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.573964 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f022c-9dfb-40a2-a18b-bd6070c4868b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.574185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1341/2675] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:01 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:01.574319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f022c-9dfb-40a2-a18b-bd6070c4868b admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.574925 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f022c-9dfb-40a2-a18b-bd6070c4868b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.576888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f022c-9dfb-40a2-a18b-bd6070c4868b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.578254 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c3254-190a-4b3f-afea-e7ded3fc88d8 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.606383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1335/2676] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:01 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:01.610704 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f022c-9dfb-40a2-a18b-bd6070c4868b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.646344 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c3254-190a-4b3f-afea-e7ded3fc88d8 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.678532 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f022c-9dfb-40a2-a18b-bd6070c4868b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.684766 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2c7ea-93cd-4df6-8431-76afc11d48a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.685502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2c7ea-93cd-4df6-8431-76afc11d48a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.685784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2c7ea-93cd-4df6-8431-76afc11d48a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.686057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2c7ea-93cd-4df6-8431-76afc11d48a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.686745 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2c7ea-93cd-4df6-8431-76afc11d48a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.688682 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2c7ea-93cd-4df6-8431-76afc11d48a2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.705314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c2c41-275f-44b0-bb2f-bc2c00213ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.706127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c2c41-275f-44b0-bb2f-bc2c00213ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.706516 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c2c41-275f-44b0-bb2f-bc2c00213ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.707044 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c2c41-275f-44b0-bb2f-bc2c00213ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.707836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c2c41-275f-44b0-bb2f-bc2c00213ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.709332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1336/2677] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:01 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:01.710068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c2c41-275f-44b0-bb2f-bc2c00213ef5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.714177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2c7ea-93cd-4df6-8431-76afc11d48a2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.727146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2c7ea-93cd-4df6-8431-76afc11d48a2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.732137 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa338b9-540c-4ec3-bc83-6357b9491445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.732832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1342/2678] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:01 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:01.732988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa338b9-540c-4ec3-bc83-6357b9491445 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.733164 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa338b9-540c-4ec3-bc83-6357b9491445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.733442 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa338b9-540c-4ec3-bc83-6357b9491445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.734167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa338b9-540c-4ec3-bc83-6357b9491445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.735760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa338b9-540c-4ec3-bc83-6357b9491445 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.737038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c2c41-275f-44b0-bb2f-bc2c00213ef5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.747167 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1337/2679] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:01.747520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c2c41-275f-44b0-bb2f-bc2c00213ef5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.751198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa338b9-540c-4ec3-bc83-6357b9491445 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.752999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34858caf-8c00-43c8-9dde-2e16627b8afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.753670 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34858caf-8c00-43c8-9dde-2e16627b8afe admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.753957 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34858caf-8c00-43c8-9dde-2e16627b8afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.754238 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34858caf-8c00-43c8-9dde-2e16627b8afe admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.755008 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34858caf-8c00-43c8-9dde-2e16627b8afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.756839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34858caf-8c00-43c8-9dde-2e16627b8afe admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.761517 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa338b9-540c-4ec3-bc83-6357b9491445 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.766269 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cc6e5-e9e9-44fc-8606-893fa2e05b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.766928 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cc6e5-e9e9-44fc-8606-893fa2e05b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.767209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cc6e5-e9e9-44fc-8606-893fa2e05b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.767482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cc6e5-e9e9-44fc-8606-893fa2e05b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.767937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1343/2680] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:01.768231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cc6e5-e9e9-44fc-8606-893fa2e05b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.770118 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cc6e5-e9e9-44fc-8606-893fa2e05b6b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.772058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34858caf-8c00-43c8-9dde-2e16627b8afe admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.784506 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1338/2681] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:01.784676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34858caf-8c00-43c8-9dde-2e16627b8afe admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.785718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cc6e5-e9e9-44fc-8606-893fa2e05b6b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.787548 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10294b05-d604-4adb-95f3-f1644ed37f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.788206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10294b05-d604-4adb-95f3-f1644ed37f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.788495 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10294b05-d604-4adb-95f3-f1644ed37f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.788811 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10294b05-d604-4adb-95f3-f1644ed37f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.790134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10294b05-d604-4adb-95f3-f1644ed37f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.791727 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10294b05-d604-4adb-95f3-f1644ed37f2a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.796145 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cc6e5-e9e9-44fc-8606-893fa2e05b6b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.800843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14c114-f990-4787-a9f8-804c8787087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.801714 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14c114-f990-4787-a9f8-804c8787087f admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.802029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14c114-f990-4787-a9f8-804c8787087f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.802314 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14c114-f990-4787-a9f8-804c8787087f admin admin] PATH_INFO: `/v3/projects/8b7672ee7a0b40669b0d16ea9c1e3a70/users/12cf1978fe004d7091aea43d20e13385/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.802458 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1344/2682] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:01.807524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10294b05-d604-4adb-95f3-f1644ed37f2a admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.818200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10294b05-d604-4adb-95f3-f1644ed37f2a admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:01.818555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14c114-f990-4787-a9f8-804c8787087f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7672ee7a0b40669b0d16ea9c1e3a70, user_id=12cf1978fe004d7091aea43d20e13385, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.822106 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14c114-f990-4787-a9f8-804c8787087f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.823565 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49e01f-7cc8-4d10-b23d-2128511be89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:01.824449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49e01f-7cc8-4d10-b23d-2128511be89c admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.824767 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49e01f-7cc8-4d10-b23d-2128511be89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.825055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49e01f-7cc8-4d10-b23d-2128511be89c admin admin] PATH_INFO: `/v3/projects/9f85cce7403c4a6a853b5b7743bfc2dd/users/248325af88a143c694cc9b6fe892a94c/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.835634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1339/2683] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:01 2022] PUT /identity/v3/projects/8b7672ee7a0b40669b0d16ea9c1e3a70/users/12cf1978fe004d7091aea43d20e13385/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:01.842379 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49e01f-7cc8-4d10-b23d-2128511be89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f85cce7403c4a6a853b5b7743bfc2dd, user_id=248325af88a143c694cc9b6fe892a94c, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:01.845077 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49e01f-7cc8-4d10-b23d-2128511be89c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:01.846696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61756-368e-48d6-b814-c49f99553d0b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.846988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61756-368e-48d6-b814-c49f99553d0b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.847268 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c61756-368e-48d6-b814-c49f99553d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.858775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1345/2684] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:01 2022] PUT /identity/v3/projects/9f85cce7403c4a6a853b5b7743bfc2dd/users/248325af88a143c694cc9b6fe892a94c/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:01.870858 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74764e-1d9e-42cc-aab7-492a2ce0640c None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:01.871146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74764e-1d9e-42cc-aab7-492a2ce0640c None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:01.871427 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74764e-1d9e-42cc-aab7-492a2ce0640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:01.875507 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-24c61756-368e-48d6-b814-c49f99553d0b None None] MFA Rules not processed for user `12cf1978fe004d7091aea43d20e13385`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:01.876771 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-24c61756-368e-48d6-b814-c49f99553d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:01.899411 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-5d74764e-1d9e-42cc-aab7-492a2ce0640c None None] MFA Rules not processed for user `248325af88a143c694cc9b6fe892a94c`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:01.900573 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5d74764e-1d9e-42cc-aab7-492a2ce0640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:01.905192 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:01.939343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:01.952633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1340/2685] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:01.957079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c61756-368e-48d6-b814-c49f99553d0b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:01.969625 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1346/2686] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:01.973895 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74764e-1d9e-42cc-aab7-492a2ce0640c None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.028562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c61756-368e-48d6-b814-c49f99553d0b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.033264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6f6ff-57d6-445b-866f-d14ffaea2d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.033982 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6f6ff-57d6-445b-866f-d14ffaea2d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.034269 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6f6ff-57d6-445b-866f-d14ffaea2d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.034547 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6f6ff-57d6-445b-866f-d14ffaea2d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.035289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6f6ff-57d6-445b-866f-d14ffaea2d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.037234 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6f6ff-57d6-445b-866f-d14ffaea2d17 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.042710 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74764e-1d9e-42cc-aab7-492a2ce0640c None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.047743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65510e28-6481-4f6d-a188-ed6164ce16e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.048433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65510e28-6481-4f6d-a188-ed6164ce16e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.048786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65510e28-6481-4f6d-a188-ed6164ce16e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.049076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65510e28-6481-4f6d-a188-ed6164ce16e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.049899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65510e28-6481-4f6d-a188-ed6164ce16e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.051913 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65510e28-6481-4f6d-a188-ed6164ce16e9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.068700 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1341/2687] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:01 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:02.069747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6f6ff-57d6-445b-866f-d14ffaea2d17 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.082233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1347/2688] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:01 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:02.085965 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65510e28-6481-4f6d-a188-ed6164ce16e9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.136089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6f6ff-57d6-445b-866f-d14ffaea2d17 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.151443 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65510e28-6481-4f6d-a188-ed6164ce16e9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.156203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fadda-f152-424d-aa33-c54110844323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.156909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fadda-f152-424d-aa33-c54110844323 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.157197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fadda-f152-424d-aa33-c54110844323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.157482 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fadda-f152-424d-aa33-c54110844323 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.158171 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fadda-f152-424d-aa33-c54110844323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.160078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fadda-f152-424d-aa33-c54110844323 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.185092 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1348/2689] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:02 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:02.186179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fadda-f152-424d-aa33-c54110844323 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.196523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fadda-f152-424d-aa33-c54110844323 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.196829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d423f0d-09fa-496e-8be3-036e09a3d039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.197424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d423f0d-09fa-496e-8be3-036e09a3d039 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.197729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d423f0d-09fa-496e-8be3-036e09a3d039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.198008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d423f0d-09fa-496e-8be3-036e09a3d039 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.198727 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d423f0d-09fa-496e-8be3-036e09a3d039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.200664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d423f0d-09fa-496e-8be3-036e09a3d039 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.201493 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807157ea-f7bc-4b29-8311-4b2d50ab0e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.202145 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807157ea-f7bc-4b29-8311-4b2d50ab0e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.202595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807157ea-f7bc-4b29-8311-4b2d50ab0e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.202829 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807157ea-f7bc-4b29-8311-4b2d50ab0e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.203720 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807157ea-f7bc-4b29-8311-4b2d50ab0e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.205632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807157ea-f7bc-4b29-8311-4b2d50ab0e55 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.218752 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1349/2690] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:45:02.223147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1342/2691] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:02 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:02.223302 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807157ea-f7bc-4b29-8311-4b2d50ab0e55 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.224151 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d423f0d-09fa-496e-8be3-036e09a3d039 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.233407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807157ea-f7bc-4b29-8311-4b2d50ab0e55 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.233822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d423f0d-09fa-496e-8be3-036e09a3d039 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.238151 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ce88a-6fec-478e-8e46-186b8f4c9eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.238399 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de436c4-a1fd-42d1-99a5-66629774ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.239021 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ce88a-6fec-478e-8e46-186b8f4c9eda admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.239127 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de436c4-a1fd-42d1-99a5-66629774ec2b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.239304 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ce88a-6fec-478e-8e46-186b8f4c9eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.239425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de436c4-a1fd-42d1-99a5-66629774ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.239579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de436c4-a1fd-42d1-99a5-66629774ec2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.239688 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ce88a-6fec-478e-8e46-186b8f4c9eda admin admin] PATH_INFO: `/v3/projects/2318c8b4d1e24480b8bb77d0a88ae7c3/users/073f4fd9db2948678191c127c08c2cff/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.240296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de436c4-a1fd-42d1-99a5-66629774ec2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.241921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de436c4-a1fd-42d1-99a5-66629774ec2b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.244239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:02.255900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1343/2692] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:45:02.256947 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de436c4-a1fd-42d1-99a5-66629774ec2b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.258205 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ce88a-6fec-478e-8e46-186b8f4c9eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=2318c8b4d1e24480b8bb77d0a88ae7c3, user_id=073f4fd9db2948678191c127c08c2cff, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.261334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ce88a-6fec-478e-8e46-186b8f4c9eda admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.263013 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:02.272635 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de436c4-a1fd-42d1-99a5-66629774ec2b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.280694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1350/2693] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:02 2022] PUT /identity/v3/projects/2318c8b4d1e24480b8bb77d0a88ae7c3/users/073f4fd9db2948678191c127c08c2cff/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:02.284666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ce88a-6fec-478e-8e46-186b8f4c9eda admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.335903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe2c79-5c6e-4b36-8f79-1409c94c871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.336933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe2c79-5c6e-4b36-8f79-1409c94c871e admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.337250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe2c79-5c6e-4b36-8f79-1409c94c871e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.337500 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe2c79-5c6e-4b36-8f79-1409c94c871e admin admin] PATH_INFO: `/v3/projects/11b2b83978b94c9fba566853eff26e53/users/308409d3bd2142dea17178b02ecd8485/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.364742 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe2c79-5c6e-4b36-8f79-1409c94c871e admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b2b83978b94c9fba566853eff26e53, user_id=308409d3bd2142dea17178b02ecd8485, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.364877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ce88a-6fec-478e-8e46-186b8f4c9eda admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.365009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe2c79-5c6e-4b36-8f79-1409c94c871e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.365125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea671376-dadb-4f72-92bb-d96f45c5bb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.365125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea671376-dadb-4f72-92bb-d96f45c5bb50 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.365125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea671376-dadb-4f72-92bb-d96f45c5bb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.365125 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea671376-dadb-4f72-92bb-d96f45c5bb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.365545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea671376-dadb-4f72-92bb-d96f45c5bb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.365545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea671376-dadb-4f72-92bb-d96f45c5bb50 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.374328 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1344/2694] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:02 2022] PUT /identity/v3/projects/11b2b83978b94c9fba566853eff26e53/users/308409d3bd2142dea17178b02ecd8485/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:02.376279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1351/2695] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:45:02.377953 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe2c79-5c6e-4b36-8f79-1409c94c871e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.380483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea671376-dadb-4f72-92bb-d96f45c5bb50 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.395686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea671376-dadb-4f72-92bb-d96f45c5bb50 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.452559 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe2c79-5c6e-4b36-8f79-1409c94c871e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.458264 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2acf5-5844-4c87-a53e-a9ffe7c559cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.458945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2acf5-5844-4c87-a53e-a9ffe7c559cd admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.459237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2acf5-5844-4c87-a53e-a9ffe7c559cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.459518 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2acf5-5844-4c87-a53e-a9ffe7c559cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.460260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2acf5-5844-4c87-a53e-a9ffe7c559cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.462260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2acf5-5844-4c87-a53e-a9ffe7c559cd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.473672 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40abed5-847d-4879-9f08-b5eb10d19538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.474702 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40abed5-847d-4879-9f08-b5eb10d19538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.474996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40abed5-847d-4879-9f08-b5eb10d19538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.475277 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40abed5-847d-4879-9f08-b5eb10d19538 admin admin] PATH_INFO: `/v3/projects/2318c8b4d1e24480b8bb77d0a88ae7c3/users/073f4fd9db2948678191c127c08c2cff/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.475934 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1345/2696] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:02.476856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2acf5-5844-4c87-a53e-a9ffe7c559cd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.477539 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40abed5-847d-4879-9f08-b5eb10d19538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2318c8b4d1e24480b8bb77d0a88ae7c3, user_id=073f4fd9db2948678191c127c08c2cff, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.480331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40abed5-847d-4879-9f08-b5eb10d19538 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.487392 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2acf5-5844-4c87-a53e-a9ffe7c559cd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.491726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1352/2697] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:02 2022] PUT /identity/v3/projects/2318c8b4d1e24480b8bb77d0a88ae7c3/users/073f4fd9db2948678191c127c08c2cff/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:02.502997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49453ce-f3d3-4b92-9f2f-6e7c9c854546 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.503200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49453ce-f3d3-4b92-9f2f-6e7c9c854546 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.503499 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49453ce-f3d3-4b92-9f2f-6e7c9c854546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.532546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b49453ce-f3d3-4b92-9f2f-6e7c9c854546 None None] MFA Rules not processed for user `073f4fd9db2948678191c127c08c2cff`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:02.533919 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b49453ce-f3d3-4b92-9f2f-6e7c9c854546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:02.568635 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a330e3-3b79-4987-9ea7-b449589d9986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.569651 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a330e3-3b79-4987-9ea7-b449589d9986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.570009 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a330e3-3b79-4987-9ea7-b449589d9986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.570362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a330e3-3b79-4987-9ea7-b449589d9986 admin admin] PATH_INFO: `/v3/projects/11b2b83978b94c9fba566853eff26e53/users/308409d3bd2142dea17178b02ecd8485/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.573418 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a330e3-3b79-4987-9ea7-b449589d9986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b2b83978b94c9fba566853eff26e53, user_id=308409d3bd2142dea17178b02ecd8485, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.577376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a330e3-3b79-4987-9ea7-b449589d9986 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.588921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1346/2698] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:02 2022] PUT /identity/v3/projects/11b2b83978b94c9fba566853eff26e53/users/308409d3bd2142dea17178b02ecd8485/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:02.599980 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d263096-15b3-4540-8076-3f67cf933f90 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.600322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d263096-15b3-4540-8076-3f67cf933f90 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.600558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d263096-15b3-4540-8076-3f67cf933f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.612585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:02.618839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1353/2699] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:02.630691 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49453ce-f3d3-4b92-9f2f-6e7c9c854546 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.632050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b49453ce-f3d3-4b92-9f2f-6e7c9c854546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:02.638844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0d263096-15b3-4540-8076-3f67cf933f90 None None] MFA Rules not processed for user `308409d3bd2142dea17178b02ecd8485`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:02.640632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0d263096-15b3-4540-8076-3f67cf933f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:02.651735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:02.697413 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49453ce-f3d3-4b92-9f2f-6e7c9c854546 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.741171 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1347/2700] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:02.770807 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaeb739-3b18-45c1-895f-dd4f33a1259c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.771466 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeb739-3b18-45c1-895f-dd4f33a1259c service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.771751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeb739-3b18-45c1-895f-dd4f33a1259c service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.772028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeb739-3b18-45c1-895f-dd4f33a1259c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.841314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaeb739-3b18-45c1-895f-dd4f33a1259c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.842782 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaeb739-3b18-45c1-895f-dd4f33a1259c service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.843714 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d263096-15b3-4540-8076-3f67cf933f90 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:02.845367 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0d263096-15b3-4540-8076-3f67cf933f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:02.853612 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1354/2701] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:45:02.858721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d263096-15b3-4540-8076-3f67cf933f90 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:02.862897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e748745-ee75-464e-9f7d-9fb5f60cabd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:02.863696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e748745-ee75-464e-9f7d-9fb5f60cabd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:02.864056 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e748745-ee75-464e-9f7d-9fb5f60cabd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:02.864753 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e748745-ee75-464e-9f7d-9fb5f60cabd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:02.883997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e748745-ee75-464e-9f7d-9fb5f60cabd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:02.885600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e748745-ee75-464e-9f7d-9fb5f60cabd2 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:02.896617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1348/2702] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:45:03.022333 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaeb739-3b18-45c1-895f-dd4f33a1259c service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.031833 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaeb739-3b18-45c1-895f-dd4f33a1259c service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:03.035659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51ef80-d9a9-4457-bd02-feee2a7f03ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:03.036385 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51ef80-d9a9-4457-bd02-feee2a7f03ac service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.036764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51ef80-d9a9-4457-bd02-feee2a7f03ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.037123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51ef80-d9a9-4457-bd02-feee2a7f03ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.104460 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51ef80-d9a9-4457-bd02-feee2a7f03ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:03.105961 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51ef80-d9a9-4457-bd02-feee2a7f03ac service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:03.116843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1355/2703] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:03.387391 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e748745-ee75-464e-9f7d-9fb5f60cabd2 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.405102 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e748745-ee75-464e-9f7d-9fb5f60cabd2 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:03.413075 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557f3bb-706b-43d2-a1e0-81192f33862a tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '073f4fd9db2948678191c127c08c2cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2318c8b4d1e24480b8bb77d0a88ae7c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:03.414302 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557f3bb-706b-43d2-a1e0-81192f33862a tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.415615 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557f3bb-706b-43d2-a1e0-81192f33862a tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.415951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557f3bb-706b-43d2-a1e0-81192f33862a tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.416880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557f3bb-706b-43d2-a1e0-81192f33862a tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:03.417780 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557f3bb-706b-43d2-a1e0-81192f33862a tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:03.419902 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557f3bb-706b-43d2-a1e0-81192f33862a tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:03.440184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1349/2704] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:03.440751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51ef80-d9a9-4457-bd02-feee2a7f03ac service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.448972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:03.455387 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51ef80-d9a9-4457-bd02-feee2a7f03ac service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:03.459559 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6138d10-330c-4400-9edf-e444c3664aea tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '073f4fd9db2948678191c127c08c2cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2318c8b4d1e24480b8bb77d0a88ae7c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:03.460297 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138d10-330c-4400-9edf-e444c3664aea tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.460676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138d10-330c-4400-9edf-e444c3664aea tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.461059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6138d10-330c-4400-9edf-e444c3664aea tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.462803 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6138d10-330c-4400-9edf-e444c3664aea tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:03.464997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6138d10-330c-4400-9edf-e444c3664aea tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:03.496248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1356/2705] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:03 2022] POST /identity/v3/projects => generated 353 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:03.497790 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557f3bb-706b-43d2-a1e0-81192f33862a tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.507912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557f3bb-706b-43d2-a1e0-81192f33862a tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:03.566564 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17e959-0517-4d86-a673-517f5daedee0 tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '073f4fd9db2948678191c127c08c2cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2318c8b4d1e24480b8bb77d0a88ae7c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:03.567324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17e959-0517-4d86-a673-517f5daedee0 tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.567685 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17e959-0517-4d86-a673-517f5daedee0 tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.568036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17e959-0517-4d86-a673-517f5daedee0 tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.568898 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17e959-0517-4d86-a673-517f5daedee0 tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:03.569281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17e959-0517-4d86-a673-517f5daedee0 tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:03.571508 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17e959-0517-4d86-a673-517f5daedee0 tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:03.583059 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1350/2706] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:03.624279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6138d10-330c-4400-9edf-e444c3664aea tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.635070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6138d10-330c-4400-9edf-e444c3664aea tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:03.639700 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '073f4fd9db2948678191c127c08c2cff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2318c8b4d1e24480b8bb77d0a88ae7c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:03.640562 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:03.640894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:03.641172 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] PATH_INFO: `/v3/projects/82040185c0d84766a1d29e4e64beab95` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:03.642366 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: Authorizing `identity:delete_project(project_id=82040185c0d84766a1d29e4e64beab95)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:03.644527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:03.692691 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82040185c0d84766a1d29e4e64beab95', 'request_id': 'req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:03.700203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82040185c0d84766a1d29e4e64beab95', 'request_id': 'req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:03.707262 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82040185c0d84766a1d29e4e64beab95', 'request_id': 'req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:03.718793 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] The token cache is being invalidate because project 82040185c0d84766a1d29e4e64beab95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:03.719080 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:03.719897 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-50f4bfd6-61ee-4110-a2a5-604769c2c5bc tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:03.721634 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1357/2707] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:03 2022] DELETE /identity/v3/projects/82040185c0d84766a1d29e4e64beab95 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:03.942528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17e959-0517-4d86-a673-517f5daedee0 tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:03.944338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8f17e959-0517-4d86-a673-517f5daedee0 tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:04.013024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17e959-0517-4d86-a673-517f5daedee0 tempest-VolumeQuotaClassesTest-2042668685 tempest-VolumeQuotaClassesTest-2042668685-project-admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:04.026313 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:04.072250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:04.073184 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.073473 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.073749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] PATH_INFO: `/v3/users/248325af88a143c694cc9b6fe892a94c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.074967 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=248325af88a143c694cc9b6fe892a94c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:04.076916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:04.125237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248325af88a143c694cc9b6fe892a94c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.125914 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248325af88a143c694cc9b6fe892a94c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.126555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248325af88a143c694cc9b6fe892a94c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.141637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248325af88a143c694cc9b6fe892a94c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.149267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248325af88a143c694cc9b6fe892a94c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.166355 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1351/2708] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:03 2022] DELETE /identity/v3/users/248325af88a143c694cc9b6fe892a94c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:04.172746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81fe55-1112-45f4-a425-3f06a2e1aa5e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.173033 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81fe55-1112-45f4-a425-3f06a2e1aa5e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.173236 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81fe55-1112-45f4-a425-3f06a2e1aa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.190857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ee81fe55-1112-45f4-a425-3f06a2e1aa5e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:04.192142 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ee81fe55-1112-45f4-a425-3f06a2e1aa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:04.257348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1358/2709] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:04.267681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:04.269368 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:04.333724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98debce-8c32-43d4-98dc-0a87a153d6e6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:04.338202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbee96-c80e-4267-abf3-fab45259cb1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:04.338852 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbee96-c80e-4267-abf3-fab45259cb1c service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.339138 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbee96-c80e-4267-abf3-fab45259cb1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.339415 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbee96-c80e-4267-abf3-fab45259cb1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.348492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbee96-c80e-4267-abf3-fab45259cb1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:04.349984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbee96-c80e-4267-abf3-fab45259cb1c service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:04.359820 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1352/2710] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:04.682489 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81fe55-1112-45f4-a425-3f06a2e1aa5e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:04.684795 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ee81fe55-1112-45f4-a425-3f06a2e1aa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:04.706172 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81fe55-1112-45f4-a425-3f06a2e1aa5e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:04.711923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:04.713353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.713735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.714083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] PATH_INFO: `/v3/projects/9f85cce7403c4a6a853b5b7743bfc2dd` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.715786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f85cce7403c4a6a853b5b7743bfc2dd)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:04.718260 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:04.791934 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f85cce7403c4a6a853b5b7743bfc2dd', 'request_id': 'req-e7b3ab21-983f-4fae-8376-8e80251dd7bf'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.807812 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f85cce7403c4a6a853b5b7743bfc2dd', 'request_id': 'req-e7b3ab21-983f-4fae-8376-8e80251dd7bf'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.814963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f85cce7403c4a6a853b5b7743bfc2dd', 'request_id': 'req-e7b3ab21-983f-4fae-8376-8e80251dd7bf'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.816914 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:04.831894 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] The token cache is being invalidate because project 9f85cce7403c4a6a853b5b7743bfc2dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:04.832177 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.833655 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.835383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1359/2711] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:04 2022] DELETE /identity/v3/projects/9f85cce7403c4a6a853b5b7743bfc2dd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:04.840116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbee96-c80e-4267-abf3-fab45259cb1c service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:04.852252 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbee96-c80e-4267-abf3-fab45259cb1c service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:04.899267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:04.923513 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027af14-ffc5-4d19-bf22-909a4ae6fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:04.924424 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027af14-ffc5-4d19-bf22-909a4ae6fa8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:04.924724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027af14-ffc5-4d19-bf22-909a4ae6fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:04.925024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027af14-ffc5-4d19-bf22-909a4ae6fa8d admin admin] PATH_INFO: `/v3/users/073f4fd9db2948678191c127c08c2cff` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:04.926522 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027af14-ffc5-4d19-bf22-909a4ae6fa8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=073f4fd9db2948678191c127c08c2cff)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:04.928496 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027af14-ffc5-4d19-bf22-909a4ae6fa8d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:04.983962 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5027af14-ffc5-4d19-bf22-909a4ae6fa8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073f4fd9db2948678191c127c08c2cff'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.985070 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5027af14-ffc5-4d19-bf22-909a4ae6fa8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073f4fd9db2948678191c127c08c2cff'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.985811 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5027af14-ffc5-4d19-bf22-909a4ae6fa8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073f4fd9db2948678191c127c08c2cff'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:04.998183 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5027af14-ffc5-4d19-bf22-909a4ae6fa8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073f4fd9db2948678191c127c08c2cff'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:05.005031 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5027af14-ffc5-4d19-bf22-909a4ae6fa8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073f4fd9db2948678191c127c08c2cff'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:05.019563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1353/2712] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:04 2022] DELETE /identity/v3/users/073f4fd9db2948678191c127c08c2cff => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:05.306626 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:05.308167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:05.322424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3ab21-983f-4fae-8376-8e80251dd7bf admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:05.379368 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff97b96-5e41-4321-bf63-3ae5080c4f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:05.380229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff97b96-5e41-4321-bf63-3ae5080c4f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.380511 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff97b96-5e41-4321-bf63-3ae5080c4f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.380823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff97b96-5e41-4321-bf63-3ae5080c4f31 admin admin] PATH_INFO: `/v3/projects/2318c8b4d1e24480b8bb77d0a88ae7c3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.381984 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff97b96-5e41-4321-bf63-3ae5080c4f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2318c8b4d1e24480b8bb77d0a88ae7c3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:05.384974 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff97b96-5e41-4321-bf63-3ae5080c4f31 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:05.431532 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ff97b96-5e41-4321-bf63-3ae5080c4f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2318c8b4d1e24480b8bb77d0a88ae7c3', 'request_id': 'req-8ff97b96-5e41-4321-bf63-3ae5080c4f31'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:05.438836 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ff97b96-5e41-4321-bf63-3ae5080c4f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2318c8b4d1e24480b8bb77d0a88ae7c3', 'request_id': 'req-8ff97b96-5e41-4321-bf63-3ae5080c4f31'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:05.445418 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ff97b96-5e41-4321-bf63-3ae5080c4f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2318c8b4d1e24480b8bb77d0a88ae7c3', 'request_id': 'req-8ff97b96-5e41-4321-bf63-3ae5080c4f31'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:05.460511 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ff97b96-5e41-4321-bf63-3ae5080c4f31 admin admin] The token cache is being invalidate because project 2318c8b4d1e24480b8bb77d0a88ae7c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:05.460968 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ff97b96-5e41-4321-bf63-3ae5080c4f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:05.462005 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8ff97b96-5e41-4321-bf63-3ae5080c4f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:05.464681 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1360/2713] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:05 2022] DELETE /identity/v3/projects/2318c8b4d1e24480b8bb77d0a88ae7c3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:05.469950 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ccc81-1475-429d-bd99-443001018111 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.470261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ccc81-1475-429d-bd99-443001018111 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.470542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ccc81-1475-429d-bd99-443001018111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.491521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f73ccc81-1475-429d-bd99-443001018111 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:05.492772 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f73ccc81-1475-429d-bd99-443001018111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:05.556589 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1354/2714] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:05.564393 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b747e-682d-4d4d-a80e-b574664beddc None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.564686 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b747e-682d-4d4d-a80e-b574664beddc None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.564997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b747e-682d-4d4d-a80e-b574664beddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.584007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-2e5b747e-682d-4d4d-a80e-b574664beddc None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:05.585258 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2e5b747e-682d-4d4d-a80e-b574664beddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:05.594028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1361/2715] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:05.598156 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ccc81-1475-429d-bd99-443001018111 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:05.607972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ccc81-1475-429d-bd99-443001018111 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:05.612896 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221acce-78c8-493f-8b6c-4e7a88084b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:05.613557 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221acce-78c8-493f-8b6c-4e7a88084b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.613863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221acce-78c8-493f-8b6c-4e7a88084b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.614142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221acce-78c8-493f-8b6c-4e7a88084b8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.614872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221acce-78c8-493f-8b6c-4e7a88084b8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:05.615185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221acce-78c8-493f-8b6c-4e7a88084b8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:05.616899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221acce-78c8-493f-8b6c-4e7a88084b8c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:05.628482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1355/2716] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:05.632654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b747e-682d-4d4d-a80e-b574664beddc None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:05.642551 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b747e-682d-4d4d-a80e-b574664beddc None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:05.647498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9b2f9-c7d3-45b9-96b2-2238aa71f269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:05.648138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9b2f9-c7d3-45b9-96b2-2238aa71f269 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.648421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9b2f9-c7d3-45b9-96b2-2238aa71f269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.648909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9b2f9-c7d3-45b9-96b2-2238aa71f269 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.649670 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9b2f9-c7d3-45b9-96b2-2238aa71f269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:05.651549 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9b2f9-c7d3-45b9-96b2-2238aa71f269 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:05.677040 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1362/2717] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:05 2022] POST /identity/v3/projects => generated 407 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:05.681661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221acce-78c8-493f-8b6c-4e7a88084b8c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:05.691648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221acce-78c8-493f-8b6c-4e7a88084b8c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:05.735866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:05.750181 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0589a2-2f37-4c44-963d-735f9cc4ebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:05.750852 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0589a2-2f37-4c44-963d-735f9cc4ebeb admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.751135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0589a2-2f37-4c44-963d-735f9cc4ebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.751410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0589a2-2f37-4c44-963d-735f9cc4ebeb admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.752107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0589a2-2f37-4c44-963d-735f9cc4ebeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:05.754090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0589a2-2f37-4c44-963d-735f9cc4ebeb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:05.773755 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1356/2718] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:05 2022] POST /identity/v3/users => generated 304 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:05.777901 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9b2f9-c7d3-45b9-96b2-2238aa71f269 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:05.788113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9b2f9-c7d3-45b9-96b2-2238aa71f269 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:05.794052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5d439-da3f-4c4e-9b8d-2bb048514126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:05.795015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d439-da3f-4c4e-9b8d-2bb048514126 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.795438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d439-da3f-4c4e-9b8d-2bb048514126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.795852 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d439-da3f-4c4e-9b8d-2bb048514126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.797007 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5d439-da3f-4c4e-9b8d-2bb048514126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:05.799506 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5d439-da3f-4c4e-9b8d-2bb048514126 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:05.818862 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1363/2719] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:05.820246 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0589a2-2f37-4c44-963d-735f9cc4ebeb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:05.830832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0589a2-2f37-4c44-963d-735f9cc4ebeb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:05.837070 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833e063-5a8a-400e-aa88-d995c3b75b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:05.837852 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833e063-5a8a-400e-aa88-d995c3b75b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.838142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833e063-5a8a-400e-aa88-d995c3b75b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.838423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833e063-5a8a-400e-aa88-d995c3b75b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.839164 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833e063-5a8a-400e-aa88-d995c3b75b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:05.841847 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833e063-5a8a-400e-aa88-d995c3b75b1d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:05.858241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1357/2720] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:05.859300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5d439-da3f-4c4e-9b8d-2bb048514126 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:05.870899 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5d439-da3f-4c4e-9b8d-2bb048514126 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:05.876426 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba6ce1-8143-4e1d-aa11-02a9d65844ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:05.877372 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba6ce1-8143-4e1d-aa11-02a9d65844ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.877652 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba6ce1-8143-4e1d-aa11-02a9d65844ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.877923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba6ce1-8143-4e1d-aa11-02a9d65844ba admin admin] PATH_INFO: `/v3/projects/9b3da932915e47639284b988e838bd1b/users/9e890a63fc0443a09ab13027397f35ee/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.895876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba6ce1-8143-4e1d-aa11-02a9d65844ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3da932915e47639284b988e838bd1b, user_id=9e890a63fc0443a09ab13027397f35ee, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:05.898520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba6ce1-8143-4e1d-aa11-02a9d65844ba admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:05.913667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1364/2721] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:05 2022] PUT /identity/v3/projects/9b3da932915e47639284b988e838bd1b/users/9e890a63fc0443a09ab13027397f35ee/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:05.925321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a228-5bca-471e-935c-03ba6addc7bb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:05.925640 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a228-5bca-471e-935c-03ba6addc7bb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:05.925948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a228-5bca-471e-935c-03ba6addc7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:05.954623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0c93a228-5bca-471e-935c-03ba6addc7bb None None] MFA Rules not processed for user `9e890a63fc0443a09ab13027397f35ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:05.955912 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0c93a228-5bca-471e-935c-03ba6addc7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:06.027268 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1358/2722] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:06.031668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba6ce1-8143-4e1d-aa11-02a9d65844ba admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.049958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:06.098494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba6ce1-8143-4e1d-aa11-02a9d65844ba admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.103470 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2632d-e160-4446-a1e0-da7468339fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.104129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2632d-e160-4446-a1e0-da7468339fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.104416 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2632d-e160-4446-a1e0-da7468339fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.104694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2632d-e160-4446-a1e0-da7468339fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.105451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2632d-e160-4446-a1e0-da7468339fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.107340 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2632d-e160-4446-a1e0-da7468339fd7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:06.138986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1365/2723] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:06 2022] POST /identity/v3/projects => generated 409 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:06.142974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93a228-5bca-471e-935c-03ba6addc7bb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.158029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93a228-5bca-471e-935c-03ba6addc7bb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.220039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c433a6-0925-4991-b007-7a4bcbbfa0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.220773 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c433a6-0925-4991-b007-7a4bcbbfa0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.221019 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c433a6-0925-4991-b007-7a4bcbbfa0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.221297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c433a6-0925-4991-b007-7a4bcbbfa0c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.222001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c433a6-0925-4991-b007-7a4bcbbfa0c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.223951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c433a6-0925-4991-b007-7a4bcbbfa0c7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:06.248232 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1359/2724] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:06 2022] POST /identity/v3/users => generated 311 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:06.249351 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2632d-e160-4446-a1e0-da7468339fd7 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.261314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2632d-e160-4446-a1e0-da7468339fd7 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.268083 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c29ef-54ae-4c1e-aec8-6c05300951f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.269060 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c29ef-54ae-4c1e-aec8-6c05300951f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.269348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c29ef-54ae-4c1e-aec8-6c05300951f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.269624 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c29ef-54ae-4c1e-aec8-6c05300951f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.270512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c29ef-54ae-4c1e-aec8-6c05300951f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.272140 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c29ef-54ae-4c1e-aec8-6c05300951f6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:06.284274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1366/2725] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:45:06.288190 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c433a6-0925-4991-b007-7a4bcbbfa0c7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.301674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c433a6-0925-4991-b007-7a4bcbbfa0c7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.309862 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1f3be-88d7-4d58-95fc-842967c8395a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.311499 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1f3be-88d7-4d58-95fc-842967c8395a admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.311927 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1f3be-88d7-4d58-95fc-842967c8395a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.312389 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1f3be-88d7-4d58-95fc-842967c8395a admin admin] PATH_INFO: `/v3/projects/8ae3539b5fd94723a16ecc91aa561103/users/6d4176aaefea48f9b8295a7fc7eb6ea6/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.338696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1f3be-88d7-4d58-95fc-842967c8395a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae3539b5fd94723a16ecc91aa561103, user_id=6d4176aaefea48f9b8295a7fc7eb6ea6, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.341642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1f3be-88d7-4d58-95fc-842967c8395a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:06.360962 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1360/2726] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:06 2022] PUT /identity/v3/projects/8ae3539b5fd94723a16ecc91aa561103/users/6d4176aaefea48f9b8295a7fc7eb6ea6/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:06.363273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c29ef-54ae-4c1e-aec8-6c05300951f6 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.376058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c29ef-54ae-4c1e-aec8-6c05300951f6 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.441475 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f46ec-cd86-4113-80e7-0462a59a0d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.442158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f46ec-cd86-4113-80e7-0462a59a0d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.442445 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f46ec-cd86-4113-80e7-0462a59a0d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.442724 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f46ec-cd86-4113-80e7-0462a59a0d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.443488 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f46ec-cd86-4113-80e7-0462a59a0d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.445131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f46ec-cd86-4113-80e7-0462a59a0d7c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:06.455839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1367/2727] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:06.459721 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1f3be-88d7-4d58-95fc-842967c8395a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.470533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1f3be-88d7-4d58-95fc-842967c8395a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.479090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6557e2-a119-4ca5-833f-5c63038a8f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.479993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6557e2-a119-4ca5-833f-5c63038a8f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.480279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6557e2-a119-4ca5-833f-5c63038a8f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.480559 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6557e2-a119-4ca5-833f-5c63038a8f08 admin admin] PATH_INFO: `/v3/projects/8ae3539b5fd94723a16ecc91aa561103/users/6d4176aaefea48f9b8295a7fc7eb6ea6/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.482588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6557e2-a119-4ca5-833f-5c63038a8f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae3539b5fd94723a16ecc91aa561103, user_id=6d4176aaefea48f9b8295a7fc7eb6ea6, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.485450 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6557e2-a119-4ca5-833f-5c63038a8f08 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:06.495895 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1361/2728] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:06 2022] PUT /identity/v3/projects/8ae3539b5fd94723a16ecc91aa561103/users/6d4176aaefea48f9b8295a7fc7eb6ea6/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:06.506273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566b54-741c-4ed9-9b85-b9c3d799553d None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.506619 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566b54-741c-4ed9-9b85-b9c3d799553d None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.506863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566b54-741c-4ed9-9b85-b9c3d799553d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.537430 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-03566b54-741c-4ed9-9b85-b9c3d799553d None None] MFA Rules not processed for user `6d4176aaefea48f9b8295a7fc7eb6ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:06.538677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-03566b54-741c-4ed9-9b85-b9c3d799553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:06.623048 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1368/2729] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:06 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:06.637477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6557e2-a119-4ca5-833f-5c63038a8f08 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.639271 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dd6557e2-a119-4ca5-833f-5c63038a8f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:06.654384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:06.710973 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6557e2-a119-4ca5-833f-5c63038a8f08 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.715006 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5af76-0cae-475b-99a2-651cf19e04ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.715661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5af76-0cae-475b-99a2-651cf19e04ae service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.715943 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5af76-0cae-475b-99a2-651cf19e04ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.716224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5af76-0cae-475b-99a2-651cf19e04ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.726588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5af76-0cae-475b-99a2-651cf19e04ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.728265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5af76-0cae-475b-99a2-651cf19e04ae service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:06.738058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1362/2730] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:06 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:06.903285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03566b54-741c-4ed9-9b85-b9c3d799553d None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:06.904679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-03566b54-741c-4ed9-9b85-b9c3d799553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:06.917377 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03566b54-741c-4ed9-9b85-b9c3d799553d None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:06.921032 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fca0f0-73c7-4139-8962-e731016cbeef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:06.921674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fca0f0-73c7-4139-8962-e731016cbeef service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:06.921960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fca0f0-73c7-4139-8962-e731016cbeef service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:06.922243 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fca0f0-73c7-4139-8962-e731016cbeef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:06.930787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:06.981076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fca0f0-73c7-4139-8962-e731016cbeef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:06.982504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fca0f0-73c7-4139-8962-e731016cbeef service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:06.991438 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1369/2731] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:06 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:07.983152 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5af76-0cae-475b-99a2-651cf19e04ae service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:07.984563 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f7b5af76-0cae-475b-99a2-651cf19e04ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.049740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5af76-0cae-475b-99a2-651cf19e04ae service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:08.054303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:08.055611 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.055894 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.056172 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] PATH_INFO: `/v3/users/12cf1978fe004d7091aea43d20e13385` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.057356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12cf1978fe004d7091aea43d20e13385)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:08.059260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.108861 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12cf1978fe004d7091aea43d20e13385'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.109632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12cf1978fe004d7091aea43d20e13385'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.110241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12cf1978fe004d7091aea43d20e13385'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.123207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12cf1978fe004d7091aea43d20e13385'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.130926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12cf1978fe004d7091aea43d20e13385'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.145043 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1363/2732] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:07 2022] DELETE /identity/v3/users/12cf1978fe004d7091aea43d20e13385 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:08.149760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92be58-0df3-4856-8dd1-738220fdf748 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.150216 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92be58-0df3-4856-8dd1-738220fdf748 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.150314 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92be58-0df3-4856-8dd1-738220fdf748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.169111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-cc92be58-0df3-4856-8dd1-738220fdf748 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:08.170292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cc92be58-0df3-4856-8dd1-738220fdf748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.234079 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1370/2733] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:08.244134 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:08.245662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.278376 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:08.306858 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a237eb-7e96-425b-bab1-6441cf5802b7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:08.310558 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8261d-ded5-4bca-8793-7bea6070b0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:08.311206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8261d-ded5-4bca-8793-7bea6070b0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.311490 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8261d-ded5-4bca-8793-7bea6070b0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.311765 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab8261d-ded5-4bca-8793-7bea6070b0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.321565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8261d-ded5-4bca-8793-7bea6070b0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:08.323181 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab8261d-ded5-4bca-8793-7bea6070b0c9 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.333050 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1364/2734] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:45:08.548977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92be58-0df3-4856-8dd1-738220fdf748 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:08.550667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-cc92be58-0df3-4856-8dd1-738220fdf748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.562847 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92be58-0df3-4856-8dd1-738220fdf748 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:08.567547 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fd850-abe4-4a0d-81eb-636b9d11f043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:08.568487 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fd850-abe4-4a0d-81eb-636b9d11f043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.568873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fd850-abe4-4a0d-81eb-636b9d11f043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.569264 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fd850-abe4-4a0d-81eb-636b9d11f043 admin admin] PATH_INFO: `/v3/users/5ccfad816b3945be917d5aef96e008cd` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.571068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fd850-abe4-4a0d-81eb-636b9d11f043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ccfad816b3945be917d5aef96e008cd)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:08.573137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fd850-abe4-4a0d-81eb-636b9d11f043 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.626570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8e7fd850-abe4-4a0d-81eb-636b9d11f043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ccfad816b3945be917d5aef96e008cd'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.627447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8e7fd850-abe4-4a0d-81eb-636b9d11f043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ccfad816b3945be917d5aef96e008cd'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.628365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8e7fd850-abe4-4a0d-81eb-636b9d11f043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ccfad816b3945be917d5aef96e008cd'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.638364 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8261d-ded5-4bca-8793-7bea6070b0c9 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:08.640343 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4ab8261d-ded5-4bca-8793-7bea6070b0c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.648854 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8e7fd850-abe4-4a0d-81eb-636b9d11f043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ccfad816b3945be917d5aef96e008cd'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.656117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab8261d-ded5-4bca-8793-7bea6070b0c9 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:08.658216 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-8e7fd850-abe4-4a0d-81eb-636b9d11f043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ccfad816b3945be917d5aef96e008cd'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.661475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:08.662351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.662633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.662981 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] PATH_INFO: `/v3/projects/8b7672ee7a0b40669b0d16ea9c1e3a70` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.665190 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7672ee7a0b40669b0d16ea9c1e3a70)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:08.667885 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.674066 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1371/2735] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:08 2022] DELETE /identity/v3/users/5ccfad816b3945be917d5aef96e008cd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:08.678473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4449e-95d5-4282-b064-364bdfd5b423 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.678859 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4449e-95d5-4282-b064-364bdfd5b423 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.679064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4449e-95d5-4282-b064-364bdfd5b423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.698085 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f8f4449e-95d5-4282-b064-364bdfd5b423 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:08.699605 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f8f4449e-95d5-4282-b064-364bdfd5b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.717464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:08.718283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7672ee7a0b40669b0d16ea9c1e3a70', 'request_id': 'req-8fb97de3-640d-434d-b532-ed74291d9d77'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.728836 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7672ee7a0b40669b0d16ea9c1e3a70', 'request_id': 'req-8fb97de3-640d-434d-b532-ed74291d9d77'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.735771 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7672ee7a0b40669b0d16ea9c1e3a70', 'request_id': 'req-8fb97de3-640d-434d-b532-ed74291d9d77'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.746701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] The token cache is being invalidate because project 8b7672ee7a0b40669b0d16ea9c1e3a70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:08.746986 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.747627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.749493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1365/2736] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:08 2022] DELETE /identity/v3/projects/8b7672ee7a0b40669b0d16ea9c1e3a70 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:08.753169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:08.754483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.763247 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1372/2737] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:08.772927 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4449e-95d5-4282-b064-364bdfd5b423 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:08.775086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f8f4449e-95d5-4282-b064-364bdfd5b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.822104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb97de3-640d-434d-b532-ed74291d9d77 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:08.826819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:08.827740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.828026 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.828301 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] PATH_INFO: `/v3/users/308409d3bd2142dea17178b02ecd8485` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.829539 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=308409d3bd2142dea17178b02ecd8485)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:08.831498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.831751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4449e-95d5-4282-b064-364bdfd5b423 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:08.880681 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308409d3bd2142dea17178b02ecd8485'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.881443 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308409d3bd2142dea17178b02ecd8485'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.882197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308409d3bd2142dea17178b02ecd8485'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.883408 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb640aa-2bc9-446a-8589-fc0e0012ce1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:08.884334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb640aa-2bc9-446a-8589-fc0e0012ce1e service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:08.884621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb640aa-2bc9-446a-8589-fc0e0012ce1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:08.884939 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb640aa-2bc9-446a-8589-fc0e0012ce1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:08.887354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fdb640aa-2bc9-446a-8589-fc0e0012ce1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:08.889949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:08.896604 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308409d3bd2142dea17178b02ecd8485'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.901958 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb640aa-2bc9-446a-8589-fc0e0012ce1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:08.903410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb640aa-2bc9-446a-8589-fc0e0012ce1e service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:08.905147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308409d3bd2142dea17178b02ecd8485'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:08.914352 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1373/2738] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:08.919765 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1366/2739] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:08 2022] DELETE /identity/v3/users/308409d3bd2142dea17178b02ecd8485 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:09.186045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb640aa-2bc9-446a-8589-fc0e0012ce1e service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:09.187880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fdb640aa-2bc9-446a-8589-fc0e0012ce1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:09.200258 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb640aa-2bc9-446a-8589-fc0e0012ce1e service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:09.227704 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:09.229403 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:09.271743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:09.272764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:09.273065 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:09.273325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48 admin admin] PATH_INFO: `/v3/projects/c5545fd5c02a4d909ad6a504e075adad` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:09.275504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5545fd5c02a4d909ad6a504e075adad)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:09.277476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:09.296703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe5a04-b182-4bed-8c0c-5aeaa8743d16 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:09.301384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f926b-e7ce-4ee0-b8e5-628d5d1587af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:09.302328 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f926b-e7ce-4ee0-b8e5-628d5d1587af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:09.302675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f926b-e7ce-4ee0-b8e5-628d5d1587af admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:09.303040 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f926b-e7ce-4ee0-b8e5-628d5d1587af admin admin] PATH_INFO: `/v3/projects/11b2b83978b94c9fba566853eff26e53` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:09.303181 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:09.304599 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f926b-e7ce-4ee0-b8e5-628d5d1587af admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b2b83978b94c9fba566853eff26e53)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:09.307674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f926b-e7ce-4ee0-b8e5-628d5d1587af admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:09.328134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5545fd5c02a4d909ad6a504e075adad', 'request_id': 'req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:09.335243 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5545fd5c02a4d909ad6a504e075adad', 'request_id': 'req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:09.342743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5545fd5c02a4d909ad6a504e075adad', 'request_id': 'req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:09.353577 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48 admin admin] The token cache is being invalidate because project c5545fd5c02a4d909ad6a504e075adad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:09.353871 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:09.354502 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-4c2b8432-3b12-4e53-b2c5-af7faeaa9f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:09.356146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1374/2740] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:09 2022] DELETE /identity/v3/projects/c5545fd5c02a4d909ad6a504e075adad => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:09.359455 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-938f926b-e7ce-4ee0-b8e5-628d5d1587af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b2b83978b94c9fba566853eff26e53', 'request_id': 'req-938f926b-e7ce-4ee0-b8e5-628d5d1587af'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:09.370067 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-938f926b-e7ce-4ee0-b8e5-628d5d1587af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b2b83978b94c9fba566853eff26e53', 'request_id': 'req-938f926b-e7ce-4ee0-b8e5-628d5d1587af'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:09.377853 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-938f926b-e7ce-4ee0-b8e5-628d5d1587af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b2b83978b94c9fba566853eff26e53', 'request_id': 'req-938f926b-e7ce-4ee0-b8e5-628d5d1587af'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:09.390514 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-938f926b-e7ce-4ee0-b8e5-628d5d1587af admin admin] The token cache is being invalidate because project 11b2b83978b94c9fba566853eff26e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:09.390810 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-938f926b-e7ce-4ee0-b8e5-628d5d1587af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:09.391498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-938f926b-e7ce-4ee0-b8e5-628d5d1587af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:09.393148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1367/2741] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:09 2022] DELETE /identity/v3/projects/11b2b83978b94c9fba566853eff26e53 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:09.398726 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a4eb3-0fd6-4412-9934-8f4c9ee79148 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:09.399518 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a4eb3-0fd6-4412-9934-8f4c9ee79148 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:09.399797 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a4eb3-0fd6-4412-9934-8f4c9ee79148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:09.419159 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c79a4eb3-0fd6-4412-9934-8f4c9ee79148 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:09.420318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c79a4eb3-0fd6-4412-9934-8f4c9ee79148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:09.489292 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1375/2742] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:09.497678 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8b2b2-5a85-44c9-b472-48f3feef8b9b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:09.498088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8b2b2-5a85-44c9-b472-48f3feef8b9b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:09.498437 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8b2b2-5a85-44c9-b472-48f3feef8b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:09.518949 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-01c8b2b2-5a85-44c9-b472-48f3feef8b9b None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:09.520226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-01c8b2b2-5a85-44c9-b472-48f3feef8b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:09.529362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1368/2743] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:09.533649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a4eb3-0fd6-4412-9934-8f4c9ee79148 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:09.545621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a4eb3-0fd6-4412-9934-8f4c9ee79148 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:09.550994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdba69d-972e-44fd-b4de-11a4bf8e3084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:09.551972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdba69d-972e-44fd-b4de-11a4bf8e3084 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:09.552434 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdba69d-972e-44fd-b4de-11a4bf8e3084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:09.552901 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdba69d-972e-44fd-b4de-11a4bf8e3084 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:09.554170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdba69d-972e-44fd-b4de-11a4bf8e3084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:09.554656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdba69d-972e-44fd-b4de-11a4bf8e3084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:09.557362 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdba69d-972e-44fd-b4de-11a4bf8e3084 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:09.572052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1376/2744] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:09.576633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8b2b2-5a85-44c9-b472-48f3feef8b9b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:09.586956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8b2b2-5a85-44c9-b472-48f3feef8b9b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:09.591706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6376a96-5b77-4a87-a209-31e9faa6e52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:09.592389 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376a96-5b77-4a87-a209-31e9faa6e52b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:09.592673 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376a96-5b77-4a87-a209-31e9faa6e52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:09.592985 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6376a96-5b77-4a87-a209-31e9faa6e52b admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:09.593695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6376a96-5b77-4a87-a209-31e9faa6e52b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:09.595637 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6376a96-5b77-4a87-a209-31e9faa6e52b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:09.623291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1369/2745] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:09 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:09.627468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdba69d-972e-44fd-b4de-11a4bf8e3084 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:09.638237 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdba69d-972e-44fd-b4de-11a4bf8e3084 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:09.698086 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555026e8-e004-4de7-9b13-f118bf57fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:09.698710 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555026e8-e004-4de7-9b13-f118bf57fa30 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:09.698995 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555026e8-e004-4de7-9b13-f118bf57fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:09.699274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555026e8-e004-4de7-9b13-f118bf57fa30 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:09.699972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555026e8-e004-4de7-9b13-f118bf57fa30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:09.701920 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555026e8-e004-4de7-9b13-f118bf57fa30 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:09.720800 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1377/2746] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:09 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:09.725288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6376a96-5b77-4a87-a209-31e9faa6e52b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:09.736023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6376a96-5b77-4a87-a209-31e9faa6e52b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:09.740630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44061027-5a89-40a1-b378-639e1fe0b2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:09.741336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44061027-5a89-40a1-b378-639e1fe0b2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:09.741625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44061027-5a89-40a1-b378-639e1fe0b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:09.741904 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44061027-5a89-40a1-b378-639e1fe0b2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:09.743147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44061027-5a89-40a1-b378-639e1fe0b2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:09.744772 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44061027-5a89-40a1-b378-639e1fe0b2e1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:09.755029 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1370/2747] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:09.759500 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555026e8-e004-4de7-9b13-f118bf57fa30 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:09.770131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555026e8-e004-4de7-9b13-f118bf57fa30 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:09.774746 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f2acd-163e-469f-85c0-0026b31e0aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:09.775394 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f2acd-163e-469f-85c0-0026b31e0aab admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:09.775677 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f2acd-163e-469f-85c0-0026b31e0aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:09.775950 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f2acd-163e-469f-85c0-0026b31e0aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:09.776666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f2acd-163e-469f-85c0-0026b31e0aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:09.778318 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f2acd-163e-469f-85c0-0026b31e0aab admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:09.789843 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1378/2748] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:09.793807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44061027-5a89-40a1-b378-639e1fe0b2e1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:09.803741 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44061027-5a89-40a1-b378-639e1fe0b2e1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:09.809178 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125d347-6acd-4011-9acd-121082088e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:09.810055 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d347-6acd-4011-9acd-121082088e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:09.810344 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d347-6acd-4011-9acd-121082088e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:09.810624 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d347-6acd-4011-9acd-121082088e8a admin admin] PATH_INFO: `/v3/projects/788f021f4e6c4a328644c9f8fe78092e/users/993cc8b1c88148bf97ab3b42e85861de/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:09.825485 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125d347-6acd-4011-9acd-121082088e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=788f021f4e6c4a328644c9f8fe78092e, user_id=993cc8b1c88148bf97ab3b42e85861de, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:09.828173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125d347-6acd-4011-9acd-121082088e8a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:09.837204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:09.842468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1371/2749] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:09 2022] PUT /identity/v3/projects/788f021f4e6c4a328644c9f8fe78092e/users/993cc8b1c88148bf97ab3b42e85861de/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:09.849106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4a95a-4c51-497a-8546-daa3a4617003 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:09.849593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4a95a-4c51-497a-8546-daa3a4617003 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:09.850072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4a95a-4c51-497a-8546-daa3a4617003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:09.869265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-09b4a95a-4c51-497a-8546-daa3a4617003 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:09.870457 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-09b4a95a-4c51-497a-8546-daa3a4617003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:09.882495 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:09.932364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1379/2750] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:09.941910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125d347-6acd-4011-9acd-121082088e8a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:09.943598 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b125d347-6acd-4011-9acd-121082088e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:10.001561 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125d347-6acd-4011-9acd-121082088e8a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:10.005223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51313c1b-871b-408c-9064-b5b201acd470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:10.005864 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51313c1b-871b-408c-9064-b5b201acd470 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:10.006149 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51313c1b-871b-408c-9064-b5b201acd470 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:10.006426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51313c1b-871b-408c-9064-b5b201acd470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:10.015842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51313c1b-871b-408c-9064-b5b201acd470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:10.017315 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51313c1b-871b-408c-9064-b5b201acd470 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:10.026943 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1372/2751] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:10.642638 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f460-7c9d-4acd-a878-aa88946b2d36 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:10.643195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f460-7c9d-4acd-a878-aa88946b2d36 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:10.643299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f460-7c9d-4acd-a878-aa88946b2d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:10.670221 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-9083f460-7c9d-4acd-a878-aa88946b2d36 None None] MFA Rules not processed for user `993cc8b1c88148bf97ab3b42e85861de`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:10.671447 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-9083f460-7c9d-4acd-a878-aa88946b2d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:10.742724 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1380/2752] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:10.747477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51313c1b-871b-408c-9064-b5b201acd470 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:10.757572 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51313c1b-871b-408c-9064-b5b201acd470 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:10.762292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d7a69-cf49-416e-977c-0e32f3249c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:10.762956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d7a69-cf49-416e-977c-0e32f3249c92 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:10.763241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d7a69-cf49-416e-977c-0e32f3249c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:10.763514 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d7a69-cf49-416e-977c-0e32f3249c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:10.764208 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d7a69-cf49-416e-977c-0e32f3249c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:10.766174 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d7a69-cf49-416e-977c-0e32f3249c92 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:10.793698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1373/2753] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:10 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:10.797799 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f460-7c9d-4acd-a878-aa88946b2d36 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:10.808479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f460-7c9d-4acd-a878-aa88946b2d36 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:10.866375 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba3149-d076-4359-8c59-9969896372be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:10.867052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba3149-d076-4359-8c59-9969896372be admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:10.867383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba3149-d076-4359-8c59-9969896372be admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:10.867676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba3149-d076-4359-8c59-9969896372be admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:10.868374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba3149-d076-4359-8c59-9969896372be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:10.870339 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba3149-d076-4359-8c59-9969896372be admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:10.897609 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1381/2754] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:10 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:10.902489 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d7a69-cf49-416e-977c-0e32f3249c92 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:10.912751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d7a69-cf49-416e-977c-0e32f3249c92 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:10.917596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fd7d2-d400-409e-9252-deb63bd3dbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:10.918268 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fd7d2-d400-409e-9252-deb63bd3dbcb admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:10.918555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fd7d2-d400-409e-9252-deb63bd3dbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:10.918834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fd7d2-d400-409e-9252-deb63bd3dbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:10.919562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fd7d2-d400-409e-9252-deb63bd3dbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:10.921204 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fd7d2-d400-409e-9252-deb63bd3dbcb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:10.932042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1374/2755] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:10.936242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba3149-d076-4359-8c59-9969896372be admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:10.946819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba3149-d076-4359-8c59-9969896372be admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:10.951462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049c0aa-147a-479b-bb4d-2675490cc061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:10.952354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049c0aa-147a-479b-bb4d-2675490cc061 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:10.952638 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049c0aa-147a-479b-bb4d-2675490cc061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:10.952947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049c0aa-147a-479b-bb4d-2675490cc061 admin admin] PATH_INFO: `/v3/projects/f4d677bea75b436c8689049019811823/users/62568b5a812d46ab8adc7c90ac99f283/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:10.968236 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049c0aa-147a-479b-bb4d-2675490cc061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d677bea75b436c8689049019811823, user_id=62568b5a812d46ab8adc7c90ac99f283, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:10.970923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049c0aa-147a-479b-bb4d-2675490cc061 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:10.983931 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1382/2756] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:10 2022] PUT /identity/v3/projects/f4d677bea75b436c8689049019811823/users/62568b5a812d46ab8adc7c90ac99f283/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:10.987880 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fd7d2-d400-409e-9252-deb63bd3dbcb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:10.998521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fd7d2-d400-409e-9252-deb63bd3dbcb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:11.054524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b331b1-e2b8-4403-82b4-380f1ac40c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:11.055981 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b331b1-e2b8-4403-82b4-380f1ac40c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:11.056262 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b331b1-e2b8-4403-82b4-380f1ac40c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:11.056548 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b331b1-e2b8-4403-82b4-380f1ac40c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:11.057310 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b331b1-e2b8-4403-82b4-380f1ac40c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:11.058921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b331b1-e2b8-4403-82b4-380f1ac40c4d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:11.068849 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1375/2757] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:11.073135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049c0aa-147a-479b-bb4d-2675490cc061 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:11.083245 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049c0aa-147a-479b-bb4d-2675490cc061 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:11.088255 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922ad31-338c-4c8c-99e4-cf6d6b338a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:11.089232 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922ad31-338c-4c8c-99e4-cf6d6b338a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:11.089517 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922ad31-338c-4c8c-99e4-cf6d6b338a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:11.089794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922ad31-338c-4c8c-99e4-cf6d6b338a18 admin admin] PATH_INFO: `/v3/projects/f4d677bea75b436c8689049019811823/users/62568b5a812d46ab8adc7c90ac99f283/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:11.091770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922ad31-338c-4c8c-99e4-cf6d6b338a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d677bea75b436c8689049019811823, user_id=62568b5a812d46ab8adc7c90ac99f283, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:11.094426 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922ad31-338c-4c8c-99e4-cf6d6b338a18 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:11.100552 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:11.106415 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1383/2758] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:11 2022] PUT /identity/v3/projects/f4d677bea75b436c8689049019811823/users/62568b5a812d46ab8adc7c90ac99f283/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:11.776390 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447794f6-ccb0-4e53-9a45-78fb7e73b7bb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:11.776925 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447794f6-ccb0-4e53-9a45-78fb7e73b7bb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:11.777050 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447794f6-ccb0-4e53-9a45-78fb7e73b7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:11.803020 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-447794f6-ccb0-4e53-9a45-78fb7e73b7bb None None] MFA Rules not processed for user `62568b5a812d46ab8adc7c90ac99f283`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:11.804245 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-447794f6-ccb0-4e53-9a45-78fb7e73b7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:11.859592 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:11.882468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1376/2759] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:11.892982 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922ad31-338c-4c8c-99e4-cf6d6b338a18 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:11.894913 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f922ad31-338c-4c8c-99e4-cf6d6b338a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:11.955367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922ad31-338c-4c8c-99e4-cf6d6b338a18 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:11.959063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cc9a5-5db8-4ff8-8a5a-99853ceaa016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:11.959720 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cc9a5-5db8-4ff8-8a5a-99853ceaa016 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:11.960008 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cc9a5-5db8-4ff8-8a5a-99853ceaa016 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:11.960324 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cc9a5-5db8-4ff8-8a5a-99853ceaa016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:12.019738 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cc9a5-5db8-4ff8-8a5a-99853ceaa016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:12.021203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cc9a5-5db8-4ff8-8a5a-99853ceaa016 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:12.030424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1384/2760] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:13.381480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447794f6-ccb0-4e53-9a45-78fb7e73b7bb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:13.391367 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447794f6-ccb0-4e53-9a45-78fb7e73b7bb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:13.395188 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef206f-c747-4872-afb4-e9b53f02e5f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:13.395837 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef206f-c747-4872-afb4-e9b53f02e5f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:13.396110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef206f-c747-4872-afb4-e9b53f02e5f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:13.396387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef206f-c747-4872-afb4-e9b53f02e5f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:13.406153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef206f-c747-4872-afb4-e9b53f02e5f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:13.407587 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef206f-c747-4872-afb4-e9b53f02e5f5 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:13.418036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1377/2761] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:13 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:15.336456 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cc9a5-5db8-4ff8-8a5a-99853ceaa016 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:15.337955 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c84cc9a5-5db8-4ff8-8a5a-99853ceaa016 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:15.402589 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cc9a5-5db8-4ff8-8a5a-99853ceaa016 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:15.407089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:15.407948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:15.408234 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:15.408510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] PATH_INFO: `/v3/users/9e890a63fc0443a09ab13027397f35ee` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:15.409867 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e890a63fc0443a09ab13027397f35ee)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:15.411777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:15.457696 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e890a63fc0443a09ab13027397f35ee'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:15.458341 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e890a63fc0443a09ab13027397f35ee'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:15.458944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e890a63fc0443a09ab13027397f35ee'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:15.466119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:15.472432 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e890a63fc0443a09ab13027397f35ee'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:15.480076 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e890a63fc0443a09ab13027397f35ee'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:15.494230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1385/2762] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:15 2022] DELETE /identity/v3/users/9e890a63fc0443a09ab13027397f35ee => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:15.498805 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae0a54-7853-4835-b14d-f069ded6fd91 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:15.499307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae0a54-7853-4835-b14d-f069ded6fd91 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:15.499420 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae0a54-7853-4835-b14d-f069ded6fd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:15.516631 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3fae0a54-7853-4835-b14d-f069ded6fd91 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:15.517840 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3fae0a54-7853-4835-b14d-f069ded6fd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:15.579393 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1378/2763] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:15.591569 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:15.593038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:15.654595 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa5d21-e82d-4640-885e-b6b59a57c930 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:15.658436 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204b60-b472-48ae-a9c6-7a2af653f080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:15.659090 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204b60-b472-48ae-a9c6-7a2af653f080 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:15.659376 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204b60-b472-48ae-a9c6-7a2af653f080 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:15.659654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204b60-b472-48ae-a9c6-7a2af653f080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:15.669670 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec204b60-b472-48ae-a9c6-7a2af653f080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:15.671089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec204b60-b472-48ae-a9c6-7a2af653f080 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:15.680534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1386/2764] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:15.945214 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae0a54-7853-4835-b14d-f069ded6fd91 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:15.946927 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3fae0a54-7853-4835-b14d-f069ded6fd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:15.958784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae0a54-7853-4835-b14d-f069ded6fd91 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:15.970143 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:15.971102 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:15.971476 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:15.971846 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] PATH_INFO: `/v3/projects/9b3da932915e47639284b988e838bd1b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:15.973086 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3da932915e47639284b988e838bd1b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:15.975080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:16.027724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3da932915e47639284b988e838bd1b', 'request_id': 'req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.034896 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3da932915e47639284b988e838bd1b', 'request_id': 'req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.042877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3da932915e47639284b988e838bd1b', 'request_id': 'req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.056402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] The token cache is being invalidate because project 9b3da932915e47639284b988e838bd1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:16.056695 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.057390 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.058979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1379/2765] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:15 2022] DELETE /identity/v3/projects/9b3da932915e47639284b988e838bd1b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:16.063597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204b60-b472-48ae-a9c6-7a2af653f080 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:16.073971 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204b60-b472-48ae-a9c6-7a2af653f080 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:16.135391 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc139b-fe9e-40c4-8ba1-0257b7f9ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:16.136278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc139b-fe9e-40c4-8ba1-0257b7f9ef87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:16.136605 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc139b-fe9e-40c4-8ba1-0257b7f9ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:16.136930 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc139b-fe9e-40c4-8ba1-0257b7f9ef87 admin admin] PATH_INFO: `/v3/users/6d4176aaefea48f9b8295a7fc7eb6ea6` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:16.138202 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc139b-fe9e-40c4-8ba1-0257b7f9ef87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4176aaefea48f9b8295a7fc7eb6ea6)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:16.140136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc139b-fe9e-40c4-8ba1-0257b7f9ef87 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:16.190740 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cfdc139b-fe9e-40c4-8ba1-0257b7f9ef87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4176aaefea48f9b8295a7fc7eb6ea6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.191387 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cfdc139b-fe9e-40c4-8ba1-0257b7f9ef87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4176aaefea48f9b8295a7fc7eb6ea6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.192006 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cfdc139b-fe9e-40c4-8ba1-0257b7f9ef87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4176aaefea48f9b8295a7fc7eb6ea6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.204326 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cfdc139b-fe9e-40c4-8ba1-0257b7f9ef87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4176aaefea48f9b8295a7fc7eb6ea6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.211467 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-cfdc139b-fe9e-40c4-8ba1-0257b7f9ef87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4176aaefea48f9b8295a7fc7eb6ea6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.215045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:16.225532 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1387/2766] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:16 2022] DELETE /identity/v3/users/6d4176aaefea48f9b8295a7fc7eb6ea6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:16.496887 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:16.498341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:16.512224 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a2e19-78b2-42ab-b0d5-3cf16ac1b741 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:16.569937 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a069a-fd53-4b59-bdba-ee5cff8217bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:16.570738 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a069a-fd53-4b59-bdba-ee5cff8217bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:16.571042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a069a-fd53-4b59-bdba-ee5cff8217bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:16.571295 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a069a-fd53-4b59-bdba-ee5cff8217bd admin admin] PATH_INFO: `/v3/projects/8ae3539b5fd94723a16ecc91aa561103` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:16.572467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a069a-fd53-4b59-bdba-ee5cff8217bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae3539b5fd94723a16ecc91aa561103)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:16.574423 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a069a-fd53-4b59-bdba-ee5cff8217bd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:16.576667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:16.622341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-da9a069a-fd53-4b59-bdba-ee5cff8217bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae3539b5fd94723a16ecc91aa561103', 'request_id': 'req-da9a069a-fd53-4b59-bdba-ee5cff8217bd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.628562 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-da9a069a-fd53-4b59-bdba-ee5cff8217bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae3539b5fd94723a16ecc91aa561103', 'request_id': 'req-da9a069a-fd53-4b59-bdba-ee5cff8217bd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.634788 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-da9a069a-fd53-4b59-bdba-ee5cff8217bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae3539b5fd94723a16ecc91aa561103', 'request_id': 'req-da9a069a-fd53-4b59-bdba-ee5cff8217bd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.645098 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-da9a069a-fd53-4b59-bdba-ee5cff8217bd admin admin] The token cache is being invalidate because project 8ae3539b5fd94723a16ecc91aa561103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:16.645387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-da9a069a-fd53-4b59-bdba-ee5cff8217bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.646014 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-da9a069a-fd53-4b59-bdba-ee5cff8217bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:16.647546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1380/2767] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:16 2022] DELETE /identity/v3/projects/8ae3539b5fd94723a16ecc91aa561103 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:16.653170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1d6f7-650b-46d6-9e2a-35cd2f018963 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:16.653646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1d6f7-650b-46d6-9e2a-35cd2f018963 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:16.653743 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1d6f7-650b-46d6-9e2a-35cd2f018963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:16.671757 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-d0c1d6f7-650b-46d6-9e2a-35cd2f018963 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:16.672987 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d0c1d6f7-650b-46d6-9e2a-35cd2f018963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:16.732690 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1388/2768] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:16.741523 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a1f85-6589-4f4d-94fd-e701a74b93f5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:16.741814 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a1f85-6589-4f4d-94fd-e701a74b93f5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:16.742094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a1f85-6589-4f4d-94fd-e701a74b93f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:16.761740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-992a1f85-6589-4f4d-94fd-e701a74b93f5 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:16.762951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-992a1f85-6589-4f4d-94fd-e701a74b93f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:16.771267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1381/2769] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:16.775707 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1d6f7-650b-46d6-9e2a-35cd2f018963 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:16.785421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1d6f7-650b-46d6-9e2a-35cd2f018963 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:16.790790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4862f58-f739-4547-9a76-c5b04e376229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:16.791435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4862f58-f739-4547-9a76-c5b04e376229 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:16.791719 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4862f58-f739-4547-9a76-c5b04e376229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:16.791996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4862f58-f739-4547-9a76-c5b04e376229 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:16.792736 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4862f58-f739-4547-9a76-c5b04e376229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:16.793053 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4862f58-f739-4547-9a76-c5b04e376229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:16.794667 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4862f58-f739-4547-9a76-c5b04e376229 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:16.806903 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1389/2770] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:16.810964 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a1f85-6589-4f4d-94fd-e701a74b93f5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:16.820308 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a1f85-6589-4f4d-94fd-e701a74b93f5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:16.825136 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab617ae-3989-478f-87db-272749db133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:16.825786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab617ae-3989-478f-87db-272749db133e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:16.826071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab617ae-3989-478f-87db-272749db133e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:16.826351 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab617ae-3989-478f-87db-272749db133e admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:16.827039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab617ae-3989-478f-87db-272749db133e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:16.828972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab617ae-3989-478f-87db-272749db133e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:16.855493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1382/2771] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:16 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:16.859605 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4862f58-f739-4547-9a76-c5b04e376229 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:16.870225 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4862f58-f739-4547-9a76-c5b04e376229 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:16.927510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e40dd-8696-41ff-8064-4d615e8216ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:16.928188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e40dd-8696-41ff-8064-4d615e8216ef admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:16.928473 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e40dd-8696-41ff-8064-4d615e8216ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:16.928784 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e40dd-8696-41ff-8064-4d615e8216ef admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:16.929474 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e40dd-8696-41ff-8064-4d615e8216ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:16.931999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e40dd-8696-41ff-8064-4d615e8216ef admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:16.951761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1390/2772] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:16 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:16.955807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab617ae-3989-478f-87db-272749db133e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:16.966316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab617ae-3989-478f-87db-272749db133e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:16.971062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8a45d-7c5b-45d6-a437-d29fd828cc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:16.971719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8a45d-7c5b-45d6-a437-d29fd828cc28 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:16.972004 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8a45d-7c5b-45d6-a437-d29fd828cc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:16.972279 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8a45d-7c5b-45d6-a437-d29fd828cc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:16.973042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8a45d-7c5b-45d6-a437-d29fd828cc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:16.974626 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8a45d-7c5b-45d6-a437-d29fd828cc28 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:16.986135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1383/2773] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:16.990056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e40dd-8696-41ff-8064-4d615e8216ef admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:17.000888 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e40dd-8696-41ff-8064-4d615e8216ef admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:17.005546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c7056-cf2a-4d76-993f-412322ccf847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:17.006210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c7056-cf2a-4d76-993f-412322ccf847 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:17.006495 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c7056-cf2a-4d76-993f-412322ccf847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:17.006771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c7056-cf2a-4d76-993f-412322ccf847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:17.007497 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c7056-cf2a-4d76-993f-412322ccf847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:17.009481 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c7056-cf2a-4d76-993f-412322ccf847 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:17.019538 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1391/2774] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:17.023988 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8a45d-7c5b-45d6-a437-d29fd828cc28 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:17.034212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8a45d-7c5b-45d6-a437-d29fd828cc28 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:17.038863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0a98c-5944-42c3-b5cb-a9f778f6c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:17.040510 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0a98c-5944-42c3-b5cb-a9f778f6c4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:17.040832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0a98c-5944-42c3-b5cb-a9f778f6c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:17.041147 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0a98c-5944-42c3-b5cb-a9f778f6c4c9 admin admin] PATH_INFO: `/v3/projects/1f41575a834b4be38aa0862a6057c16f/users/4dd4b1963a3c4c01b81625a604652209/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:17.057733 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0a98c-5944-42c3-b5cb-a9f778f6c4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f41575a834b4be38aa0862a6057c16f, user_id=4dd4b1963a3c4c01b81625a604652209, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:17.060389 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0a98c-5944-42c3-b5cb-a9f778f6c4c9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:17.074791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1384/2775] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:17 2022] PUT /identity/v3/projects/1f41575a834b4be38aa0862a6057c16f/users/4dd4b1963a3c4c01b81625a604652209/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:17.085176 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07a92-86bc-4af3-813b-c11839927934 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:17.085522 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07a92-86bc-4af3-813b-c11839927934 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:17.085809 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07a92-86bc-4af3-813b-c11839927934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:17.112520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-14f07a92-86bc-4af3-813b-c11839927934 None None] MFA Rules not processed for user `4dd4b1963a3c4c01b81625a604652209`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:17.113763 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-14f07a92-86bc-4af3-813b-c11839927934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:17.163062 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:17.181120 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1392/2776] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:17.191996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0a98c-5944-42c3-b5cb-a9f778f6c4c9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:17.193675 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d6c0a98c-5944-42c3-b5cb-a9f778f6c4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:17.254461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0a98c-5944-42c3-b5cb-a9f778f6c4c9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:17.258159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104e113-71c0-4542-bada-229e2268cac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:17.258997 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104e113-71c0-4542-bada-229e2268cac9 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:17.259286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104e113-71c0-4542-bada-229e2268cac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:17.259567 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104e113-71c0-4542-bada-229e2268cac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:17.267978 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104e113-71c0-4542-bada-229e2268cac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:17.269736 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104e113-71c0-4542-bada-229e2268cac9 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:17.280907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1385/2777] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:17.301290 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f07a92-86bc-4af3-813b-c11839927934 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:17.366705 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f07a92-86bc-4af3-813b-c11839927934 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:17.371796 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:17.372680 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:17.372996 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:17.373276 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] PATH_INFO: `/v3/users/4dd4b1963a3c4c01b81625a604652209` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:17.374535 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd4b1963a3c4c01b81625a604652209)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:17.376832 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:17.431271 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd4b1963a3c4c01b81625a604652209'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:17.432099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd4b1963a3c4c01b81625a604652209'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:17.433268 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd4b1963a3c4c01b81625a604652209'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:17.456849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd4b1963a3c4c01b81625a604652209'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:17.464748 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd4b1963a3c4c01b81625a604652209'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:17.481546 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1393/2778] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:17 2022] DELETE /identity/v3/users/4dd4b1963a3c4c01b81625a604652209 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:17.485970 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b914f-3297-4f56-b74d-550d8b1c89ba None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:17.486265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b914f-3297-4f56-b74d-550d8b1c89ba None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:17.486546 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b914f-3297-4f56-b74d-550d8b1c89ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:17.505251 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b14b914f-3297-4f56-b74d-550d8b1c89ba None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:17.506446 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b14b914f-3297-4f56-b74d-550d8b1c89ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:17.535211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:17.571482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1386/2779] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:17.581709 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:17.583112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:17.641201 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807707ef-5184-43fd-8dfc-332eaf62cc57 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:17.645064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd9e36-9eb8-471f-8d61-1ab9fd8dc8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:17.645711 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd9e36-9eb8-471f-8d61-1ab9fd8dc8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:17.645999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd9e36-9eb8-471f-8d61-1ab9fd8dc8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:17.646278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd9e36-9eb8-471f-8d61-1ab9fd8dc8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:17.656110 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd9e36-9eb8-471f-8d61-1ab9fd8dc8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:17.657574 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd9e36-9eb8-471f-8d61-1ab9fd8dc8b1 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:17.667266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1394/2780] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:45:17.969724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b914f-3297-4f56-b74d-550d8b1c89ba None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:17.972145 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b14b914f-3297-4f56-b74d-550d8b1c89ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:17.989709 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b914f-3297-4f56-b74d-550d8b1c89ba None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:17.995039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:17.995970 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:17.996320 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:17.996736 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5 admin admin] PATH_INFO: `/v3/projects/1f41575a834b4be38aa0862a6057c16f` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:17.998966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f41575a834b4be38aa0862a6057c16f)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:18.001994 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:18.057767 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f41575a834b4be38aa0862a6057c16f', 'request_id': 'req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:18.068514 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f41575a834b4be38aa0862a6057c16f', 'request_id': 'req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:18.076923 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f41575a834b4be38aa0862a6057c16f', 'request_id': 'req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:18.088402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5 admin admin] The token cache is being invalidate because project 1f41575a834b4be38aa0862a6057c16f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:18.088691 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:18.089442 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-469a6b3b-6e28-4ad9-b26b-d31a0d1355c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:18.091173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1387/2781] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:17 2022] DELETE /identity/v3/projects/1f41575a834b4be38aa0862a6057c16f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:18.096646 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312964f-e81a-448b-879a-fb3489c3a37a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:18.096972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312964f-e81a-448b-879a-fb3489c3a37a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:18.097279 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312964f-e81a-448b-879a-fb3489c3a37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:18.117937 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-b312964f-e81a-448b-879a-fb3489c3a37a None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:18.119146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-b312964f-e81a-448b-879a-fb3489c3a37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:18.129882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:18.190813 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1395/2782] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:18.199316 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b675001-5f1f-41eb-a03c-d08f7e16d8c8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:18.199604 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b675001-5f1f-41eb-a03c-d08f7e16d8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:18.199884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b675001-5f1f-41eb-a03c-d08f7e16d8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:18.221863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3b675001-5f1f-41eb-a03c-d08f7e16d8c8 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:18.223478 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3b675001-5f1f-41eb-a03c-d08f7e16d8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:18.237576 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1388/2783] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:18.243365 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312964f-e81a-448b-879a-fb3489c3a37a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:18.256179 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312964f-e81a-448b-879a-fb3489c3a37a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:18.262799 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d22da-4fdf-441b-94fe-9bb1b413e387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:18.263488 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d22da-4fdf-441b-94fe-9bb1b413e387 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:18.263802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d22da-4fdf-441b-94fe-9bb1b413e387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:18.264159 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d22da-4fdf-441b-94fe-9bb1b413e387 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:18.265244 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d22da-4fdf-441b-94fe-9bb1b413e387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:18.265559 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d22da-4fdf-441b-94fe-9bb1b413e387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:18.267419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d22da-4fdf-441b-94fe-9bb1b413e387 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:18.286632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1396/2784] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:18.291666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b675001-5f1f-41eb-a03c-d08f7e16d8c8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:18.306359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b675001-5f1f-41eb-a03c-d08f7e16d8c8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:18.311892 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b94381-6a11-4826-9bb8-cdb3a0e40bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:18.312854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b94381-6a11-4826-9bb8-cdb3a0e40bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:18.313307 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b94381-6a11-4826-9bb8-cdb3a0e40bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:18.313661 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b94381-6a11-4826-9bb8-cdb3a0e40bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:18.314358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b94381-6a11-4826-9bb8-cdb3a0e40bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:18.316350 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b94381-6a11-4826-9bb8-cdb3a0e40bbb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:18.348768 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1389/2785] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:18 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:18.353242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d22da-4fdf-441b-94fe-9bb1b413e387 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:18.364785 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d22da-4fdf-441b-94fe-9bb1b413e387 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:18.429298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76611311-0f95-455a-9269-27ecefc4fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:18.430918 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76611311-0f95-455a-9269-27ecefc4fc1e admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:18.431422 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76611311-0f95-455a-9269-27ecefc4fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:18.431815 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76611311-0f95-455a-9269-27ecefc4fc1e admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:18.432524 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76611311-0f95-455a-9269-27ecefc4fc1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:18.434472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76611311-0f95-455a-9269-27ecefc4fc1e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:18.456112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1397/2786] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:18 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:18.460501 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b94381-6a11-4826-9bb8-cdb3a0e40bbb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:18.472323 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b94381-6a11-4826-9bb8-cdb3a0e40bbb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:18.478072 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593b74a-2e7d-4841-9d64-319ace466fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:18.478625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593b74a-2e7d-4841-9d64-319ace466fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:18.478916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593b74a-2e7d-4841-9d64-319ace466fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:18.479199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593b74a-2e7d-4841-9d64-319ace466fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:18.480058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593b74a-2e7d-4841-9d64-319ace466fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:18.483084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593b74a-2e7d-4841-9d64-319ace466fa1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:18.495549 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1390/2787] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:18.499476 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76611311-0f95-455a-9269-27ecefc4fc1e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:18.514375 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76611311-0f95-455a-9269-27ecefc4fc1e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:18.521860 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2de23e-7923-47cc-bdba-64522a801c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:18.523026 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2de23e-7923-47cc-bdba-64522a801c86 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:18.523541 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2de23e-7923-47cc-bdba-64522a801c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:18.523956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2de23e-7923-47cc-bdba-64522a801c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:18.525087 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2de23e-7923-47cc-bdba-64522a801c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:18.527303 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2de23e-7923-47cc-bdba-64522a801c86 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:18.538621 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1398/2788] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:18.543421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593b74a-2e7d-4841-9d64-319ace466fa1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:18.560968 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593b74a-2e7d-4841-9d64-319ace466fa1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:18.565802 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9c48a-08ed-440b-b31d-75bab081ded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:18.566693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9c48a-08ed-440b-b31d-75bab081ded3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:18.566989 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9c48a-08ed-440b-b31d-75bab081ded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:18.567268 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9c48a-08ed-440b-b31d-75bab081ded3 admin admin] PATH_INFO: `/v3/projects/020bfef58469462ea466c747b8159a8f/users/828c767cd558404ab017d4df9eab6873/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:18.585187 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9c48a-08ed-440b-b31d-75bab081ded3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=020bfef58469462ea466c747b8159a8f, user_id=828c767cd558404ab017d4df9eab6873, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:18.588123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9c48a-08ed-440b-b31d-75bab081ded3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:18.606639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1391/2789] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:18 2022] PUT /identity/v3/projects/020bfef58469462ea466c747b8159a8f/users/828c767cd558404ab017d4df9eab6873/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:18.619301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148e191-64d0-4544-8236-e0de590494f2 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:18.619759 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148e191-64d0-4544-8236-e0de590494f2 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:18.620122 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148e191-64d0-4544-8236-e0de590494f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:18.650893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c148e191-64d0-4544-8236-e0de590494f2 None None] MFA Rules not processed for user `828c767cd558404ab017d4df9eab6873`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:18.652262 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c148e191-64d0-4544-8236-e0de590494f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:18.724940 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1399/2790] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:18.730525 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9c48a-08ed-440b-b31d-75bab081ded3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:18.786165 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:18.799444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9c48a-08ed-440b-b31d-75bab081ded3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:18.805042 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea80058-2430-46df-9de6-a847b177b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:18.806069 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea80058-2430-46df-9de6-a847b177b7ba admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:18.806356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea80058-2430-46df-9de6-a847b177b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:18.806636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea80058-2430-46df-9de6-a847b177b7ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:18.807374 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea80058-2430-46df-9de6-a847b177b7ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:18.809326 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea80058-2430-46df-9de6-a847b177b7ba admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:18.840791 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1392/2791] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:18 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:18.841926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148e191-64d0-4544-8236-e0de590494f2 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:18.853131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148e191-64d0-4544-8236-e0de590494f2 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:18.862838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:18.924927 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c5ae3-6021-43a2-bc40-c46bccee204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:18.925630 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c5ae3-6021-43a2-bc40-c46bccee204d admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:18.926154 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c5ae3-6021-43a2-bc40-c46bccee204d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:18.926633 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c5ae3-6021-43a2-bc40-c46bccee204d admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:18.927139 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c5ae3-6021-43a2-bc40-c46bccee204d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:18.929185 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c5ae3-6021-43a2-bc40-c46bccee204d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:18.951393 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1400/2792] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:18 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:18.955676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea80058-2430-46df-9de6-a847b177b7ba admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:18.967102 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea80058-2430-46df-9de6-a847b177b7ba admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:18.972209 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69419f50-be00-4b80-b0f8-2484ff069dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:18.977407 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69419f50-be00-4b80-b0f8-2484ff069dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:18.977651 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69419f50-be00-4b80-b0f8-2484ff069dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:18.977935 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69419f50-be00-4b80-b0f8-2484ff069dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:18.978682 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69419f50-be00-4b80-b0f8-2484ff069dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:18.980416 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69419f50-be00-4b80-b0f8-2484ff069dc7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:18.991365 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1393/2793] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:18.995750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c5ae3-6021-43a2-bc40-c46bccee204d admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:19.005697 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c5ae3-6021-43a2-bc40-c46bccee204d admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:19.011068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffd97c-5044-4dd9-a54f-429c38a3f138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:19.011716 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffd97c-5044-4dd9-a54f-429c38a3f138 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:19.011999 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffd97c-5044-4dd9-a54f-429c38a3f138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:19.012272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffd97c-5044-4dd9-a54f-429c38a3f138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:19.013022 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffd97c-5044-4dd9-a54f-429c38a3f138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:19.014596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffd97c-5044-4dd9-a54f-429c38a3f138 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:19.025459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1401/2794] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:19.029554 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69419f50-be00-4b80-b0f8-2484ff069dc7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:19.040613 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69419f50-be00-4b80-b0f8-2484ff069dc7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:19.045402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c010738-cb66-4072-ad4e-1c206448f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:19.046289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010738-cb66-4072-ad4e-1c206448f9aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:19.046595 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010738-cb66-4072-ad4e-1c206448f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:19.046872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010738-cb66-4072-ad4e-1c206448f9aa admin admin] PATH_INFO: `/v3/projects/860a26fa8c19481d8cc0535c2b9082b2/users/dab1bab08d824c149db11b47279b2dc2/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:19.061946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c010738-cb66-4072-ad4e-1c206448f9aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=860a26fa8c19481d8cc0535c2b9082b2, user_id=dab1bab08d824c149db11b47279b2dc2, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:19.064773 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c010738-cb66-4072-ad4e-1c206448f9aa admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:19.078458 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1394/2795] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:19 2022] PUT /identity/v3/projects/860a26fa8c19481d8cc0535c2b9082b2/users/dab1bab08d824c149db11b47279b2dc2/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:19.089715 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9ed9-3edc-4a0e-8e60-23817592872e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:19.090214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9ed9-3edc-4a0e-8e60-23817592872e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:19.090675 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9ed9-3edc-4a0e-8e60-23817592872e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:19.119993 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-83ba9ed9-3edc-4a0e-8e60-23817592872e None None] MFA Rules not processed for user `dab1bab08d824c149db11b47279b2dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:19.121321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-83ba9ed9-3edc-4a0e-8e60-23817592872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:19.188521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1402/2796] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:19.192984 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c010738-cb66-4072-ad4e-1c206448f9aa admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:19.257207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c010738-cb66-4072-ad4e-1c206448f9aa admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:19.262594 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec05e3-dcb8-41b7-beb8-e9ac17112996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:19.263250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec05e3-dcb8-41b7-beb8-e9ac17112996 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:19.263529 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec05e3-dcb8-41b7-beb8-e9ac17112996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:19.263804 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec05e3-dcb8-41b7-beb8-e9ac17112996 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:19.264499 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec05e3-dcb8-41b7-beb8-e9ac17112996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:19.266425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec05e3-dcb8-41b7-beb8-e9ac17112996 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:19.291916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1395/2797] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:19 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:19.296047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba9ed9-3edc-4a0e-8e60-23817592872e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:19.307674 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba9ed9-3edc-4a0e-8e60-23817592872e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:19.362997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8750d68-60ea-4b7b-adec-a2cf6185a3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:19.363673 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8750d68-60ea-4b7b-adec-a2cf6185a3de admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:19.363956 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8750d68-60ea-4b7b-adec-a2cf6185a3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:19.364230 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8750d68-60ea-4b7b-adec-a2cf6185a3de admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:19.364952 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8750d68-60ea-4b7b-adec-a2cf6185a3de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:19.366854 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8750d68-60ea-4b7b-adec-a2cf6185a3de admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:19.387952 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1403/2798] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:19 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:19.391270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec05e3-dcb8-41b7-beb8-e9ac17112996 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:19.402240 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec05e3-dcb8-41b7-beb8-e9ac17112996 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:19.407139 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f5d34-e0f3-44ce-98b4-f3566e2ac93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:19.407809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f5d34-e0f3-44ce-98b4-f3566e2ac93e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:19.408099 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f5d34-e0f3-44ce-98b4-f3566e2ac93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:19.408408 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f5d34-e0f3-44ce-98b4-f3566e2ac93e admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:19.409177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f5d34-e0f3-44ce-98b4-f3566e2ac93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:19.410803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f5d34-e0f3-44ce-98b4-f3566e2ac93e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:19.421932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1396/2799] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:19.426001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8750d68-60ea-4b7b-adec-a2cf6185a3de admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:19.436037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8750d68-60ea-4b7b-adec-a2cf6185a3de admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:19.440915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46c75d-93fe-499a-9d5b-3b3f678b54f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:19.441789 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46c75d-93fe-499a-9d5b-3b3f678b54f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:19.442071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46c75d-93fe-499a-9d5b-3b3f678b54f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:19.442346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46c75d-93fe-499a-9d5b-3b3f678b54f9 admin admin] PATH_INFO: `/v3/projects/4059025bd49a4159bc1da7edf66bd22d/users/f24cb2e0ff0b48f0a359ff06301ecc9d/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:19.444571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:19.459038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46c75d-93fe-499a-9d5b-3b3f678b54f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4059025bd49a4159bc1da7edf66bd22d, user_id=f24cb2e0ff0b48f0a359ff06301ecc9d, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:19.462433 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46c75d-93fe-499a-9d5b-3b3f678b54f9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:19.475346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1404/2800] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:19 2022] PUT /identity/v3/projects/4059025bd49a4159bc1da7edf66bd22d/users/f24cb2e0ff0b48f0a359ff06301ecc9d/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:19.479260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f5d34-e0f3-44ce-98b4-f3566e2ac93e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:19.489359 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f5d34-e0f3-44ce-98b4-f3566e2ac93e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:19.545650 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d8b97-d31f-4612-a534-699ee3b78ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:19.546289 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d8b97-d31f-4612-a534-699ee3b78ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:19.546516 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d8b97-d31f-4612-a534-699ee3b78ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:19.546796 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d8b97-d31f-4612-a534-699ee3b78ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:19.547531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d8b97-d31f-4612-a534-699ee3b78ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:19.549162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d8b97-d31f-4612-a534-699ee3b78ad3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:19.559358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1397/2801] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:19.563462 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46c75d-93fe-499a-9d5b-3b3f678b54f9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:19.573735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46c75d-93fe-499a-9d5b-3b3f678b54f9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:19.578367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592af8-0031-4926-957b-7cf00e71f07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:19.579242 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592af8-0031-4926-957b-7cf00e71f07f admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:19.579528 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592af8-0031-4926-957b-7cf00e71f07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:19.579804 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592af8-0031-4926-957b-7cf00e71f07f admin admin] PATH_INFO: `/v3/projects/4059025bd49a4159bc1da7edf66bd22d/users/f24cb2e0ff0b48f0a359ff06301ecc9d/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:19.581827 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac592af8-0031-4926-957b-7cf00e71f07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4059025bd49a4159bc1da7edf66bd22d, user_id=f24cb2e0ff0b48f0a359ff06301ecc9d, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:19.584406 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac592af8-0031-4926-957b-7cf00e71f07f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:19.594973 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1405/2802] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:19 2022] PUT /identity/v3/projects/4059025bd49a4159bc1da7edf66bd22d/users/f24cb2e0ff0b48f0a359ff06301ecc9d/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:19.605724 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa730b2-5a09-4821-804a-d3ade0232d57 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:19.606015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa730b2-5a09-4821-804a-d3ade0232d57 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:19.606293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa730b2-5a09-4821-804a-d3ade0232d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:19.625422 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:19.635062 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7fa730b2-5a09-4821-804a-d3ade0232d57 None None] MFA Rules not processed for user `f24cb2e0ff0b48f0a359ff06301ecc9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:19.636578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7fa730b2-5a09-4821-804a-d3ade0232d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:19.704070 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1398/2803] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:19.715733 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592af8-0031-4926-957b-7cf00e71f07f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:19.717446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ac592af8-0031-4926-957b-7cf00e71f07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:19.776189 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592af8-0031-4926-957b-7cf00e71f07f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:19.779870 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b248f-4703-47f9-b922-6860c07facf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:19.780504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b248f-4703-47f9-b922-6860c07facf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:19.780816 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b248f-4703-47f9-b922-6860c07facf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:19.781096 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b248f-4703-47f9-b922-6860c07facf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:19.837910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b248f-4703-47f9-b922-6860c07facf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:19.839263 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b248f-4703-47f9-b922-6860c07facf0 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:19.848131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1406/2804] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:21.359179 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa730b2-5a09-4821-804a-d3ade0232d57 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:21.368915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa730b2-5a09-4821-804a-d3ade0232d57 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:21.372483 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d39c0b-43dd-4270-a4f3-9f4ca1002e0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:21.373159 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d39c0b-43dd-4270-a4f3-9f4ca1002e0e service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:21.373474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d39c0b-43dd-4270-a4f3-9f4ca1002e0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:21.373760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d39c0b-43dd-4270-a4f3-9f4ca1002e0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:21.430964 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d39c0b-43dd-4270-a4f3-9f4ca1002e0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:21.432567 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d39c0b-43dd-4270-a4f3-9f4ca1002e0e service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:21.442676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1399/2805] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:21.982657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b248f-4703-47f9-b922-6860c07facf0 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:21.991345 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b248f-4703-47f9-b922-6860c07facf0 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:21.995115 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26fe0c-222f-4d17-87e4-60cc3f2031be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:21.995749 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26fe0c-222f-4d17-87e4-60cc3f2031be service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:21.996034 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26fe0c-222f-4d17-87e4-60cc3f2031be service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:21.996312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26fe0c-222f-4d17-87e4-60cc3f2031be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:22.005175 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26fe0c-222f-4d17-87e4-60cc3f2031be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:22.006593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26fe0c-222f-4d17-87e4-60cc3f2031be service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:22.016453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1407/2806] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:25.858387 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d39c0b-43dd-4270-a4f3-9f4ca1002e0e service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:25.923693 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d39c0b-43dd-4270-a4f3-9f4ca1002e0e service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:25.928195 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:25.929094 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:25.929377 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:25.929652 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] PATH_INFO: `/v3/users/828c767cd558404ab017d4df9eab6873` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:25.930833 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=828c767cd558404ab017d4df9eab6873)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:25.932823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:25.972048 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:25.982198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828c767cd558404ab017d4df9eab6873'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:25.982866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828c767cd558404ab017d4df9eab6873'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:25.983486 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828c767cd558404ab017d4df9eab6873'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:25.995237 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828c767cd558404ab017d4df9eab6873'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:26.002360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828c767cd558404ab017d4df9eab6873'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:26.016261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1400/2807] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:25 2022] DELETE /identity/v3/users/828c767cd558404ab017d4df9eab6873 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:26.021477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad580bed-4982-4ac5-ba7c-469676fb0030 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:26.021932 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad580bed-4982-4ac5-ba7c-469676fb0030 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:26.022102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad580bed-4982-4ac5-ba7c-469676fb0030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:26.042253 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-ad580bed-4982-4ac5-ba7c-469676fb0030 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:26.043615 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ad580bed-4982-4ac5-ba7c-469676fb0030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:26.103112 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1408/2808] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:26.112877 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:26.114319 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:26.173155 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda09685-1cc2-4111-adc9-f4e00d8a7fbf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:26.176824 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c91d23-ed05-4988-b40b-652617c18e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:26.177468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c91d23-ed05-4988-b40b-652617c18e5b service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:26.177751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c91d23-ed05-4988-b40b-652617c18e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:26.178032 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c91d23-ed05-4988-b40b-652617c18e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:26.187433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c91d23-ed05-4988-b40b-652617c18e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:26.188921 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c91d23-ed05-4988-b40b-652617c18e5b service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:26.200120 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1401/2809] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:26.473301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad580bed-4982-4ac5-ba7c-469676fb0030 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:26.474750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ad580bed-4982-4ac5-ba7c-469676fb0030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:26.487435 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad580bed-4982-4ac5-ba7c-469676fb0030 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:26.492158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:26.493070 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:26.493361 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:26.493641 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] PATH_INFO: `/v3/projects/020bfef58469462ea466c747b8159a8f` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:26.494901 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=020bfef58469462ea466c747b8159a8f)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:26.497679 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:26.504526 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:26.555162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020bfef58469462ea466c747b8159a8f', 'request_id': 'req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:26.564041 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020bfef58469462ea466c747b8159a8f', 'request_id': 'req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:26.570775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020bfef58469462ea466c747b8159a8f', 'request_id': 'req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:26.581813 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] The token cache is being invalidate because project 020bfef58469462ea466c747b8159a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:26.582107 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:26.582764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:26.584306 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1409/2810] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:26 2022] DELETE /identity/v3/projects/020bfef58469462ea466c747b8159a8f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:26.588273 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c91d23-ed05-4988-b40b-652617c18e5b service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:26.598482 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c91d23-ed05-4988-b40b-652617c18e5b service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:26.657780 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:26.658648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:26.658971 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:26.659260 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] PATH_INFO: `/v3/users/dab1bab08d824c149db11b47279b2dc2` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:26.660441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab1bab08d824c149db11b47279b2dc2)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:26.662452 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:26.710705 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab1bab08d824c149db11b47279b2dc2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:26.711505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab1bab08d824c149db11b47279b2dc2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:26.712473 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab1bab08d824c149db11b47279b2dc2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:26.723302 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:26.732397 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab1bab08d824c149db11b47279b2dc2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:26.743255 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab1bab08d824c149db11b47279b2dc2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:26.759142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1402/2811] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:26 2022] DELETE /identity/v3/users/dab1bab08d824c149db11b47279b2dc2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:27.062629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:27.064548 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:27.084308 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddf01c-a12d-4f33-9efa-8e6d36d59a34 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:27.166137 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:27.167015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:27.167300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:27.167579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] PATH_INFO: `/v3/projects/860a26fa8c19481d8cc0535c2b9082b2` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:27.169203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] RBAC: Authorizing `identity:delete_project(project_id=860a26fa8c19481d8cc0535c2b9082b2)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:27.171202 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:27.229383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860a26fa8c19481d8cc0535c2b9082b2', 'request_id': 'req-ea1a929d-43e0-4249-8383-a66d671c159f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.239255 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860a26fa8c19481d8cc0535c2b9082b2', 'request_id': 'req-ea1a929d-43e0-4249-8383-a66d671c159f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.246879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860a26fa8c19481d8cc0535c2b9082b2', 'request_id': 'req-ea1a929d-43e0-4249-8383-a66d671c159f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.257895 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] The token cache is being invalidate because project 860a26fa8c19481d8cc0535c2b9082b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:27.258194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.258859 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.260649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1410/2812] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:27 2022] DELETE /identity/v3/projects/860a26fa8c19481d8cc0535c2b9082b2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:27.264484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:27.266036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:27.286588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c49a7-36ed-4f67-9f1a-599bea903bd6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:27.346242 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:27.347077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:27.347371 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:27.347718 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] PATH_INFO: `/v3/users/f24cb2e0ff0b48f0a359ff06301ecc9d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:27.348924 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24cb2e0ff0b48f0a359ff06301ecc9d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:27.350870 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:27.403461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24cb2e0ff0b48f0a359ff06301ecc9d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.404292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24cb2e0ff0b48f0a359ff06301ecc9d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.405056 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24cb2e0ff0b48f0a359ff06301ecc9d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.420432 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24cb2e0ff0b48f0a359ff06301ecc9d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.428212 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24cb2e0ff0b48f0a359ff06301ecc9d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.448142 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1403/2813] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:27 2022] DELETE /identity/v3/users/f24cb2e0ff0b48f0a359ff06301ecc9d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:27.736671 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:27.738369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:27.752564 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a929d-43e0-4249-8383-a66d671c159f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:27.760088 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:27.761742 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:27.785695 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:27.827913 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fddd5d-3261-4d6d-958a-bd48f35532c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:27.828949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fddd5d-3261-4d6d-958a-bd48f35532c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:27.829298 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fddd5d-3261-4d6d-958a-bd48f35532c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:27.829647 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fddd5d-3261-4d6d-958a-bd48f35532c6 admin admin] PATH_INFO: `/v3/projects/4059025bd49a4159bc1da7edf66bd22d` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:27.830925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fddd5d-3261-4d6d-958a-bd48f35532c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4059025bd49a4159bc1da7edf66bd22d)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:27.832940 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fddd5d-3261-4d6d-958a-bd48f35532c6 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:27.833555 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:27.840565 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fb7ae-4d38-4a5b-af3e-75befff99de6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:27.847127 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f57050-2a8f-470f-a514-b6e51a8bf90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:27.847972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f57050-2a8f-470f-a514-b6e51a8bf90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:27.848273 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f57050-2a8f-470f-a514-b6e51a8bf90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:27.848571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f57050-2a8f-470f-a514-b6e51a8bf90f admin admin] PATH_INFO: `/v3/users/993cc8b1c88148bf97ab3b42e85861de` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:27.849829 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f57050-2a8f-470f-a514-b6e51a8bf90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=993cc8b1c88148bf97ab3b42e85861de)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:27.851834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f57050-2a8f-470f-a514-b6e51a8bf90f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:27.888891 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-78fddd5d-3261-4d6d-958a-bd48f35532c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4059025bd49a4159bc1da7edf66bd22d', 'request_id': 'req-78fddd5d-3261-4d6d-958a-bd48f35532c6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.897459 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-78fddd5d-3261-4d6d-958a-bd48f35532c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4059025bd49a4159bc1da7edf66bd22d', 'request_id': 'req-78fddd5d-3261-4d6d-958a-bd48f35532c6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.904578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-78fddd5d-3261-4d6d-958a-bd48f35532c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4059025bd49a4159bc1da7edf66bd22d', 'request_id': 'req-78fddd5d-3261-4d6d-958a-bd48f35532c6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.912451 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-79f57050-2a8f-470f-a514-b6e51a8bf90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993cc8b1c88148bf97ab3b42e85861de'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.913158 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-79f57050-2a8f-470f-a514-b6e51a8bf90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993cc8b1c88148bf97ab3b42e85861de'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.913770 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-79f57050-2a8f-470f-a514-b6e51a8bf90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993cc8b1c88148bf97ab3b42e85861de'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.915229 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-78fddd5d-3261-4d6d-958a-bd48f35532c6 admin admin] The token cache is being invalidate because project 4059025bd49a4159bc1da7edf66bd22d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:27.915806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-78fddd5d-3261-4d6d-958a-bd48f35532c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.916214 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-78fddd5d-3261-4d6d-958a-bd48f35532c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.918134 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1411/2814] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:27 2022] DELETE /identity/v3/projects/4059025bd49a4159bc1da7edf66bd22d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:27.922876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec1ec7-6c0c-409f-baa1-94c05e11207e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:27.923215 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec1ec7-6c0c-409f-baa1-94c05e11207e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:27.923494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec1ec7-6c0c-409f-baa1-94c05e11207e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:27.926594 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-79f57050-2a8f-470f-a514-b6e51a8bf90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993cc8b1c88148bf97ab3b42e85861de'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.934247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-79f57050-2a8f-470f-a514-b6e51a8bf90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993cc8b1c88148bf97ab3b42e85861de'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:27.943892 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-88ec1ec7-6c0c-409f-baa1-94c05e11207e None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:27.945251 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-88ec1ec7-6c0c-409f-baa1-94c05e11207e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:27.947378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1404/2815] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:27 2022] DELETE /identity/v3/users/993cc8b1c88148bf97ab3b42e85861de => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:28.008848 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1412/2816] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:28.017077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8218a-1762-4f3c-a3c4-b18c910abc26 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.017417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8218a-1762-4f3c-a3c4-b18c910abc26 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.017723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8218a-1762-4f3c-a3c4-b18c910abc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.037333 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c7e8218a-1762-4f3c-a3c4-b18c910abc26 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:28.038630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c7e8218a-1762-4f3c-a3c4-b18c910abc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:28.048536 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1405/2817] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:28.052636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec1ec7-6c0c-409f-baa1-94c05e11207e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:28.063210 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec1ec7-6c0c-409f-baa1-94c05e11207e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:28.067993 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe24af-28c9-4f91-aecd-4e651578ae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:28.068660 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe24af-28c9-4f91-aecd-4e651578ae45 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.068991 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe24af-28c9-4f91-aecd-4e651578ae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.069270 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe24af-28c9-4f91-aecd-4e651578ae45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.070001 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe24af-28c9-4f91-aecd-4e651578ae45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:28.070309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe24af-28c9-4f91-aecd-4e651578ae45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:28.071908 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe24af-28c9-4f91-aecd-4e651578ae45 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:28.084296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1413/2818] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:28.088312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8218a-1762-4f3c-a3c4-b18c910abc26 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:28.098500 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8218a-1762-4f3c-a3c4-b18c910abc26 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:28.103057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b66175-08ce-4264-b983-f8aa00280a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:28.103712 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66175-08ce-4264-b983-f8aa00280a81 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.104244 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66175-08ce-4264-b983-f8aa00280a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.104244 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b66175-08ce-4264-b983-f8aa00280a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.105098 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b66175-08ce-4264-b983-f8aa00280a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:28.108553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b66175-08ce-4264-b983-f8aa00280a81 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:28.135525 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe24af-28c9-4f91-aecd-4e651578ae45 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:28.138839 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-d4fe24af-28c9-4f91-aecd-4e651578ae45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:28.142682 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1406/2819] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:28 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:28.148620 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b66175-08ce-4264-b983-f8aa00280a81 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:28.156900 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe24af-28c9-4f91-aecd-4e651578ae45 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:28.209587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:28.214249 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b66175-08ce-4264-b983-f8aa00280a81 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:28.220463 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e91102-b25c-4fb1-bf46-b8f94e1c956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:28.221107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e91102-b25c-4fb1-bf46-b8f94e1c956a admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.221390 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e91102-b25c-4fb1-bf46-b8f94e1c956a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.221667 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e91102-b25c-4fb1-bf46-b8f94e1c956a admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.222360 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e91102-b25c-4fb1-bf46-b8f94e1c956a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:28.224297 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e91102-b25c-4fb1-bf46-b8f94e1c956a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:28.228586 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:28.229487 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.229765 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.230037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] PATH_INFO: `/v3/projects/788f021f4e6c4a328644c9f8fe78092e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.231865 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=788f021f4e6c4a328644c9f8fe78092e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:28.233816 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:28.247493 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1407/2820] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:28 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:28.251528 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e91102-b25c-4fb1-bf46-b8f94e1c956a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:28.261468 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e91102-b25c-4fb1-bf46-b8f94e1c956a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:28.266672 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a78fd5-27d9-4fcb-a210-0be56874c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:28.267422 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a78fd5-27d9-4fcb-a210-0be56874c692 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.267769 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a78fd5-27d9-4fcb-a210-0be56874c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.268103 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a78fd5-27d9-4fcb-a210-0be56874c692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.269090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a78fd5-27d9-4fcb-a210-0be56874c692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:28.271183 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a78fd5-27d9-4fcb-a210-0be56874c692 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:28.281525 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1408/2821] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:45:28.285373 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a78fd5-27d9-4fcb-a210-0be56874c692 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:28.292043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '788f021f4e6c4a328644c9f8fe78092e', 'request_id': 'req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.295623 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a78fd5-27d9-4fcb-a210-0be56874c692 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:28.300387 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '788f021f4e6c4a328644c9f8fe78092e', 'request_id': 'req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.306806 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '788f021f4e6c4a328644c9f8fe78092e', 'request_id': 'req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.318123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] The token cache is being invalidate because project 788f021f4e6c4a328644c9f8fe78092e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:28.318410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.318809 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:28.319296 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.321478 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1414/2822] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:28 2022] DELETE /identity/v3/projects/788f021f4e6c4a328644c9f8fe78092e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:28.325527 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:28.326963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:28.360632 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79804f7e-d055-4c53-ba25-65fa699dd973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:28.361247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804f7e-d055-4c53-ba25-65fa699dd973 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.361653 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804f7e-d055-4c53-ba25-65fa699dd973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.361945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79804f7e-d055-4c53-ba25-65fa699dd973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.362687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79804f7e-d055-4c53-ba25-65fa699dd973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:28.364286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79804f7e-d055-4c53-ba25-65fa699dd973 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:28.374396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1409/2823] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:45:28.378540 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79804f7e-d055-4c53-ba25-65fa699dd973 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:28.380194 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-79804f7e-d055-4c53-ba25-65fa699dd973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:28.392570 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79804f7e-d055-4c53-ba25-65fa699dd973 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:28.396243 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfb7a2-1084-4e3c-8018-8d6b9f067e8f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:28.397671 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c42eaa-12b6-4605-a490-7e2111b108ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:28.398578 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c42eaa-12b6-4605-a490-7e2111b108ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.398867 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c42eaa-12b6-4605-a490-7e2111b108ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.399148 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c42eaa-12b6-4605-a490-7e2111b108ee admin admin] PATH_INFO: `/v3/projects/6113ad5a21fa49d6906e26db6cf348a3/users/3c4e48e94f934a3baf6a09a2b2d8f85d/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.401058 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:28.402111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.402916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.403198 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] PATH_INFO: `/v3/users/62568b5a812d46ab8adc7c90ac99f283` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.404620 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=62568b5a812d46ab8adc7c90ac99f283)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:28.406596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:28.416288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c42eaa-12b6-4605-a490-7e2111b108ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6113ad5a21fa49d6906e26db6cf348a3, user_id=3c4e48e94f934a3baf6a09a2b2d8f85d, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:28.419966 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c42eaa-12b6-4605-a490-7e2111b108ee admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:28.434220 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1410/2824] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:28 2022] PUT /identity/v3/projects/6113ad5a21fa49d6906e26db6cf348a3/users/3c4e48e94f934a3baf6a09a2b2d8f85d/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:28.439341 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c2298-92d9-46c5-8b98-0e163f97510d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.439625 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c2298-92d9-46c5-8b98-0e163f97510d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.439913 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c2298-92d9-46c5-8b98-0e163f97510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.462668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62568b5a812d46ab8adc7c90ac99f283'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.463465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62568b5a812d46ab8adc7c90ac99f283'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.464222 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-470c2298-92d9-46c5-8b98-0e163f97510d None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:28.464419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62568b5a812d46ab8adc7c90ac99f283'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.465475 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-470c2298-92d9-46c5-8b98-0e163f97510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:28.480019 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62568b5a812d46ab8adc7c90ac99f283'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.488215 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62568b5a812d46ab8adc7c90ac99f283'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.489975 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:28.506388 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1415/2825] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:28 2022] DELETE /identity/v3/users/62568b5a812d46ab8adc7c90ac99f283 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:45:28.533781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1411/2826] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:28.545346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:28.546828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:28.610601 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89209d8d-b1e3-42ad-ae3c-b90cbeb7d2ac admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:28.615055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e124c6-51c9-4fb7-9b26-69e87bef4ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:28.615764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e124c6-51c9-4fb7-9b26-69e87bef4ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.616055 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e124c6-51c9-4fb7-9b26-69e87bef4ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.616801 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e124c6-51c9-4fb7-9b26-69e87bef4ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.687485 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e124c6-51c9-4fb7-9b26-69e87bef4ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:28.688976 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e124c6-51c9-4fb7-9b26-69e87bef4ff0 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:28.701327 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1416/2827] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:28.702537 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c2298-92d9-46c5-8b98-0e163f97510d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:28.704535 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-470c2298-92d9-46c5-8b98-0e163f97510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:28.717737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c2298-92d9-46c5-8b98-0e163f97510d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:28.723641 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01534557-2d9f-4167-bd2a-139084fd1305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:28.724795 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01534557-2d9f-4167-bd2a-139084fd1305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.725122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01534557-2d9f-4167-bd2a-139084fd1305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.725524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01534557-2d9f-4167-bd2a-139084fd1305 admin admin] PATH_INFO: `/v3/projects/f4d677bea75b436c8689049019811823` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.727305 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01534557-2d9f-4167-bd2a-139084fd1305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d677bea75b436c8689049019811823)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:28.729337 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01534557-2d9f-4167-bd2a-139084fd1305 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:28.781933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-01534557-2d9f-4167-bd2a-139084fd1305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d677bea75b436c8689049019811823', 'request_id': 'req-01534557-2d9f-4167-bd2a-139084fd1305'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.789588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-01534557-2d9f-4167-bd2a-139084fd1305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d677bea75b436c8689049019811823', 'request_id': 'req-01534557-2d9f-4167-bd2a-139084fd1305'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.797521 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-01534557-2d9f-4167-bd2a-139084fd1305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d677bea75b436c8689049019811823', 'request_id': 'req-01534557-2d9f-4167-bd2a-139084fd1305'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.808826 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-01534557-2d9f-4167-bd2a-139084fd1305 admin admin] The token cache is being invalidate because project f4d677bea75b436c8689049019811823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:28.810117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-01534557-2d9f-4167-bd2a-139084fd1305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.810859 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-01534557-2d9f-4167-bd2a-139084fd1305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:28.812514 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1412/2828] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:28 2022] DELETE /identity/v3/projects/f4d677bea75b436c8689049019811823 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:28.817545 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba52cfd-9b71-4ddc-87ec-d7603b2e5541 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.817908 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba52cfd-9b71-4ddc-87ec-d7603b2e5541 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.818299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba52cfd-9b71-4ddc-87ec-d7603b2e5541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.837351 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fba52cfd-9b71-4ddc-87ec-d7603b2e5541 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:28.838598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fba52cfd-9b71-4ddc-87ec-d7603b2e5541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:28.915312 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1417/2829] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:28.923239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9db5b-316e-40d7-ab88-70df264494d0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.923524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9db5b-316e-40d7-ab88-70df264494d0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.923852 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9db5b-316e-40d7-ab88-70df264494d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.945028 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-83f9db5b-316e-40d7-ab88-70df264494d0 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:28.946322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-83f9db5b-316e-40d7-ab88-70df264494d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:28.957001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1413/2830] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:28.959770 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba52cfd-9b71-4ddc-87ec-d7603b2e5541 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:28.970006 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba52cfd-9b71-4ddc-87ec-d7603b2e5541 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:28.975959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c632d6-4ef6-41da-b1d4-c48a29f74ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:28.976603 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c632d6-4ef6-41da-b1d4-c48a29f74ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:28.976916 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c632d6-4ef6-41da-b1d4-c48a29f74ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:28.977200 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c632d6-4ef6-41da-b1d4-c48a29f74ceb admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:28.977942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c632d6-4ef6-41da-b1d4-c48a29f74ceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:28.978265 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c632d6-4ef6-41da-b1d4-c48a29f74ceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:28.979864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c632d6-4ef6-41da-b1d4-c48a29f74ceb admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:28.996798 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1418/2831] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:28.998819 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9db5b-316e-40d7-ab88-70df264494d0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:29.008211 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9db5b-316e-40d7-ab88-70df264494d0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:29.013230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7de93-c3b4-4f7b-a17f-a8c934cacc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:29.013890 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7de93-c3b4-4f7b-a17f-a8c934cacc0f admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:29.014173 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7de93-c3b4-4f7b-a17f-a8c934cacc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:29.014457 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7de93-c3b4-4f7b-a17f-a8c934cacc0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:29.015153 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7de93-c3b4-4f7b-a17f-a8c934cacc0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:29.017092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7de93-c3b4-4f7b-a17f-a8c934cacc0f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:29.029304 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:29.061039 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1414/2832] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:28 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:29.062227 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c632d6-4ef6-41da-b1d4-c48a29f74ceb admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:29.073579 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c632d6-4ef6-41da-b1d4-c48a29f74ceb admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:29.107079 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:29.146483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725786d9-a1fe-4751-b41d-3cca4319737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:29.147331 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725786d9-a1fe-4751-b41d-3cca4319737c admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:29.147694 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725786d9-a1fe-4751-b41d-3cca4319737c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:29.148056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725786d9-a1fe-4751-b41d-3cca4319737c admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:29.148898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725786d9-a1fe-4751-b41d-3cca4319737c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:29.150985 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725786d9-a1fe-4751-b41d-3cca4319737c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:29.179867 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1419/2833] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:29 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:29.181479 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7de93-c3b4-4f7b-a17f-a8c934cacc0f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:29.194974 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7de93-c3b4-4f7b-a17f-a8c934cacc0f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:29.200292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c21402-2f6c-43f0-9cd2-fcb890f19140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:29.201233 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c21402-2f6c-43f0-9cd2-fcb890f19140 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:29.201627 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c21402-2f6c-43f0-9cd2-fcb890f19140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:29.202071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c21402-2f6c-43f0-9cd2-fcb890f19140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:29.202934 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c21402-2f6c-43f0-9cd2-fcb890f19140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:29.204948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c21402-2f6c-43f0-9cd2-fcb890f19140 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:29.220380 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1415/2834] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:29.221947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725786d9-a1fe-4751-b41d-3cca4319737c admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:29.234305 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725786d9-a1fe-4751-b41d-3cca4319737c admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:29.240328 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fedabb-2cb8-49f7-9994-173b43f6e931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:29.241159 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fedabb-2cb8-49f7-9994-173b43f6e931 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:29.241449 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fedabb-2cb8-49f7-9994-173b43f6e931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:29.241735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fedabb-2cb8-49f7-9994-173b43f6e931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:29.242632 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fedabb-2cb8-49f7-9994-173b43f6e931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:29.244997 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fedabb-2cb8-49f7-9994-173b43f6e931 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:29.260981 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1420/2835] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:29.265051 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c21402-2f6c-43f0-9cd2-fcb890f19140 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:29.278257 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c21402-2f6c-43f0-9cd2-fcb890f19140 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:29.284141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d5695-b20f-4873-b252-43f139b430e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:29.285336 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d5695-b20f-4873-b252-43f139b430e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:29.285633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d5695-b20f-4873-b252-43f139b430e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:29.285923 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d5695-b20f-4873-b252-43f139b430e5 admin admin] PATH_INFO: `/v3/projects/e4425095a49e44ce8e9bbb08fe74a561/users/a573ca391709417cb2b514f3823cddf6/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:29.304113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d5695-b20f-4873-b252-43f139b430e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4425095a49e44ce8e9bbb08fe74a561, user_id=a573ca391709417cb2b514f3823cddf6, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:29.306918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d5695-b20f-4873-b252-43f139b430e5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:29.323409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1416/2836] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:29 2022] PUT /identity/v3/projects/e4425095a49e44ce8e9bbb08fe74a561/users/a573ca391709417cb2b514f3823cddf6/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:29.335369 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503faca4-3e22-43f5-a1b2-24fc79d954b0 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:29.335773 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503faca4-3e22-43f5-a1b2-24fc79d954b0 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:29.336162 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503faca4-3e22-43f5-a1b2-24fc79d954b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:29.369863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-503faca4-3e22-43f5-a1b2-24fc79d954b0 None None] MFA Rules not processed for user `a573ca391709417cb2b514f3823cddf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:29.371731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-503faca4-3e22-43f5-a1b2-24fc79d954b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:29.472902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1421/2837] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:29.473701 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d5695-b20f-4873-b252-43f139b430e5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:29.566185 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d5695-b20f-4873-b252-43f139b430e5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:29.572740 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6180a8d-7227-49a7-b0b6-c1a20dcb3e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:29.575013 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6180a8d-7227-49a7-b0b6-c1a20dcb3e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:29.575013 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6180a8d-7227-49a7-b0b6-c1a20dcb3e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:29.575013 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6180a8d-7227-49a7-b0b6-c1a20dcb3e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:29.575487 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6180a8d-7227-49a7-b0b6-c1a20dcb3e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:29.577206 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6180a8d-7227-49a7-b0b6-c1a20dcb3e05 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:29.614834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1417/2838] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:29 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:29.616803 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503faca4-3e22-43f5-a1b2-24fc79d954b0 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:29.627967 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503faca4-3e22-43f5-a1b2-24fc79d954b0 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:29.690346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3dad0-3cc6-4be9-afa0-ccffbe847c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:29.691028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3dad0-3cc6-4be9-afa0-ccffbe847c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:29.691453 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3dad0-3cc6-4be9-afa0-ccffbe847c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:29.691740 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3dad0-3cc6-4be9-afa0-ccffbe847c18 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:29.692464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3dad0-3cc6-4be9-afa0-ccffbe847c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:29.694407 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3dad0-3cc6-4be9-afa0-ccffbe847c18 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:29.719071 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1422/2839] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:29 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:29.723929 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6180a8d-7227-49a7-b0b6-c1a20dcb3e05 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:29.735871 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6180a8d-7227-49a7-b0b6-c1a20dcb3e05 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:29.741413 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1af47-6a4a-422c-b7b6-4d0e9b81ce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:29.742095 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1af47-6a4a-422c-b7b6-4d0e9b81ce85 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:29.742381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1af47-6a4a-422c-b7b6-4d0e9b81ce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:29.742702 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1af47-6a4a-422c-b7b6-4d0e9b81ce85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:29.743402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1af47-6a4a-422c-b7b6-4d0e9b81ce85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:29.745046 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1af47-6a4a-422c-b7b6-4d0e9b81ce85 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:29.757410 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1418/2840] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:29.761570 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3dad0-3cc6-4be9-afa0-ccffbe847c18 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:29.773421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3dad0-3cc6-4be9-afa0-ccffbe847c18 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:29.779146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b76c00-3d2b-428c-93a7-d54642cc072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:29.779949 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b76c00-3d2b-428c-93a7-d54642cc072c admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:29.780346 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b76c00-3d2b-428c-93a7-d54642cc072c admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:29.780748 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b76c00-3d2b-428c-93a7-d54642cc072c admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:29.781750 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b76c00-3d2b-428c-93a7-d54642cc072c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:29.783468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b76c00-3d2b-428c-93a7-d54642cc072c admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:29.795424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1423/2841] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:29.799699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1af47-6a4a-422c-b7b6-4d0e9b81ce85 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:29.810881 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1af47-6a4a-422c-b7b6-4d0e9b81ce85 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:29.816409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bad68c-b1b6-4582-947f-faaf8502a821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:29.817346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bad68c-b1b6-4582-947f-faaf8502a821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:29.817646 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bad68c-b1b6-4582-947f-faaf8502a821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:29.817903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bad68c-b1b6-4582-947f-faaf8502a821 admin admin] PATH_INFO: `/v3/projects/9e4f9f0f9ed94d0a8f8c1fc59e264014/users/62cdad6db47e43c6936a4b5ce8a5a46b/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:29.835207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bad68c-b1b6-4582-947f-faaf8502a821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e4f9f0f9ed94d0a8f8c1fc59e264014, user_id=62cdad6db47e43c6936a4b5ce8a5a46b, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:29.838866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bad68c-b1b6-4582-947f-faaf8502a821 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:29.857461 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1419/2842] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:29 2022] PUT /identity/v3/projects/9e4f9f0f9ed94d0a8f8c1fc59e264014/users/62cdad6db47e43c6936a4b5ce8a5a46b/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:29.867507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78f727-048a-470d-a3f1-1af04c6e6c2e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:29.867792 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78f727-048a-470d-a3f1-1af04c6e6c2e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:29.868068 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78f727-048a-470d-a3f1-1af04c6e6c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:29.902223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fb78f727-048a-470d-a3f1-1af04c6e6c2e None None] MFA Rules not processed for user `62cdad6db47e43c6936a4b5ce8a5a46b`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:29.904231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fb78f727-048a-470d-a3f1-1af04c6e6c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:29.909315 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:29.990113 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1424/2843] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:29.994197 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bad68c-b1b6-4582-947f-faaf8502a821 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:30.063669 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bad68c-b1b6-4582-947f-faaf8502a821 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:30.068698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2533efb-04f4-4c6b-8be9-98a9b5ef1952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:30.069417 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2533efb-04f4-4c6b-8be9-98a9b5ef1952 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:30.069699 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2533efb-04f4-4c6b-8be9-98a9b5ef1952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:30.070090 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2533efb-04f4-4c6b-8be9-98a9b5ef1952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:30.070803 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2533efb-04f4-4c6b-8be9-98a9b5ef1952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:30.072706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2533efb-04f4-4c6b-8be9-98a9b5ef1952 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:30.083174 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:30.111047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1420/2844] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:29 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:30.113219 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78f727-048a-470d-a3f1-1af04c6e6c2e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:30.125240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78f727-048a-470d-a3f1-1af04c6e6c2e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:30.205268 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e4d9b-1546-4664-adb6-fd6f6c6003cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:30.206084 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e4d9b-1546-4664-adb6-fd6f6c6003cb admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:30.206469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e4d9b-1546-4664-adb6-fd6f6c6003cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:30.206844 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e4d9b-1546-4664-adb6-fd6f6c6003cb admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:30.207659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e4d9b-1546-4664-adb6-fd6f6c6003cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:30.209716 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e4d9b-1546-4664-adb6-fd6f6c6003cb admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:30.233629 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1425/2845] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:30 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:30.237346 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2533efb-04f4-4c6b-8be9-98a9b5ef1952 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:30.249215 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2533efb-04f4-4c6b-8be9-98a9b5ef1952 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:30.255354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729584d9-8827-4c1f-ba7f-5c9af9612299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:30.256111 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729584d9-8827-4c1f-ba7f-5c9af9612299 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:30.256474 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729584d9-8827-4c1f-ba7f-5c9af9612299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:30.256857 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729584d9-8827-4c1f-ba7f-5c9af9612299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:30.257698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729584d9-8827-4c1f-ba7f-5c9af9612299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:30.259383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729584d9-8827-4c1f-ba7f-5c9af9612299 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:30.272031 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1421/2846] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:30.276465 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e4d9b-1546-4664-adb6-fd6f6c6003cb admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:30.290578 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e4d9b-1546-4664-adb6-fd6f6c6003cb admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:30.296952 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34c8d4-28fa-4e4b-9172-31fc3b1bf7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:30.298038 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34c8d4-28fa-4e4b-9172-31fc3b1bf7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:30.298386 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34c8d4-28fa-4e4b-9172-31fc3b1bf7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:30.298895 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34c8d4-28fa-4e4b-9172-31fc3b1bf7dd admin admin] PATH_INFO: `/v3/projects/aeeb3b92c7fd4914865153cfbff52498/users/8c51053f86ba4f459b72fc38b90349ef/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:30.316565 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34c8d4-28fa-4e4b-9172-31fc3b1bf7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeeb3b92c7fd4914865153cfbff52498, user_id=8c51053f86ba4f459b72fc38b90349ef, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:30.319928 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34c8d4-28fa-4e4b-9172-31fc3b1bf7dd admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:30.337882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1426/2847] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:30 2022] PUT /identity/v3/projects/aeeb3b92c7fd4914865153cfbff52498/users/8c51053f86ba4f459b72fc38b90349ef/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:30.342601 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729584d9-8827-4c1f-ba7f-5c9af9612299 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:30.353726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729584d9-8827-4c1f-ba7f-5c9af9612299 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:30.443872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa32cc-054c-43c3-800a-fec3bec15ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:30.444746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa32cc-054c-43c3-800a-fec3bec15ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:30.445092 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa32cc-054c-43c3-800a-fec3bec15ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:30.445441 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa32cc-054c-43c3-800a-fec3bec15ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:30.446196 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa32cc-054c-43c3-800a-fec3bec15ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:30.447858 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa32cc-054c-43c3-800a-fec3bec15ff7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:30.463277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1422/2848] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:30.467876 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34c8d4-28fa-4e4b-9172-31fc3b1bf7dd admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:30.479507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34c8d4-28fa-4e4b-9172-31fc3b1bf7dd admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:30.485153 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237a328-58fa-43c5-bd06-4809f6228eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:30.486069 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a328-58fa-43c5-bd06-4809f6228eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:30.486491 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a328-58fa-43c5-bd06-4809f6228eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:30.486803 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a328-58fa-43c5-bd06-4809f6228eb9 admin admin] PATH_INFO: `/v3/projects/aeeb3b92c7fd4914865153cfbff52498/users/8c51053f86ba4f459b72fc38b90349ef/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:30.488892 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237a328-58fa-43c5-bd06-4809f6228eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeeb3b92c7fd4914865153cfbff52498, user_id=8c51053f86ba4f459b72fc38b90349ef, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:30.491531 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237a328-58fa-43c5-bd06-4809f6228eb9 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:30.505507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1427/2849] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:30 2022] PUT /identity/v3/projects/aeeb3b92c7fd4914865153cfbff52498/users/8c51053f86ba4f459b72fc38b90349ef/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:30.516023 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c7829-d974-4a2e-ae75-7c1ded16d25f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:30.516317 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c7829-d974-4a2e-ae75-7c1ded16d25f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:30.516600 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c7829-d974-4a2e-ae75-7c1ded16d25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:30.546692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4d4c7829-d974-4a2e-ae75-7c1ded16d25f None None] MFA Rules not processed for user `8c51053f86ba4f459b72fc38b90349ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:30.548163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4d4c7829-d974-4a2e-ae75-7c1ded16d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:30.622899 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1423/2850] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:30.635266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237a328-58fa-43c5-bd06-4809f6228eb9 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:30.637440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-2237a328-58fa-43c5-bd06-4809f6228eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:30.726172 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237a328-58fa-43c5-bd06-4809f6228eb9 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:30.733880 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8a943-8998-4c3b-8a7b-5435d2d71fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:30.734555 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8a943-8998-4c3b-8a7b-5435d2d71fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:30.734846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8a943-8998-4c3b-8a7b-5435d2d71fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:30.735129 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8a943-8998-4c3b-8a7b-5435d2d71fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:30.748126 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:30.813464 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8a943-8998-4c3b-8a7b-5435d2d71fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:30.815099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8a943-8998-4c3b-8a7b-5435d2d71fa2 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:30.826143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1428/2851] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:32.440235 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c7829-d974-4a2e-ae75-7c1ded16d25f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:32.442312 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4d4c7829-d974-4a2e-ae75-7c1ded16d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:32.455354 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c7829-d974-4a2e-ae75-7c1ded16d25f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:32.461278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f9389-9064-446b-af16-9967cdb47b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:32.462460 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f9389-9064-446b-af16-9967cdb47b8c service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:32.463034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f9389-9064-446b-af16-9967cdb47b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:32.464113 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f9389-9064-446b-af16-9967cdb47b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:32.549321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f9389-9064-446b-af16-9967cdb47b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:32.550854 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f9389-9064-446b-af16-9967cdb47b8c service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:32.556434 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:32.580765 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1424/2852] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:33.257653 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8a943-8998-4c3b-8a7b-5435d2d71fa2 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:33.270119 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8a943-8998-4c3b-8a7b-5435d2d71fa2 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:33.274669 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6db611-fc51-406e-bf22-26eba78c7948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:33.275406 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6db611-fc51-406e-bf22-26eba78c7948 service cinder] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:33.275700 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6db611-fc51-406e-bf22-26eba78c7948 service cinder] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:33.275983 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6db611-fc51-406e-bf22-26eba78c7948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:33.286424 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6db611-fc51-406e-bf22-26eba78c7948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:33.287914 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6db611-fc51-406e-bf22-26eba78c7948 service cinder] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:33.299993 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1429/2853] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:33.632091 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351173a-3a5a-4b00-877e-d7bcf7316e13 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:33.633639 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351173a-3a5a-4b00-877e-d7bcf7316e13 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:33.633910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351173a-3a5a-4b00-877e-d7bcf7316e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:33.665927 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a351173a-3a5a-4b00-877e-d7bcf7316e13 None None] MFA Rules not processed for user `3c4e48e94f934a3baf6a09a2b2d8f85d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:33.667169 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a351173a-3a5a-4b00-877e-d7bcf7316e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:33.742842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1425/2854] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:33.748429 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6db611-fc51-406e-bf22-26eba78c7948 service cinder] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:33.750063 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-5c6db611-fc51-406e-bf22-26eba78c7948 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:33.849676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6db611-fc51-406e-bf22-26eba78c7948 service cinder] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:33.854387 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869c714-481e-4ccc-b674-f3a506e1cc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:33.855064 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869c714-481e-4ccc-b674-f3a506e1cc8f admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:33.855350 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869c714-481e-4ccc-b674-f3a506e1cc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:33.856194 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0869c714-481e-4ccc-b674-f3a506e1cc8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:33.856983 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869c714-481e-4ccc-b674-f3a506e1cc8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:33.858979 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0869c714-481e-4ccc-b674-f3a506e1cc8f admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:33.888902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1430/2855] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:33 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:33.893011 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351173a-3a5a-4b00-877e-d7bcf7316e13 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:33.905203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351173a-3a5a-4b00-877e-d7bcf7316e13 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:33.966542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1925d-fc0a-459c-bab9-a46b2ced8368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:33.967230 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1925d-fc0a-459c-bab9-a46b2ced8368 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:33.967527 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1925d-fc0a-459c-bab9-a46b2ced8368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:33.967826 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1925d-fc0a-459c-bab9-a46b2ced8368 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:33.968553 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1925d-fc0a-459c-bab9-a46b2ced8368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:33.970545 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1925d-fc0a-459c-bab9-a46b2ced8368 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:33.992996 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1426/2856] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:33 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:33.996902 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869c714-481e-4ccc-b674-f3a506e1cc8f admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:34.007673 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0869c714-481e-4ccc-b674-f3a506e1cc8f admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:34.013317 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35802-6223-4243-8931-91587f92ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:34.013994 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35802-6223-4243-8931-91587f92ee6e admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:34.014278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35802-6223-4243-8931-91587f92ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:34.014561 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35802-6223-4243-8931-91587f92ee6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:34.015295 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c35802-6223-4243-8931-91587f92ee6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:34.016915 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c35802-6223-4243-8931-91587f92ee6e admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:34.028483 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1431/2857] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:45:34.032761 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1925d-fc0a-459c-bab9-a46b2ced8368 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:34.042696 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1925d-fc0a-459c-bab9-a46b2ced8368 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:34.048561 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71e19f-b6c1-4929-951c-3ae31470da1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:34.049908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e19f-b6c1-4929-951c-3ae31470da1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:34.050196 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e19f-b6c1-4929-951c-3ae31470da1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:34.050630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71e19f-b6c1-4929-951c-3ae31470da1b admin admin] PATH_INFO: `/v3/projects/5e0b25b703a0489698549d83d7d46d83/users/a4686a8867424a2498eb1572971d509a/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:34.066296 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71e19f-b6c1-4929-951c-3ae31470da1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0b25b703a0489698549d83d7d46d83, user_id=a4686a8867424a2498eb1572971d509a, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:34.069010 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71e19f-b6c1-4929-951c-3ae31470da1b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:34.085706 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1427/2858] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:34 2022] PUT /identity/v3/projects/5e0b25b703a0489698549d83d7d46d83/users/a4686a8867424a2498eb1572971d509a/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:34.089602 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35802-6223-4243-8931-91587f92ee6e admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:34.100841 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35802-6223-4243-8931-91587f92ee6e admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:34.170309 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2937c4-d5ec-4b25-9dac-8b617f129a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:34.171344 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2937c4-d5ec-4b25-9dac-8b617f129a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:34.171819 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2937c4-d5ec-4b25-9dac-8b617f129a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:34.172016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2937c4-d5ec-4b25-9dac-8b617f129a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:34.172977 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2937c4-d5ec-4b25-9dac-8b617f129a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:34.174598 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2937c4-d5ec-4b25-9dac-8b617f129a30 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:34.185926 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1432/2859] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:45:34.190236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71e19f-b6c1-4929-951c-3ae31470da1b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:34.201827 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71e19f-b6c1-4929-951c-3ae31470da1b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:34.206635 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e99fa7-6a68-4b09-93b6-2f6f7a88e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:34.207526 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e99fa7-6a68-4b09-93b6-2f6f7a88e824 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:34.207808 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e99fa7-6a68-4b09-93b6-2f6f7a88e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:34.208080 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e99fa7-6a68-4b09-93b6-2f6f7a88e824 admin admin] PATH_INFO: `/v3/projects/5e0b25b703a0489698549d83d7d46d83/users/a4686a8867424a2498eb1572971d509a/roles/bcbfd8f7fed84bb99e272a37328dcc43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:34.210216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e99fa7-6a68-4b09-93b6-2f6f7a88e824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0b25b703a0489698549d83d7d46d83, user_id=a4686a8867424a2498eb1572971d509a, role_id=bcbfd8f7fed84bb99e272a37328dcc43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:34.213064 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e99fa7-6a68-4b09-93b6-2f6f7a88e824 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:34.223531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1428/2860] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:34 2022] PUT /identity/v3/projects/5e0b25b703a0489698549d83d7d46d83/users/a4686a8867424a2498eb1572971d509a/roles/bcbfd8f7fed84bb99e272a37328dcc43 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:37.722588 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2937c4-d5ec-4b25-9dac-8b617f129a30 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:37.734216 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2937c4-d5ec-4b25-9dac-8b617f129a30 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:37.742248 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:37.841574 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:37.842557 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:37.842846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:37.843127 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] PATH_INFO: `/v3/users/a573ca391709417cb2b514f3823cddf6` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:37.844420 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a573ca391709417cb2b514f3823cddf6)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:37.846751 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:37.938687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a573ca391709417cb2b514f3823cddf6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:37.939402 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a573ca391709417cb2b514f3823cddf6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:37.940035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a573ca391709417cb2b514f3823cddf6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:37.963879 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a573ca391709417cb2b514f3823cddf6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:37.975930 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a573ca391709417cb2b514f3823cddf6'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:37.999599 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1433/2861] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:37 2022] DELETE /identity/v3/users/a573ca391709417cb2b514f3823cddf6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:38.001425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05251e7a-5ab9-4c2a-91de-8aa50c9aef0c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:38.001901 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05251e7a-5ab9-4c2a-91de-8aa50c9aef0c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:38.002078 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05251e7a-5ab9-4c2a-91de-8aa50c9aef0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:38.040556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-05251e7a-5ab9-4c2a-91de-8aa50c9aef0c None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:38.042089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-05251e7a-5ab9-4c2a-91de-8aa50c9aef0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:38.114332 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:38.146952 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1429/2862] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:38.160003 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:38.162706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:38.274441 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed904d-ac5f-442c-a8ae-2f01056f3fe5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:38.281173 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4a902-0697-4d85-8495-457f67fdb639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:38.282018 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4a902-0697-4d85-8495-457f67fdb639 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:38.282315 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4a902-0697-4d85-8495-457f67fdb639 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:38.282597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4a902-0697-4d85-8495-457f67fdb639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:38.295043 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4a902-0697-4d85-8495-457f67fdb639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:38.296882 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4a902-0697-4d85-8495-457f67fdb639 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:38.309328 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1434/2863] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:38.664893 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05251e7a-5ab9-4c2a-91de-8aa50c9aef0c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:38.666940 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-05251e7a-5ab9-4c2a-91de-8aa50c9aef0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:38.687394 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05251e7a-5ab9-4c2a-91de-8aa50c9aef0c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:38.693186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:38.694288 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:38.694617 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:38.694946 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] PATH_INFO: `/v3/projects/e4425095a49e44ce8e9bbb08fe74a561` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:38.696421 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4425095a49e44ce8e9bbb08fe74a561)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:38.703371 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:38.809102 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4425095a49e44ce8e9bbb08fe74a561', 'request_id': 'req-db5bd611-6f75-41bf-a368-71c6e42fd85a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:38.819961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4425095a49e44ce8e9bbb08fe74a561', 'request_id': 'req-db5bd611-6f75-41bf-a368-71c6e42fd85a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:38.835396 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4425095a49e44ce8e9bbb08fe74a561', 'request_id': 'req-db5bd611-6f75-41bf-a368-71c6e42fd85a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:38.853771 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] The token cache is being invalidate because project e4425095a49e44ce8e9bbb08fe74a561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:38.854321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:38.855372 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:38.860604 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1430/2864] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:38 2022] DELETE /identity/v3/projects/e4425095a49e44ce8e9bbb08fe74a561 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:38.862774 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4a902-0697-4d85-8495-457f67fdb639 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:38.877469 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4a902-0697-4d85-8495-457f67fdb639 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:38.926682 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:38.968211 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e938791-3e39-4498-97b0-a620340ec68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:38.969787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e938791-3e39-4498-97b0-a620340ec68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:38.969787 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e938791-3e39-4498-97b0-a620340ec68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:38.970138 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e938791-3e39-4498-97b0-a620340ec68a admin admin] PATH_INFO: `/v3/users/62cdad6db47e43c6936a4b5ce8a5a46b` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:38.971989 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e938791-3e39-4498-97b0-a620340ec68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=62cdad6db47e43c6936a4b5ce8a5a46b)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:38.974102 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e938791-3e39-4498-97b0-a620340ec68a admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:39.034059 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6e938791-3e39-4498-97b0-a620340ec68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62cdad6db47e43c6936a4b5ce8a5a46b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:39.035683 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6e938791-3e39-4498-97b0-a620340ec68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62cdad6db47e43c6936a4b5ce8a5a46b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:39.036355 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6e938791-3e39-4498-97b0-a620340ec68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62cdad6db47e43c6936a4b5ce8a5a46b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:39.054087 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6e938791-3e39-4498-97b0-a620340ec68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62cdad6db47e43c6936a4b5ce8a5a46b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:39.065488 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-6e938791-3e39-4498-97b0-a620340ec68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62cdad6db47e43c6936a4b5ce8a5a46b'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:39.085217 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1435/2865] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:38 2022] DELETE /identity/v3/users/62cdad6db47e43c6936a4b5ce8a5a46b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:39.587123 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:39.589315 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:39.618425 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bd611-6f75-41bf-a368-71c6e42fd85a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:39.702883 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:39.703907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:39.704290 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:39.704822 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] PATH_INFO: `/v3/projects/9e4f9f0f9ed94d0a8f8c1fc59e264014` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:39.706278 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e4f9f0f9ed94d0a8f8c1fc59e264014)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:39.723414 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:39.768576 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e4f9f0f9ed94d0a8f8c1fc59e264014', 'request_id': 'req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:39.774520 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e7c98-c43d-4f1a-8ac1-b5493d68af13 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:39.774763 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e7c98-c43d-4f1a-8ac1-b5493d68af13 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:39.775052 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e7c98-c43d-4f1a-8ac1-b5493d68af13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:39.779737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e4f9f0f9ed94d0a8f8c1fc59e264014', 'request_id': 'req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:39.801634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e4f9f0f9ed94d0a8f8c1fc59e264014', 'request_id': 'req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:39.813542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:39.832883 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] The token cache is being invalidate because project 9e4f9f0f9ed94d0a8f8c1fc59e264014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:39.832883 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:39.834201 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:39.835384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1431/2866] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:39 2022] DELETE /identity/v3/projects/9e4f9f0f9ed94d0a8f8c1fc59e264014 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:39.839058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:39.842658 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:39.848136 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-626e7c98-c43d-4f1a-8ac1-b5493d68af13 None None] MFA Rules not processed for user `a4686a8867424a2498eb1572971d509a`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:39.850178 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-626e7c98-c43d-4f1a-8ac1-b5493d68af13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:39.957502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab49166-5c5c-4e9e-85fe-6a9307c7e90a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:39.961771 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1436/2867] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:45:39.966484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:39.967539 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:39.967926 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:39.968358 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] PATH_INFO: `/v3/users/8c51053f86ba4f459b72fc38b90349ef` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:39.969884 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c51053f86ba4f459b72fc38b90349ef)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:39.972198 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:39.982231 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e7c98-c43d-4f1a-8ac1-b5493d68af13 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:39.988511 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-626e7c98-c43d-4f1a-8ac1-b5493d68af13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:40.051277 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c51053f86ba4f459b72fc38b90349ef'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:40.052122 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c51053f86ba4f459b72fc38b90349ef'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:40.052582 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:40.054079 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c51053f86ba4f459b72fc38b90349ef'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:40.074708 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c51053f86ba4f459b72fc38b90349ef'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:40.082175 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c51053f86ba4f459b72fc38b90349ef'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:40.102036 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1432/2868] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:45:39 2022] DELETE /identity/v3/users/8c51053f86ba4f459b72fc38b90349ef => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:40.131659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e7c98-c43d-4f1a-8ac1-b5493d68af13 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:40.214490 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e95c4-0ea7-4cb6-a2ab-91273cc21478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:40.215963 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e95c4-0ea7-4cb6-a2ab-91273cc21478 service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:40.216461 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e95c4-0ea7-4cb6-a2ab-91273cc21478 service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:40.216881 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e95c4-0ea7-4cb6-a2ab-91273cc21478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:40.218893 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c67e95c4-0ea7-4cb6-a2ab-91273cc21478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:40.289072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e95c4-0ea7-4cb6-a2ab-91273cc21478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:40.290898 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e95c4-0ea7-4cb6-a2ab-91273cc21478 service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:40.302910 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1437/2869] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:40.453933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:40.455670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:40.566567 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dff40-81f0-4fde-8cec-a205dd5cd6bc admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:40.572473 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602610e-f015-4ce1-a065-d828d4107652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:40.577492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602610e-f015-4ce1-a065-d828d4107652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:40.577492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602610e-f015-4ce1-a065-d828d4107652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:40.577492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602610e-f015-4ce1-a065-d828d4107652 admin admin] PATH_INFO: `/v3/projects/aeeb3b92c7fd4914865153cfbff52498` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:40.581830 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602610e-f015-4ce1-a065-d828d4107652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeeb3b92c7fd4914865153cfbff52498)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:40.584160 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602610e-f015-4ce1-a065-d828d4107652 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:40.609872 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:40.641958 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5602610e-f015-4ce1-a065-d828d4107652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeeb3b92c7fd4914865153cfbff52498', 'request_id': 'req-5602610e-f015-4ce1-a065-d828d4107652'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:40.656498 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5602610e-f015-4ce1-a065-d828d4107652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeeb3b92c7fd4914865153cfbff52498', 'request_id': 'req-5602610e-f015-4ce1-a065-d828d4107652'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:40.669781 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5602610e-f015-4ce1-a065-d828d4107652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeeb3b92c7fd4914865153cfbff52498', 'request_id': 'req-5602610e-f015-4ce1-a065-d828d4107652'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:40.686030 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5602610e-f015-4ce1-a065-d828d4107652 admin admin] The token cache is being invalidate because project aeeb3b92c7fd4914865153cfbff52498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:45:40.686348 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5602610e-f015-4ce1-a065-d828d4107652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:40.687021 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5602610e-f015-4ce1-a065-d828d4107652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:45:40.688786 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1433/2870] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:45:40 2022] DELETE /identity/v3/projects/aeeb3b92c7fd4914865153cfbff52498 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:40.693714 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674c25b-df2f-4b8c-9637-78746890d24f None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:40.694027 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674c25b-df2f-4b8c-9637-78746890d24f None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:40.694284 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674c25b-df2f-4b8c-9637-78746890d24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:40.719359 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-6674c25b-df2f-4b8c-9637-78746890d24f None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:40.720841 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-6674c25b-df2f-4b8c-9637-78746890d24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:40.789554 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:40.835278 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1438/2871] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:40.835917 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d680719-fa34-4c60-a35e-37f424b08abf None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:40.836217 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d680719-fa34-4c60-a35e-37f424b08abf None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:40.836502 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d680719-fa34-4c60-a35e-37f424b08abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:40.859973 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9d680719-fa34-4c60-a35e-37f424b08abf None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:40.861792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9d680719-fa34-4c60-a35e-37f424b08abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:40.874940 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1434/2872] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:40.881273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674c25b-df2f-4b8c-9637-78746890d24f None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:40.894028 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674c25b-df2f-4b8c-9637-78746890d24f None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:40.901299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fc601-6d59-4d6b-9a78-d48b865cb8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:40.902056 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fc601-6d59-4d6b-9a78-d48b865cb8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:40.902953 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fc601-6d59-4d6b-9a78-d48b865cb8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:40.904135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fc601-6d59-4d6b-9a78-d48b865cb8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:40.905203 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fc601-6d59-4d6b-9a78-d48b865cb8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80140) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:40.905730 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fc601-6d59-4d6b-9a78-d48b865cb8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:40.908271 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fc601-6d59-4d6b-9a78-d48b865cb8c8 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:40.944947 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1439/2873] 10.222.0.39 () {58 vars in 1152 bytes} [Thu May 26 12:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:40.945579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d680719-fa34-4c60-a35e-37f424b08abf None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:40.963904 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d680719-fa34-4c60-a35e-37f424b08abf None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:40.972951 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537851a-46d3-4b22-a2cf-8261b24fc802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:40.973945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537851a-46d3-4b22-a2cf-8261b24fc802 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:40.974604 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537851a-46d3-4b22-a2cf-8261b24fc802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:40.974957 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537851a-46d3-4b22-a2cf-8261b24fc802 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:40.976057 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537851a-46d3-4b22-a2cf-8261b24fc802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:40.978453 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537851a-46d3-4b22-a2cf-8261b24fc802 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:41.023207 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1435/2874] 10.222.0.39 () {60 vars in 1152 bytes} [Thu May 26 12:45:40 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:45:41.028757 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fc601-6d59-4d6b-9a78-d48b865cb8c8 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:41.050143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fc601-6d59-4d6b-9a78-d48b865cb8c8 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:41.118846 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914744a-bc3a-477e-8ab3-59a348b3ebd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:41.122508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914744a-bc3a-477e-8ab3-59a348b3ebd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:41.122508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914744a-bc3a-477e-8ab3-59a348b3ebd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:41.122508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914744a-bc3a-477e-8ab3-59a348b3ebd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:41.122508 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914744a-bc3a-477e-8ab3-59a348b3ebd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:41.124215 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914744a-bc3a-477e-8ab3-59a348b3ebd7 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:41.152334 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1440/2875] 10.222.0.39 () {60 vars in 1143 bytes} [Thu May 26 12:45:41 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:41.157571 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537851a-46d3-4b22-a2cf-8261b24fc802 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:41.180916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537851a-46d3-4b22-a2cf-8261b24fc802 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:41.187663 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c273b-5005-4db1-a2a8-c1648cbf0e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:41.188356 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c273b-5005-4db1-a2a8-c1648cbf0e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:41.188644 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c273b-5005-4db1-a2a8-c1648cbf0e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:41.188954 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c273b-5005-4db1-a2a8-c1648cbf0e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:41.189692 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c273b-5005-4db1-a2a8-c1648cbf0e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:41.191324 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c273b-5005-4db1-a2a8-c1648cbf0e4e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:41.204024 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1436/2876] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:45:41.208206 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914744a-bc3a-477e-8ab3-59a348b3ebd7 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:41.219173 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914744a-bc3a-477e-8ab3-59a348b3ebd7 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:41.224615 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78259a56-1a8b-4bec-8a34-048ccd4b738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:41.225411 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78259a56-1a8b-4bec-8a34-048ccd4b738d admin admin] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:41.225780 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78259a56-1a8b-4bec-8a34-048ccd4b738d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:41.226146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78259a56-1a8b-4bec-8a34-048ccd4b738d admin admin] PATH_INFO: `/v3/roles` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:41.226978 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78259a56-1a8b-4bec-8a34-048ccd4b738d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:41.228699 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78259a56-1a8b-4bec-8a34-048ccd4b738d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:41.243037 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1441/2877] 10.222.0.39 () {58 vars in 1121 bytes} [Thu May 26 12:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:41.244900 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c273b-5005-4db1-a2a8-c1648cbf0e4e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:41.270247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c273b-5005-4db1-a2a8-c1648cbf0e4e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:41.275001 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f730c4-9b7f-44c9-8c43-29bed45bc426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:41.275907 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f730c4-9b7f-44c9-8c43-29bed45bc426 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:41.276221 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f730c4-9b7f-44c9-8c43-29bed45bc426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:41.276505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f730c4-9b7f-44c9-8c43-29bed45bc426 admin admin] PATH_INFO: `/v3/projects/967941c42e3046b4b5e929dbc446d2f3/users/7ef548f433e444a2892e772165ce1e11/roles/c860ed9e0b784b18a457abd0ddb5f508` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:41.296777 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f730c4-9b7f-44c9-8c43-29bed45bc426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=967941c42e3046b4b5e929dbc446d2f3, user_id=7ef548f433e444a2892e772165ce1e11, role_id=c860ed9e0b784b18a457abd0ddb5f508)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:41.299477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f730c4-9b7f-44c9-8c43-29bed45bc426 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:41.313897 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1437/2878] 10.222.0.39 () {60 vars in 1482 bytes} [Thu May 26 12:45:41 2022] PUT /identity/v3/projects/967941c42e3046b4b5e929dbc446d2f3/users/7ef548f433e444a2892e772165ce1e11/roles/c860ed9e0b784b18a457abd0ddb5f508 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:41.319393 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff7da-c560-4ef9-97eb-94b9ce085577 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:41.319687 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff7da-c560-4ef9-97eb-94b9ce085577 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:41.319969 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff7da-c560-4ef9-97eb-94b9ce085577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:41.342650 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-73aff7da-c560-4ef9-97eb-94b9ce085577 None None] MFA Rules not processed for user `6cb812d57b84461b8b6450ef1b357cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:41.343886 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-73aff7da-c560-4ef9-97eb-94b9ce085577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:41.425534 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1442/2879] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:41.437375 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f730c4-9b7f-44c9-8c43-29bed45bc426 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:41.439130 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a1f730c4-9b7f-44c9-8c43-29bed45bc426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:41.507226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f730c4-9b7f-44c9-8c43-29bed45bc426 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:41.510972 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c794b-4b88-4ba0-9758-50cfd91fb087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:41.511726 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c794b-4b88-4ba0-9758-50cfd91fb087 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:41.512018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c794b-4b88-4ba0-9758-50cfd91fb087 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:41.512299 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c794b-4b88-4ba0-9758-50cfd91fb087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:41.524642 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c794b-4b88-4ba0-9758-50cfd91fb087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:41.526607 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c794b-4b88-4ba0-9758-50cfd91fb087 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:41.538813 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1438/2880] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:42.267099 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7117f7-c23f-4c37-be07-011b7fdedf70 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:42.267593 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7117f7-c23f-4c37-be07-011b7fdedf70 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:42.267778 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7117f7-c23f-4c37-be07-011b7fdedf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:42.298209 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-fe7117f7-c23f-4c37-be07-011b7fdedf70 None None] MFA Rules not processed for user `7ef548f433e444a2892e772165ce1e11`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:42.299451 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-fe7117f7-c23f-4c37-be07-011b7fdedf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:42.386909 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:42.427159 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1443/2881] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:42.439226 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c794b-4b88-4ba0-9758-50cfd91fb087 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:42.440808 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-832c794b-4b88-4ba0-9758-50cfd91fb087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:42.493192 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:42.515816 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c794b-4b88-4ba0-9758-50cfd91fb087 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:42.520494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70abaa-8772-4d12-aa5f-799a2edcb7b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:42.521216 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70abaa-8772-4d12-aa5f-799a2edcb7b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:42.521505 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70abaa-8772-4d12-aa5f-799a2edcb7b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:42.521785 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70abaa-8772-4d12-aa5f-799a2edcb7b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:42.532561 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70abaa-8772-4d12-aa5f-799a2edcb7b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:42.534177 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70abaa-8772-4d12-aa5f-799a2edcb7b2 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:42.545186 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1439/2882] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:44.039735 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e22b7-a174-4355-8af9-a949b1fd4a35 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:44.040521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e22b7-a174-4355-8af9-a949b1fd4a35 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:44.040521 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e22b7-a174-4355-8af9-a949b1fd4a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:44.062012 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-8e3e22b7-a174-4355-8af9-a949b1fd4a35 None None] MFA Rules not processed for user `7ef548f433e444a2892e772165ce1e11`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:44.063239 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8e3e22b7-a174-4355-8af9-a949b1fd4a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:44.070359 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1444/2883] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:45:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:44.319163 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70abaa-8772-4d12-aa5f-799a2edcb7b2 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:44.320751 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-aa70abaa-8772-4d12-aa5f-799a2edcb7b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:44.332903 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70abaa-8772-4d12-aa5f-799a2edcb7b2 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:44.336454 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbf595-5f81-4799-90c1-783ef44bd657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:44.337124 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbf595-5f81-4799-90c1-783ef44bd657 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:44.337404 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbf595-5f81-4799-90c1-783ef44bd657 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:44.337676 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbf595-5f81-4799-90c1-783ef44bd657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:44.340749 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8dbbf595-5f81-4799-90c1-783ef44bd657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:44.354239 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbf595-5f81-4799-90c1-783ef44bd657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:44.356845 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbf595-5f81-4799-90c1-783ef44bd657 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:44.366008 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1440/2884] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:49.235649 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e22b7-a174-4355-8af9-a949b1fd4a35 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:49.237107 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8e3e22b7-a174-4355-8af9-a949b1fd4a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:49.344468 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e22b7-a174-4355-8af9-a949b1fd4a35 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:49.351834 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03143c-a440-4598-b337-7db8e320b772 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:49.352498 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03143c-a440-4598-b337-7db8e320b772 service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:49.352825 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03143c-a440-4598-b337-7db8e320b772 service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:49.353106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03143c-a440-4598-b337-7db8e320b772 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:49.354959 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-df03143c-a440-4598-b337-7db8e320b772 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:49.369886 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03143c-a440-4598-b337-7db8e320b772 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:49.371808 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03143c-a440-4598-b337-7db8e320b772 service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:49.385723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1445/2885] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:54.362193 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=12 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:56.446068 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbf595-5f81-4799-90c1-783ef44bd657 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.448588 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8dbbf595-5f81-4799-90c1-783ef44bd657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:56.526533 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbf595-5f81-4799-90c1-783ef44bd657 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.532634 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461f44a-15c6-4752-bf6c-cab5ad728e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.533321 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461f44a-15c6-4752-bf6c-cab5ad728e43 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.533609 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461f44a-15c6-4752-bf6c-cab5ad728e43 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.533888 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461f44a-15c6-4752-bf6c-cab5ad728e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.535703 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0461f44a-15c6-4752-bf6c-cab5ad728e43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:56.547855 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461f44a-15c6-4752-bf6c-cab5ad728e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.549494 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461f44a-15c6-4752-bf6c-cab5ad728e43 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.560101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1441/2886] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:45:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:59.378913 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=53 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:06.555524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=34 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:07.397666 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209923d-3a0b-42e0-991c-a827724e401a None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:07.398223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209923d-3a0b-42e0-991c-a827724e401a None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:07.398223 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209923d-3a0b-42e0-991c-a827724e401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:07.416530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-c209923d-3a0b-42e0-991c-a827724e401a None None] MFA Rules not processed for user `3c4e48e94f934a3baf6a09a2b2d8f85d`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:07.417835 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c209923d-3a0b-42e0-991c-a827724e401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:07.480158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1446/2887] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:46:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:14.188747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b068c-59fa-429c-ab83-267d6db362c4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:14.189303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b068c-59fa-429c-ab83-267d6db362c4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:14.189303 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b068c-59fa-429c-ab83-267d6db362c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:14.257467 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fc6b068c-59fa-429c-ab83-267d6db362c4 None None] MFA Rules not processed for user `bc48f3a3998b4c5ab199181005f9a5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:14.258602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fc6b068c-59fa-429c-ab83-267d6db362c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:14.336151 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1442/2888] 10.222.0.39 () {58 vars in 967 bytes} [Thu May 26 12:46:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:14.387299 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209923d-3a0b-42e0-991c-a827724e401a None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:14.388794 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-c209923d-3a0b-42e0-991c-a827724e401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:14.500383 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209923d-3a0b-42e0-991c-a827724e401a None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:14.505786 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac25a1-096b-4e61-a2f3-5ec4047039d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '691c9da310ef42a189bb78183867e46a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:14.506472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac25a1-096b-4e61-a2f3-5ec4047039d5 service swift] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:14.506760 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac25a1-096b-4e61-a2f3-5ec4047039d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:14.507041 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac25a1-096b-4e61-a2f3-5ec4047039d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:14.516045 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac25a1-096b-4e61-a2f3-5ec4047039d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:14.517597 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac25a1-096b-4e61-a2f3-5ec4047039d5 service swift] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:14.525987 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1447/2889] 10.222.0.39 () {60 vars in 1384 bytes} [Thu May 26 12:46:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:46:21.911630 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b068c-59fa-429c-ab83-267d6db362c4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:21.913157 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fc6b068c-59fa-429c-ab83-267d6db362c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:21.928495 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b068c-59fa-429c-ab83-267d6db362c4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:21.934100 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:21.935189 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:21.935491 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:21.935772 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] PATH_INFO: `/v3/users/7ff0a10504ef4323a853d5f721c05299` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:21.937150 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff0a10504ef4323a853d5f721c05299)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:21.939104 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:21.990945 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff0a10504ef4323a853d5f721c05299'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:21.991908 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff0a10504ef4323a853d5f721c05299'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:21.992779 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff0a10504ef4323a853d5f721c05299'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.006687 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff0a10504ef4323a853d5f721c05299'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.014567 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff0a10504ef4323a853d5f721c05299'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.028595 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1443/2890] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:46:21 2022] DELETE /identity/v3/users/7ff0a10504ef4323a853d5f721c05299 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:22.202082 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac25a1-096b-4e61-a2f3-5ec4047039d5 service swift] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:22.215691 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac25a1-096b-4e61-a2f3-5ec4047039d5 service swift] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:22.276393 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:22.277300 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:22.277585 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:22.277862 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] PATH_INFO: `/v3/projects/91ce6c14fb95466dab6338cd0fafcd0e` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:22.279035 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ce6c14fb95466dab6338cd0fafcd0e)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:22.281867 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:22.298536 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:22.330135 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ce6c14fb95466dab6338cd0fafcd0e', 'request_id': 'req-11210673-9c13-4c00-923f-d767207ad9b5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.337762 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ce6c14fb95466dab6338cd0fafcd0e', 'request_id': 'req-11210673-9c13-4c00-923f-d767207ad9b5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.344330 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ce6c14fb95466dab6338cd0fafcd0e', 'request_id': 'req-11210673-9c13-4c00-923f-d767207ad9b5'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.354440 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] The token cache is being invalidate because project 91ce6c14fb95466dab6338cd0fafcd0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:22.354728 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.355348 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.356960 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1448/2891] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:46:22 2022] DELETE /identity/v3/projects/91ce6c14fb95466dab6338cd0fafcd0e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:22.361013 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:22.362469 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:22.376146 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a2750-f654-4052-bce4-06c1e00335d9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:22.409956 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:22.436247 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:22.437729 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:22.438250 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:22.438556 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] PATH_INFO: `/v3/users/71f18383527647b5bd69f049db82d357` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:22.439746 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f18383527647b5bd69f049db82d357)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:22.441698 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:22.487269 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f18383527647b5bd69f049db82d357'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.487843 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f18383527647b5bd69f049db82d357'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.488444 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f18383527647b5bd69f049db82d357'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.503106 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f18383527647b5bd69f049db82d357'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.510202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f18383527647b5bd69f049db82d357'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.525075 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1444/2892] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:46:22 2022] DELETE /identity/v3/users/71f18383527647b5bd69f049db82d357 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:22.701668 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:22.704747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:22.726019 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11210673-9c13-4c00-923f-d767207ad9b5 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:22.790657 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b02f2a-26fa-4b05-a748-27724e86ab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:22.791532 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02f2a-26fa-4b05-a748-27724e86ab3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:22.791820 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02f2a-26fa-4b05-a748-27724e86ab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:22.792093 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02f2a-26fa-4b05-a748-27724e86ab3d admin admin] PATH_INFO: `/v3/projects/ca2f7e7d7e624cb99ecf139eb17be670` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:22.793323 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b02f2a-26fa-4b05-a748-27724e86ab3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2f7e7d7e624cb99ecf139eb17be670)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:22.795221 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b02f2a-26fa-4b05-a748-27724e86ab3d admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:22.847823 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d3b02f2a-26fa-4b05-a748-27724e86ab3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2f7e7d7e624cb99ecf139eb17be670', 'request_id': 'req-d3b02f2a-26fa-4b05-a748-27724e86ab3d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.855410 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d3b02f2a-26fa-4b05-a748-27724e86ab3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2f7e7d7e624cb99ecf139eb17be670', 'request_id': 'req-d3b02f2a-26fa-4b05-a748-27724e86ab3d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.862353 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d3b02f2a-26fa-4b05-a748-27724e86ab3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2f7e7d7e624cb99ecf139eb17be670', 'request_id': 'req-d3b02f2a-26fa-4b05-a748-27724e86ab3d'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.872802 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d3b02f2a-26fa-4b05-a748-27724e86ab3d admin admin] The token cache is being invalidate because project ca2f7e7d7e624cb99ecf139eb17be670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:22.873089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d3b02f2a-26fa-4b05-a748-27724e86ab3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.873720 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-d3b02f2a-26fa-4b05-a748-27724e86ab3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.875357 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1449/2893] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:46:22 2022] DELETE /identity/v3/projects/ca2f7e7d7e624cb99ecf139eb17be670 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:31.568268 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:31.569823 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:31.632166 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421909a-8843-4d0a-8c17-31e5f04e082f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:31.695162 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3c84-a924-49c0-bedf-ec76a2a36276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:31.695937 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3c84-a924-49c0-bedf-ec76a2a36276 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:31.696311 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3c84-a924-49c0-bedf-ec76a2a36276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:31.696670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad3c84-a924-49c0-bedf-ec76a2a36276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:31.698636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c7ad3c84-a924-49c0-bedf-ec76a2a36276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:31.729109 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:31.768259 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad3c84-a924-49c0-bedf-ec76a2a36276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:31.770037 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad3c84-a924-49c0-bedf-ec76a2a36276 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:31.779801 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1445/2894] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:46:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:32.869849 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:41.775484 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=18 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:15.086477 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236a11b-9d91-4e8e-804b-69c0be81e2a1 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:15.087012 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236a11b-9d91-4e8e-804b-69c0be81e2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:15.087012 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236a11b-9d91-4e8e-804b-69c0be81e2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:15.104543 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3236a11b-9d91-4e8e-804b-69c0be81e2a1 None None] MFA Rules not processed for user `7ef548f433e444a2892e772165ce1e11`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:15.105764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3236a11b-9d91-4e8e-804b-69c0be81e2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:15.161364 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1450/2895] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:47:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:25.154109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=25 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:26.180340 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3c84-a924-49c0-bedf-ec76a2a36276 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:26.181842 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c7ad3c84-a924-49c0-bedf-ec76a2a36276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:26.192636 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad3c84-a924-49c0-bedf-ec76a2a36276 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:26.196309 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1586f5c-a563-4fa9-a1f6-b2aa495d3cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:26.196993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1586f5c-a563-4fa9-a1f6-b2aa495d3cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.197275 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1586f5c-a563-4fa9-a1f6-b2aa495d3cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.197551 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1586f5c-a563-4fa9-a1f6-b2aa495d3cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.199292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e1586f5c-a563-4fa9-a1f6-b2aa495d3cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:26.278261 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1586f5c-a563-4fa9-a1f6-b2aa495d3cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:26.279727 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1586f5c-a563-4fa9-a1f6-b2aa495d3cf1 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:26.292306 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1446/2896] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:47:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:27.471723 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236a11b-9d91-4e8e-804b-69c0be81e2a1 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:27.481764 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236a11b-9d91-4e8e-804b-69c0be81e2a1 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:27.486085 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e18277-6060-443c-a000-e55e5c5d3cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:27.486731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e18277-6060-443c-a000-e55e5c5d3cfb service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.487015 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e18277-6060-443c-a000-e55e5c5d3cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.487293 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e18277-6060-443c-a000-e55e5c5d3cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.489308 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f0e18277-6060-443c-a000-e55e5c5d3cfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:27.503706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e18277-6060-443c-a000-e55e5c5d3cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:27.505189 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e18277-6060-443c-a000-e55e5c5d3cfb service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:27.517421 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1451/2897] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:47:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:36.287116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=34 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:37.511446 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:20.951433 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1586f5c-a563-4fa9-a1f6-b2aa495d3cf1 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:20.953034 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e1586f5c-a563-4fa9-a1f6-b2aa495d3cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:21.014656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e18277-6060-443c-a000-e55e5c5d3cfb service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:21.016321 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f0e18277-6060-443c-a000-e55e5c5d3cfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:21.030818 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1586f5c-a563-4fa9-a1f6-b2aa495d3cf1 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.036447 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5546263-977f-4faa-9f59-e1d0bc7fbeab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.036990 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5546263-977f-4faa-9f59-e1d0bc7fbeab service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.037492 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5546263-977f-4faa-9f59-e1d0bc7fbeab service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.037797 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5546263-977f-4faa-9f59-e1d0bc7fbeab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.040442 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e5546263-977f-4faa-9f59-e1d0bc7fbeab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:21.052596 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5546263-977f-4faa-9f59-e1d0bc7fbeab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.054160 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5546263-977f-4faa-9f59-e1d0bc7fbeab service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.065524 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1447/2898] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:48:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:21.085416 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e18277-6060-443c-a000-e55e5c5d3cfb service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.090354 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.091370 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.091654 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.091929 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] PATH_INFO: `/v3/users/7ef548f433e444a2892e772165ce1e11` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.093163 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef548f433e444a2892e772165ce1e11)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.095143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.142472 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef548f433e444a2892e772165ce1e11'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:21.143169 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef548f433e444a2892e772165ce1e11'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:21.143781 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef548f433e444a2892e772165ce1e11'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:21.155966 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef548f433e444a2892e772165ce1e11'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:21.162759 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef548f433e444a2892e772165ce1e11'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:21.175948 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1452/2899] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:48:21 2022] DELETE /identity/v3/users/7ef548f433e444a2892e772165ce1e11 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:21.348077 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5546263-977f-4faa-9f59-e1d0bc7fbeab service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:21.359530 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5546263-977f-4faa-9f59-e1d0bc7fbeab service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.416688 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.417579 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.417866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.418144 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] PATH_INFO: `/v3/projects/967941c42e3046b4b5e929dbc446d2f3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.419338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] RBAC: Authorizing `identity:delete_project(project_id=967941c42e3046b4b5e929dbc446d2f3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.421308 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.465932 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967941c42e3046b4b5e929dbc446d2f3', 'request_id': 'req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:21.473670 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967941c42e3046b4b5e929dbc446d2f3', 'request_id': 'req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:21.480496 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967941c42e3046b4b5e929dbc446d2f3', 'request_id': 'req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:21.490792 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] The token cache is being invalidate because project 967941c42e3046b4b5e929dbc446d2f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:21.491087 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:21.491747 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:21.493409 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1448/2900] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:48:21 2022] DELETE /identity/v3/projects/967941c42e3046b4b5e929dbc446d2f3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:31.172530 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:31.487807 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:33.133349 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:33.135047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:33.194571 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2374e94-6e99-4711-9dfb-77fecaa930ff admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:33.247731 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5b51d-4ca4-44d7-97ce-47bb695a5d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:33.248395 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5b51d-4ca4-44d7-97ce-47bb695a5d96 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:33.248661 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5b51d-4ca4-44d7-97ce-47bb695a5d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:33.249123 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5b51d-4ca4-44d7-97ce-47bb695a5d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:33.250840 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-97c5b51d-4ca4-44d7-97ce-47bb695a5d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:33.260864 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5b51d-4ca4-44d7-97ce-47bb695a5d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:33.262280 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5b51d-4ca4-44d7-97ce-47bb695a5d96 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:33.270286 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1453/2901] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:48:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:43.266663 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=46 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:29.477586 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:29.479141 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:29.576834 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0ec8c-c27c-41a6-b4be-fed5298de39d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:29.583287 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b8043-6600-4f88-bae6-6708108d8811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:29.584384 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b8043-6600-4f88-bae6-6708108d8811 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:29.584918 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b8043-6600-4f88-bae6-6708108d8811 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:29.585426 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b8043-6600-4f88-bae6-6708108d8811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:29.587683 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e53b8043-6600-4f88-bae6-6708108d8811 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:29.602570 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b8043-6600-4f88-bae6-6708108d8811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:29.604256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b8043-6600-4f88-bae6-6708108d8811 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:29.615915 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1449/2902] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:49:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:31.334078 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965155b-8b4e-46f1-b1fb-e08c2cf61a7e None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:31.334684 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965155b-8b4e-46f1-b1fb-e08c2cf61a7e None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:31.334942 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965155b-8b4e-46f1-b1fb-e08c2cf61a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:31.354274 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-3965155b-8b4e-46f1-b1fb-e08c2cf61a7e None None] MFA Rules not processed for user `3c4e48e94f934a3baf6a09a2b2d8f85d`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:31.356273 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3965155b-8b4e-46f1-b1fb-e08c2cf61a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:31.410190 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1454/2903] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:49:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:31.723438 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b8043-6600-4f88-bae6-6708108d8811 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:31.724938 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e53b8043-6600-4f88-bae6-6708108d8811 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:31.738305 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b8043-6600-4f88-bae6-6708108d8811 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:31.742058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d18529-1d00-4f21-9b93-41f20cdb0e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:31.742863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d18529-1d00-4f21-9b93-41f20cdb0e30 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:31.743283 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d18529-1d00-4f21-9b93-41f20cdb0e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:31.743577 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d18529-1d00-4f21-9b93-41f20cdb0e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:31.745863 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-33d18529-1d00-4f21-9b93-41f20cdb0e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:31.756084 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d18529-1d00-4f21-9b93-41f20cdb0e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:31.757547 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d18529-1d00-4f21-9b93-41f20cdb0e30 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:31.766018 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1450/2904] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:49:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:32.216817 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965155b-8b4e-46f1-b1fb-e08c2cf61a7e None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:32.218256 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3965155b-8b4e-46f1-b1fb-e08c2cf61a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:32.293665 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965155b-8b4e-46f1-b1fb-e08c2cf61a7e None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:32.298622 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d420e4-109a-4520-af83-39ae302a25fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:32.299272 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d420e4-109a-4520-af83-39ae302a25fc service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:32.299558 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d420e4-109a-4520-af83-39ae302a25fc service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:32.299842 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d420e4-109a-4520-af83-39ae302a25fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:32.301628 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-19d420e4-109a-4520-af83-39ae302a25fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:32.313826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d420e4-109a-4520-af83-39ae302a25fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:32.315400 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d420e4-109a-4520-af83-39ae302a25fc service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:32.327479 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1455/2905] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:49:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:41.762270 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=40 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:42.321857 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=57 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:49.447330 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d18529-1d00-4f21-9b93-41f20cdb0e30 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:49.448796 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-33d18529-1d00-4f21-9b93-41f20cdb0e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:49.465757 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d18529-1d00-4f21-9b93-41f20cdb0e30 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:49.472093 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5158bb1-d70e-4d94-a288-2a338b3979a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:49.472875 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5158bb1-d70e-4d94-a288-2a338b3979a8 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:49.473241 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5158bb1-d70e-4d94-a288-2a338b3979a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:49.473602 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5158bb1-d70e-4d94-a288-2a338b3979a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:49.475754 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f5158bb1-d70e-4d94-a288-2a338b3979a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:49.489480 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5158bb1-d70e-4d94-a288-2a338b3979a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:49.491091 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5158bb1-d70e-4d94-a288-2a338b3979a8 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:49.509719 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1451/2906] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:49:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:59.501735 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:33.404763 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d420e4-109a-4520-af83-39ae302a25fc service placement] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:33.406188 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-19d420e4-109a-4520-af83-39ae302a25fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:33.419712 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d420e4-109a-4520-af83-39ae302a25fc service placement] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:33.424863 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e629f8a-5a1f-4537-adfd-f3548346c772 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:33.425504 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e629f8a-5a1f-4537-adfd-f3548346c772 service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:33.425790 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e629f8a-5a1f-4537-adfd-f3548346c772 service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:33.426072 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e629f8a-5a1f-4537-adfd-f3548346c772 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:33.427826 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-3e629f8a-5a1f-4537-adfd-f3548346c772 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:33.440316 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e629f8a-5a1f-4537-adfd-f3548346c772 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:33.441923 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e629f8a-5a1f-4537-adfd-f3548346c772 service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:33.452073 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1456/2907] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:51:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:43.447761 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:52.078856 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5158bb1-d70e-4d94-a288-2a338b3979a8 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:52.080286 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f5158bb1-d70e-4d94-a288-2a338b3979a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:52.137383 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5158bb1-d70e-4d94-a288-2a338b3979a8 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:52.141071 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8f4c9-893b-411a-b0b7-e5e23209f9ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64fd1405d96d435faba0c8857009f889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:52.141664 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8f4c9-893b-411a-b0b7-e5e23209f9ba service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:52.141948 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8f4c9-893b-411a-b0b7-e5e23209f9ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:52.142223 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8f4c9-893b-411a-b0b7-e5e23209f9ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:52.144012 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-94b8f4c9-893b-411a-b0b7-e5e23209f9ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:52.155199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8f4c9-893b-411a-b0b7-e5e23209f9ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:52.156666 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8f4c9-893b-411a-b0b7-e5e23209f9ba service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:52.166591 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1452/2908] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:51:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:02.161832 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=26 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:04.231374 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f743cf-32b4-4b1c-b80d-0275bb4cf2d8 None None] REQUEST_METHOD: `POST` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:04.231945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f743cf-32b4-4b1c-b80d-0275bb4cf2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:04.231945 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f743cf-32b4-4b1c-b80d-0275bb4cf2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:04.249556 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.auth.core [None req-f0f743cf-32b4-4b1c-b80d-0275bb4cf2d8 None None] MFA Rules not processed for user `3c4e48e94f934a3baf6a09a2b2d8f85d`. Rule list: `[]` (Enabled: `True`). {{(pid=80140) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:04.250759 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-f0f743cf-32b4-4b1c-b80d-0275bb4cf2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:04.258986 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1457/2909] 10.222.0.39 () {58 vars in 957 bytes} [Thu May 26 12:52:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:04.578680 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8f4c9-893b-411a-b0b7-e5e23209f9ba service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:04.588659 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8f4c9-893b-411a-b0b7-e5e23209f9ba service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:04.592256 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672944a3-8f72-4a18-a3ab-97da6b033a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:04.592919 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672944a3-8f72-4a18-a3ab-97da6b033a73 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:04.593203 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672944a3-8f72-4a18-a3ab-97da6b033a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:04.593477 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672944a3-8f72-4a18-a3ab-97da6b033a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:04.595236 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-672944a3-8f72-4a18-a3ab-97da6b033a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:04.604866 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672944a3-8f72-4a18-a3ab-97da6b033a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:04.606293 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672944a3-8f72-4a18-a3ab-97da6b033a73 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:04.614161 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1453/2910] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:52:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:14.244233 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=3 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:14.610598 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:23.931510 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f743cf-32b4-4b1c-b80d-0275bb4cf2d8 None None] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:23.945873 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f743cf-32b4-4b1c-b80d-0275bb4cf2d8 None None] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:23.951747 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f086a0-4bee-45d8-815a-dfe75db3e18a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:23.952419 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f086a0-4bee-45d8-815a-dfe75db3e18a service nova] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:23.952706 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f086a0-4bee-45d8-815a-dfe75db3e18a service nova] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:23.953016 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f086a0-4bee-45d8-815a-dfe75db3e18a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:23.954838 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-a0f086a0-4bee-45d8-815a-dfe75db3e18a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:23.968490 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f086a0-4bee-45d8-815a-dfe75db3e18a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:23.970177 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f086a0-4bee-45d8-815a-dfe75db3e18a service nova] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:23.982507 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1458/2911] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:52:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:25.540784 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672944a3-8f72-4a18-a3ab-97da6b033a73 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:25.549456 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672944a3-8f72-4a18-a3ab-97da6b033a73 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:25.553930 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30536d42-c9ae-4cb6-96ce-6e1b4a7d3488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:25.554561 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30536d42-c9ae-4cb6-96ce-6e1b4a7d3488 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:25.554844 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30536d42-c9ae-4cb6-96ce-6e1b4a7d3488 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:25.555117 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30536d42-c9ae-4cb6-96ce-6e1b4a7d3488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:25.556914 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-30536d42-c9ae-4cb6-96ce-6e1b4a7d3488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:25.570583 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30536d42-c9ae-4cb6-96ce-6e1b4a7d3488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:25.571992 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30536d42-c9ae-4cb6-96ce-6e1b4a7d3488 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:25.582723 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1454/2912] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:26.753147 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f086a0-4bee-45d8-815a-dfe75db3e18a service nova] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:26.768332 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f086a0-4bee-45d8-815a-dfe75db3e18a service nova] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:26.772845 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26e208-07f5-4988-8576-4d68c290051b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:26.773523 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26e208-07f5-4988-8576-4d68c290051b service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:26.773817 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26e208-07f5-4988-8576-4d68c290051b service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:26.774095 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26e208-07f5-4988-8576-4d68c290051b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:26.776170 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4d26e208-07f5-4988-8576-4d68c290051b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:26.793676 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26e208-07f5-4988-8576-4d68c290051b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:26.795131 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d26e208-07f5-4988-8576-4d68c290051b service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:26.809925 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1459/2913] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:27.142322 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30536d42-c9ae-4cb6-96ce-6e1b4a7d3488 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:27.153263 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30536d42-c9ae-4cb6-96ce-6e1b4a7d3488 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:27.157022 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871efb22-2c97-42e2-a473-d90d4653db04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:27.157657 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871efb22-2c97-42e2-a473-d90d4653db04 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:27.158085 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871efb22-2c97-42e2-a473-d90d4653db04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:27.158362 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871efb22-2c97-42e2-a473-d90d4653db04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:27.160154 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-871efb22-2c97-42e2-a473-d90d4653db04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:27.233758 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871efb22-2c97-42e2-a473-d90d4653db04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:27.235291 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871efb22-2c97-42e2-a473-d90d4653db04 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:27.249202 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1455/2914] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:52:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:36.802139 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=12 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:37.243648 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=36 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:40.138197 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26e208-07f5-4988-8576-4d68c290051b service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:40.139596 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-4d26e208-07f5-4988-8576-4d68c290051b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:40.152904 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d26e208-07f5-4988-8576-4d68c290051b service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:40.156877 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366aa29-ef72-4d7a-92ac-236f45cb2ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:40.158335 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366aa29-ef72-4d7a-92ac-236f45cb2ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:40.158614 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366aa29-ef72-4d7a-92ac-236f45cb2ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:40.158917 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366aa29-ef72-4d7a-92ac-236f45cb2ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:40.167285 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366aa29-ef72-4d7a-92ac-236f45cb2ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:40.168946 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366aa29-ef72-4d7a-92ac-236f45cb2ea3 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:40.178301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1460/2915] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:53:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:50.174266 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=6 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:30.226107 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871efb22-2c97-42e2-a473-d90d4653db04 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:30.247231 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871efb22-2c97-42e2-a473-d90d4653db04 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:30.253328 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b16755-ded9-40e4-a0b4-306c06f0b714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04f5fbbe45ec4dcf8301da8483af2941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:30.253993 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b16755-ded9-40e4-a0b4-306c06f0b714 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:30.254979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b16755-ded9-40e4-a0b4-306c06f0b714 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:30.254979 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b16755-ded9-40e4-a0b4-306c06f0b714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:30.265395 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b16755-ded9-40e4-a0b4-306c06f0b714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:30.267015 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b16755-ded9-40e4-a0b4-306c06f0b714 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:30.279737 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1456/2916] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:54:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:54:40.275515 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=9 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:43.593195 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366aa29-ef72-4d7a-92ac-236f45cb2ea3 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:43.635226 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366aa29-ef72-4d7a-92ac-236f45cb2ea3 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:43.639301 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a1ddc-f8ee-42f5-b9e5-1b22313dcb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2ea8fd0ebfd42fdbed9a989d85c8787', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:43.639944 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a1ddc-f8ee-42f5-b9e5-1b22313dcb30 service neutron] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:43.640236 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a1ddc-f8ee-42f5-b9e5-1b22313dcb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:43.640512 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a1ddc-f8ee-42f5-b9e5-1b22313dcb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:43.642325 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-8c8a1ddc-f8ee-42f5-b9e5-1b22313dcb30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:43.765199 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a1ddc-f8ee-42f5-b9e5-1b22313dcb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:43.766659 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a1ddc-f8ee-42f5-b9e5-1b22313dcb30 service neutron] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:43.788777 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1461/2917] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:46.782961 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b16755-ded9-40e4-a0b4-306c06f0b714 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:46.828508 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b16755-ded9-40e4-a0b4-306c06f0b714 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:46.834449 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec81f4-e962-47f7-beeb-6aa5bce2b5ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:46.835110 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec81f4-e962-47f7-beeb-6aa5bce2b5ba service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:46.835394 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec81f4-e962-47f7-beeb-6aa5bce2b5ba service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:46.835686 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec81f4-e962-47f7-beeb-6aa5bce2b5ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:46.839585 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-52ec81f4-e962-47f7-beeb-6aa5bce2b5ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:46.853116 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec81f4-e962-47f7-beeb-6aa5bce2b5ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:46.854761 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec81f4-e962-47f7-beeb-6aa5bce2b5ba service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:46.873542 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1457/2918] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:54:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:50.167240 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a1ddc-f8ee-42f5-b9e5-1b22313dcb30 service neutron] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:50.194883 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a1ddc-f8ee-42f5-b9e5-1b22313dcb30 service neutron] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:50.200109 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3d4aa-b76b-4e4a-9f27-8fc0045b3188 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:50.200972 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3d4aa-b76b-4e4a-9f27-8fc0045b3188 service placement] REQUEST_METHOD: `GET` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:50.201258 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3d4aa-b76b-4e4a-9f27-8fc0045b3188 service placement] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:50.201714 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3d4aa-b76b-4e4a-9f27-8fc0045b3188 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:50.203542 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-eaf3d4aa-b76b-4e4a-9f27-8fc0045b3188 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:50.216540 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3d4aa-b76b-4e4a-9f27-8fc0045b3188 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:50.218146 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3d4aa-b76b-4e4a-9f27-8fc0045b3188 service placement] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:50.229828 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1462/2919] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:54:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:50.253435 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec81f4-e962-47f7-beeb-6aa5bce2b5ba service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:50.255378 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-52ec81f4-e962-47f7-beeb-6aa5bce2b5ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:50.270584 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec81f4-e962-47f7-beeb-6aa5bce2b5ba service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:50.276531 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:50.277743 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:50.277958 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:50.278135 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] PATH_INFO: `/v3/users/3c4e48e94f934a3baf6a09a2b2d8f85d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:50.280238 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c4e48e94f934a3baf6a09a2b2d8f85d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:50.281430 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:50.333089 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c4e48e94f934a3baf6a09a2b2d8f85d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.333857 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c4e48e94f934a3baf6a09a2b2d8f85d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.334500 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c4e48e94f934a3baf6a09a2b2d8f85d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.346633 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c4e48e94f934a3baf6a09a2b2d8f85d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.355520 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c4e48e94f934a3baf6a09a2b2d8f85d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.370258 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1458/2920] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:54:50 2022] DELETE /identity/v3/users/3c4e48e94f934a3baf6a09a2b2d8f85d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:50.552050 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3d4aa-b76b-4e4a-9f27-8fc0045b3188 service placement] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:50.564128 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3d4aa-b76b-4e4a-9f27-8fc0045b3188 service placement] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:50.626872 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=100 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:50.634167 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:50.635204 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:50.635494 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:50.635775 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] PATH_INFO: `/v3/projects/6113ad5a21fa49d6906e26db6cf348a3` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:50.637218 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6113ad5a21fa49d6906e26db6cf348a3)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:50.639158 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:50.696454 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6113ad5a21fa49d6906e26db6cf348a3', 'request_id': 'req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.704565 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6113ad5a21fa49d6906e26db6cf348a3', 'request_id': 'req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.711656 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6113ad5a21fa49d6906e26db6cf348a3', 'request_id': 'req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.723143 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] The token cache is being invalidate because project 6113ad5a21fa49d6906e26db6cf348a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:50.723437 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.724111 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.725742 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1463/2921] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:54:50 2022] DELETE /identity/v3/projects/6113ad5a21fa49d6906e26db6cf348a3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:50.729861 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:50.731598 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:50.745662 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736174e7-d8c7-4fe0-a8bb-4cb40b6875e8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:50.809794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:50.810688 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:50.810983 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:50.811265 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] PATH_INFO: `/v3/users/a4686a8867424a2498eb1572971d509a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:50.812499 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4686a8867424a2498eb1572971d509a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:50.814512 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:50.859514 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:50.872101 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4686a8867424a2498eb1572971d509a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.872794 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4686a8867424a2498eb1572971d509a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.873407 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4686a8867424a2498eb1572971d509a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.888910 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4686a8867424a2498eb1572971d509a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.896267 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4686a8867424a2498eb1572971d509a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:50.912674 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1459/2922] 10.222.0.39 () {58 vars in 1223 bytes} [Thu May 26 12:54:50 2022] DELETE /identity/v3/users/a4686a8867424a2498eb1572971d509a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:51.104378 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] Authenticating user token {{(pid=80140) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:51.106101 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.fernet_utils [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80140) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:51.121732 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe0aa2-4bdf-45d1-afc6-a52d174b9b43 admin admin] Validating token access rules against request {{(pid=80140) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:51.194900 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64155bb2-c98d-44c5-a2ca-328b3de19027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb812d57b84461b8b6450ef1b357cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '051f7e40d662400dae586acf29916006', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80140) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:51.195804 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64155bb2-c98d-44c5-a2ca-328b3de19027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:51.196089 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64155bb2-c98d-44c5-a2ca-328b3de19027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:51.196367 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64155bb2-c98d-44c5-a2ca-328b3de19027 admin admin] PATH_INFO: `/v3/projects/5e0b25b703a0489698549d83d7d46d83` {{(pid=80140) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:51.197610 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64155bb2-c98d-44c5-a2ca-328b3de19027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0b25b703a0489698549d83d7d46d83)` {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:51.199537 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64155bb2-c98d-44c5-a2ca-328b3de19027 admin admin] RBAC: Authorization granted {{(pid=80140) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:51.258425 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-64155bb2-c98d-44c5-a2ca-328b3de19027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0b25b703a0489698549d83d7d46d83', 'request_id': 'req-64155bb2-c98d-44c5-a2ca-328b3de19027'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:51.268759 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-64155bb2-c98d-44c5-a2ca-328b3de19027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0b25b703a0489698549d83d7d46d83', 'request_id': 'req-64155bb2-c98d-44c5-a2ca-328b3de19027'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:51.275861 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-64155bb2-c98d-44c5-a2ca-328b3de19027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0b25b703a0489698549d83d7d46d83', 'request_id': 'req-64155bb2-c98d-44c5-a2ca-328b3de19027'} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:51.287106 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-64155bb2-c98d-44c5-a2ca-328b3de19027 admin admin] The token cache is being invalidate because project 5e0b25b703a0489698549d83d7d46d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80140) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:51.287391 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-64155bb2-c98d-44c5-a2ca-328b3de19027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:51.288047 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG keystone.notifications [None req-64155bb2-c98d-44c5-a2ca-328b3de19027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80140) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:51.289636 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: [pid: 80140|app: 0|req: 1464/2923] 10.222.0.39 () {58 vars in 1232 bytes} [Thu May 26 12:54:51 2022] DELETE /identity/v3/projects/5e0b25b703a0489698549d83d7d46d83 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:00.907933 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=15,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:01.283587 dv-cinder-815145-10-iscsi devstack@keystone.service[80140]: DEBUG dbcounter [-] [80140] Writing DB stats keystone:SELECT=76,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:38.484760 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:38.486292 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:38.582281 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cca4d-6273-45ac-9471-11de90703cc7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:38.642115 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c563dae-e128-4c4b-9724-73b56d1d3155 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b39eb81eb6a64556a4079115d27f1624', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b341d104240e4b4cb61d365e8167f6a8', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:38.642774 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c563dae-e128-4c4b-9724-73b56d1d3155 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:38.643058 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c563dae-e128-4c4b-9724-73b56d1d3155 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:38.643338 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c563dae-e128-4c4b-9724-73b56d1d3155 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:38.645199 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8c563dae-e128-4c4b-9724-73b56d1d3155 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:38.656916 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c563dae-e128-4c4b-9724-73b56d1d3155 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:38.659381 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c563dae-e128-4c4b-9724-73b56d1d3155 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:38.669402 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1460/2924] 10.222.0.39 () {60 vars in 1365 bytes} [Thu May 26 12:56:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:56:48.665047 dv-cinder-815145-10-iscsi devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=67 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}